-- Logs begin at Fri 2022-07-01 02:34:38 UTC, end at Fri 2022-07-01 04:20:01 UTC. -- Jul 01 03:41:52.590113 dv-cinder-846842-8-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 01 03:41:52.599955 dv-cinder-846842-8-smb devstack@keystone.service[80364]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 01 03:41:52.602012 dv-cinder-846842-8-smb devstack@keystone.service[80364]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 1 03:41:52 2022] *** Jul 01 03:41:52.602012 dv-cinder-846842-8-smb devstack@keystone.service[80364]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 01 03:41:52.602012 dv-cinder-846842-8-smb devstack@keystone.service[80364]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 01 03:41:52.602012 dv-cinder-846842-8-smb devstack@keystone.service[80364]: nodename: dv-cinder-846842-8-smb Jul 01 03:41:52.602012 dv-cinder-846842-8-smb devstack@keystone.service[80364]: machine: x86_64 Jul 01 03:41:52.602012 dv-cinder-846842-8-smb devstack@keystone.service[80364]: clock source: unix Jul 01 03:41:52.602012 dv-cinder-846842-8-smb devstack@keystone.service[80364]: pcre jit disabled Jul 01 03:41:52.602012 dv-cinder-846842-8-smb devstack@keystone.service[80364]: detected number of CPU cores: 4 Jul 01 03:41:52.602012 dv-cinder-846842-8-smb devstack@keystone.service[80364]: current working directory: / Jul 01 03:41:52.602012 dv-cinder-846842-8-smb devstack@keystone.service[80364]: detected binary path: /usr/bin/uwsgi-core Jul 01 03:41:52.602012 dv-cinder-846842-8-smb devstack@keystone.service[80364]: your processes number limit is 47680 Jul 01 03:41:52.602012 dv-cinder-846842-8-smb devstack@keystone.service[80364]: your memory page size is 4096 bytes Jul 01 03:41:52.602012 dv-cinder-846842-8-smb devstack@keystone.service[80364]: detected max file descriptor number: 2048 Jul 01 03:41:52.602012 dv-cinder-846842-8-smb devstack@keystone.service[80364]: lock engine: pthread robust mutexes Jul 01 03:41:52.603197 dv-cinder-846842-8-smb devstack@keystone.service[80364]: thunder lock: enabled Jul 01 03:41:52.603197 dv-cinder-846842-8-smb devstack@keystone.service[80364]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 01 03:41:52.603197 dv-cinder-846842-8-smb devstack@keystone.service[80364]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 01 03:41:52.647756 dv-cinder-846842-8-smb devstack@keystone.service[80364]: Python main interpreter initialized at 0x55a4590a19c0 Jul 01 03:41:52.647756 dv-cinder-846842-8-smb devstack@keystone.service[80364]: python threads support enabled Jul 01 03:41:52.647756 dv-cinder-846842-8-smb devstack@keystone.service[80364]: your server socket listen backlog is limited to 100 connections Jul 01 03:41:52.647756 dv-cinder-846842-8-smb devstack@keystone.service[80364]: your mercy for graceful operations on workers is 90 seconds Jul 01 03:41:52.648178 dv-cinder-846842-8-smb devstack@keystone.service[80364]: mapped 403077 bytes (393 KB) for 2 cores Jul 01 03:41:52.648249 dv-cinder-846842-8-smb devstack@keystone.service[80364]: *** Operational MODE: preforking *** Jul 01 03:41:52.648558 dv-cinder-846842-8-smb devstack@keystone.service[80364]: *** uWSGI is running in multiple interpreter mode *** Jul 01 03:41:52.648558 dv-cinder-846842-8-smb devstack@keystone.service[80364]: spawned uWSGI master process (pid: 80364) Jul 01 03:41:52.648775 dv-cinder-846842-8-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 01 03:41:52.650344 dv-cinder-846842-8-smb devstack@keystone.service[80364]: spawned uWSGI worker 1 (pid: 80376, cores: 1) Jul 01 03:41:52.650344 dv-cinder-846842-8-smb devstack@keystone.service[80364]: spawned uWSGI worker 2 (pid: 80377, cores: 1) Jul 01 03:41:52.650344 dv-cinder-846842-8-smb devstack@keystone.service[80364]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 01 03:41:58.172001 dv-cinder-846842-8-smb devstack@keystone.service[80377]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 03:41:58.172001 dv-cinder-846842-8-smb devstack@keystone.service[80377]: from cryptography.utils import int_from_bytes Jul 01 03:41:58.172817 dv-cinder-846842-8-smb devstack@keystone.service[80377]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 03:41:58.172817 dv-cinder-846842-8-smb devstack@keystone.service[80377]: from cryptography.utils import int_from_bytes Jul 01 03:41:58.172931 dv-cinder-846842-8-smb devstack@keystone.service[80376]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 03:41:58.172931 dv-cinder-846842-8-smb devstack@keystone.service[80376]: from cryptography.utils import int_from_bytes Jul 01 03:41:58.173346 dv-cinder-846842-8-smb devstack@keystone.service[80376]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 03:41:58.173346 dv-cinder-846842-8-smb devstack@keystone.service[80376]: from cryptography.utils import int_from_bytes Jul 01 03:41:58.222615 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 01 03:41:58.222798 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 01 03:41:58.222983 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] command line args: [] {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 01 03:41:58.223245 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 01 03:41:58.223420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ================================================================================ {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 01 03:41:58.223701 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] admin_token = **** {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.223942 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] config_dir = [] {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.224127 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.224306 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] config_source = [] {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.224510 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] debug = True {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.224715 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.225085 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.225173 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 01 03:41:58.225248 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.225312 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 01 03:41:58.225500 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.225591 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] command line args: [] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 01 03:41:58.225746 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.225858 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 01 03:41:58.225956 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ================================================================================ {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 01 03:41:58.226067 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] list_limit = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.226169 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] log_config_append = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.226275 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] admin_token = **** {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.226378 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.226474 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] config_dir = [] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.226582 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] log_dir = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.226684 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.226785 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] log_file = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.226892 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] config_source = [] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.226994 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.227101 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] debug = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.227211 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.227312 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.227466 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.230653 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.230653 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.230867 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.230867 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.231075 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.231157 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.231234 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.231309 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.231380 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] list_limit = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.231473 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.231561 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] log_config_append = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.231561 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.231701 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.231777 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] log_dir = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.231852 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.231922 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] log_file = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.232001 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.232076 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.232151 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.232226 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.232295 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.232368 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.232448 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.232524 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.232601 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.232677 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.232677 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.232677 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.232874 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.46/identity {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.232951 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.233022 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] publish_errors = False {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.233150 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.233229 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.233305 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.233375 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.233448 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.233523 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.233600 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.233671 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.233739 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.233807 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.233876 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.233950 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] standard_threads = False {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.234030 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.234102 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.234102 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.234102 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.234308 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.46/identity {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.234388 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] use_journal = False {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.234459 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] publish_errors = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.234533 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] use_json = False {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.234613 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.234689 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] use_stderr = False {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.234765 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.234839 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] use_syslog = False {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.234914 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.234990 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.235139 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.235217 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.235288 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.235357 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.235425 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] standard_threads = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.235565 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.235654 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.235732 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.235808 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.235880 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.235954 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.235954 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] use_journal = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.236147 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.236220 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] use_json = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.236290 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.236360 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] use_stderr = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.236440 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.236512 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] use_syslog = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.236592 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.236663 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 03:41:58.236732 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.236806 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.236882 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.236957 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.237040 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.237111 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.237185 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.237255 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.237330 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.237407 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.237485 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.237556 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.237630 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.237705 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.237829 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.237913 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.237992 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.238064 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.238138 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.238214 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.238284 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.238358 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.238428 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.238497 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.238639 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.238726 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.238877 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.239014 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.239172 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.239252 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.239359 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.239528 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.239621 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.239763 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.239872 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.239996 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.240127 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.240213 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.240373 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.240462 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.240612 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.240694 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.240866 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.240944 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.241127 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.241216 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.241354 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.241432 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.241599 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.241676 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.241832 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.241918 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.242066 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.242150 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.242307 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.242445 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.242569 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.242696 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.242811 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.242924 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.243044 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.243196 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.243322 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.243464 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.243594 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.243711 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.243838 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.243944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.244039 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.244147 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.244245 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.244341 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.244438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.244534 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.244636 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.244742 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.244841 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.244953 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.245068 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.245183 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.245308 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.245426 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.245553 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.245670 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.245774 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.245892 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.246013 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.246129 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.246252 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.246364 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.246480 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.246595 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.246711 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.246831 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.246955 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.247071 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.247185 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.247290 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.247402 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.247555 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.247684 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.247790 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.247903 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.248018 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.248171 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.248171 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.248387 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.248387 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.248623 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.248742 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.248862 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.248862 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.249075 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.249190 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.249407 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.249407 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.249624 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.249738 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.249862 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.249979 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.250100 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.250216 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.250337 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.250452 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.250578 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.250696 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.250811 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.251002 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.251121 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.251239 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.251365 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.251506 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.251631 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.251756 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.251872 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.251985 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.252112 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.252236 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.252361 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.252476 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.252590 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.252704 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.252825 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.252949 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.253072 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.253187 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.253301 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.253415 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.253529 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.253649 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.253775 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.253892 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.254005 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.254118 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.254232 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.254345 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.254467 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.254583 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.254696 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.254810 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.254924 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.254924 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.255153 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.255268 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.255381 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.255511 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.255627 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.255751 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.255879 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.255996 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.256109 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.256223 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.256337 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.256462 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.256577 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.256692 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.256805 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.256919 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.257039 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.257163 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.257284 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.257398 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.257512 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.257625 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.257738 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.257859 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.257975 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.258095 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.258210 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.258210 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.258437 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] auth.external = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.258437 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.258666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.258666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.258860 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.258963 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.259061 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.259165 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.259262 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] auth.password = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.259358 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.259521 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] auth.token = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.259626 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.259723 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.265012 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.265191 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.265284 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.265366 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.265440 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.265512 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.265583 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] auth.external = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.265654 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.265736 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.265810 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.265881 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.265960 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.266033 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.266104 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] credential.caching = True {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.266183 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] auth.password = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.266259 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.266330 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] auth.token = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.266407 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.266485 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.266558 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.266639 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.266712 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.266789 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.266861 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.266932 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.267002 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.267080 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.267153 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.267224 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.267294 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.267364 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.267435 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.267584 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] credential.caching = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.267664 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.267736 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.267736 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.267939 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.268021 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.268218 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.268298 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.268370 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.268440 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.268511 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.268581 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.268659 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.268733 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.268810 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] federation.caching = True {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.268887 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.268959 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.269028 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.269108 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.269180 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.269250 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.269328 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.269401 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.269471 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.269551 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.269551 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.269681 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.269751 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.269822 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.269891 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.269970 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.270042 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.270118 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] federation.caching = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.270190 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.270259 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.270329 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.270408 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.270480 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] identity.caching = True {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.270550 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.270620 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.270696 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.270774 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.270848 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.270918 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.270988 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.271058 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.271127 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.271206 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.271278 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.271349 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.271418 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.271541 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.271625 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.271708 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.271781 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.271852 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.271923 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] identity.caching = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.271993 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.272069 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.272138 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.272210 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.272270 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.272395 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.272472 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.272544 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.272623 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.272697 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.272768 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.272844 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.272922 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.272983 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.273108 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.273186 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.273186 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.273314 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.273391 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.273464 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.273542 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.273616 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.273741 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.273823 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.273894 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.273965 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.274044 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.274123 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.274194 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.274264 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.274264 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.274392 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.274471 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.274549 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.274621 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.274692 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.274767 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.274838 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.274917 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.274990 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.275060 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.275129 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.275204 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.275276 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.275354 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.275426 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.275567 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.275643 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.275758 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.275843 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.275995 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.276078 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.276221 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.276302 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.276456 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.276538 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.276690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.276772 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.276932 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.277018 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.277166 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.277245 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.277401 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.277482 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.277646 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.277725 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.277969 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.278545 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.278707 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.278829 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.278943 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.279060 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.279176 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.279305 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.279433 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.279590 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.279706 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.279821 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.279935 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.280063 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.280180 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.280294 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.280408 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.280523 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.user = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.280637 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.280760 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.280883 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.280998 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.281114 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.281228 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.281349 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.281477 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.281593 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.281707 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.281821 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.281936 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.282050 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.282175 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.282291 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.282441 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.282560 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.282675 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.282791 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.282915 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.283032 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.283148 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.283265 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.283381 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.283510 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.283644 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.283764 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.283879 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.283994 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.284109 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.284226 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.284350 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.284468 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.284582 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.284697 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.284813 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.284928 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.285051 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.285169 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.285286 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.285401 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.285516 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.285631 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.285756 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.285873 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.285989 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.286103 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.286219 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.286335 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.286459 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.286576 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.286692 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.286812 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.286928 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.287042 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.287235 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.287354 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.287513 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.287631 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.287747 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.287862 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.287991 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.288109 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.288224 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.288339 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.288456 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.288572 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.288696 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.288813 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.288927 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.289042 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.289158 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.289263 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.289370 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] resource.caching = True {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.289470 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.289569 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.289683 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.289799 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.289914 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.290038 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.290155 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.290270 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.290385 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.290501 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.290617 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.290741 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.290857 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.290973 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.291088 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.291203 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.291318 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] resource.caching = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.291442 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.291825 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.291941 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] role.caching = True {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.292056 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.292171 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] role.driver = sql {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.292297 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.292424 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.292541 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.292658 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.292773 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.292888 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.293003 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.293110 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.293227 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.293333 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.293458 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.293636 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.293819 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.293819 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] role.caching = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.294022 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.294120 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] role.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.294217 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.294315 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.294420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.294521 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.294617 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.294716 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.294824 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.294921 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.295026 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.295125 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.295223 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.295320 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.295417 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.295586 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.299401 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.299537 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.299617 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.299735 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.299813 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.299886 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.299971 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.300055 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.300129 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.300200 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.300272 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.300343 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.300423 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.300501 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.300573 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.300645 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.300715 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.300787 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.300866 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.300940 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.301013 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.301084 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.301156 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.301227 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.301306 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.301380 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.301452 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.301523 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.301593 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.301672 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.301746 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.301817 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.301888 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.301958 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.302029 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.302107 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.302181 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.302252 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.302323 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] token.caching = True {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.302394 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.302466 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.302544 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.302618 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.302719 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.302794 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.302865 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.302936 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.303016 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.303090 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.303161 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.303282 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.303358 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.303430 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.303547 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] token.caching = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.303623 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.303695 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.303765 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.303835 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.303906 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.303986 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.304059 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.304131 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.304202 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.304272 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.304341 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.304420 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.304493 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.304563 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.304634 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.304704 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.304775 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.304854 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.304928 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.305005 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.305077 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] database.connection = **** {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.305156 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.305237 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.305311 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.305390 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.305464 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.305535 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.305606 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.305677 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.305747 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.305825 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.305899 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.305970 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.306040 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.306111 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.306181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] database.connection = **** {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.306267 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.306417 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.306501 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.306575 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.306646 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.306716 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.306788 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.306859 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.306938 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.307060 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.307136 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.307208 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.307280 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.307350 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.307550 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.307635 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.307782 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.307864 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.308020 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.308099 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.308252 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.308335 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.308407 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80376) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 01 03:41:58.308502 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.308750 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.308987 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.309280 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.309512 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.309752 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.309986 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 03:41:58.310157 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 01 03:41:58.339489 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80376) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.339684 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.339769 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80376) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.339843 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.339916 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80376) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.340025 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.349019 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.349166 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80376) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.377521 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.377751 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.381976 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80376) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.382203 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80376) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.520528 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.522757 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80376) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.569687 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.569909 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.570492 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80376) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.570727 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80376) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.635429 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.635690 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.635804 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80376) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.635909 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.635992 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80376) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.636126 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80376) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.636207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.636340 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.636432 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80376) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.636556 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80376) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.636642 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.636771 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80376) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.668371 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80376) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.668661 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.668797 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80376) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.668878 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.668946 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80376) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.669018 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.669101 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80376) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.669176 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.669307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80376) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.669436 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.669521 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.669599 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80376) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.669713 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80376) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.669799 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.681025 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.681437 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80376) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.703366 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80376) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.703613 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80376) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.703861 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80376) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.703949 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.704086 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80376) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.704213 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.704309 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80376) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.704389 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.704490 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80376) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.704575 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.704702 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80376) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.704786 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.704930 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.705148 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 03:41:58.722007 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.722163 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.722249 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 01 03:41:58.722374 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 01 03:41:58.722566 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.722763 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 01 03:41:58.722926 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.723027 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.723130 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 01 03:41:58.723283 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.723395 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.723566 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.723688 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.723822 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.723945 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.724201 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.735134 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.735411 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.735718 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.735802 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.735996 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.736080 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.736259 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.736535 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.744399 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80376) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 03:41:58.744769 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 03:41:58.748213 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80376) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 03:41:58.748497 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.748655 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 03:41:58.748772 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.748931 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.749044 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.749207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.749323 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.749481 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.749571 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.749758 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.749839 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.750014 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.750095 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.750279 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.750368 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.750586 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.750685 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.750814 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.750896 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.751080 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.751338 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.777232 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.777522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.778895 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80376) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 03:41:58.779155 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 03:41:58.779240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.779434 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.784417 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80376) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 03:41:58.784691 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.784780 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 03:41:58.784996 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.785090 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.785265 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.792863 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 03:41:58.792960 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80376) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 03:41:58.793141 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.793224 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.798076 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 03:41:58.798177 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80376) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 03:41:58.798358 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.798456 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.798635 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.798718 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.798908 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.798988 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.799175 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.799267 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.799470 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.799562 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.799728 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.799810 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.799987 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.800168 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.819185 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.819335 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.819469 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.819639 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.823996 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 03:41:58.824166 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80376) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 03:41:58.827873 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.828165 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.828806 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.829099 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.834096 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80376) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 03:41:58.835311 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 03:41:58.837762 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80376) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 03:41:58.841799 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 03:41:58.842693 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.842988 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.843264 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.843569 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.843838 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.843961 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.844114 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.844293 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.844756 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.845383 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.845887 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.846327 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.863956 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 03:41:58.864258 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.875835 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.875835 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.876026 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80376) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 03:41:58.876026 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.876026 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.876026 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.876275 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.876275 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.876275 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.877757 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.878898 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 03:41:58.879191 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.879494 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.879584 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.879768 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.879856 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.880063 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.883159 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80376) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 03:41:58.883473 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.883763 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.884042 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.884316 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.893769 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 03:41:58.894074 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.894365 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.894645 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.894922 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.895194 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.895513 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.897709 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80376) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 03:41:58.898004 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.898282 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.898558 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.898841 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.899112 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.899400 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.914653 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 03:41:58.918192 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 03:41:58.919706 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80376) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 03:41:58.921992 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.922921 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80376) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 03:41:58.923623 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.925389 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 03:41:58.925666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.925945 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.926402 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.928067 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.929823 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80376) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 03:41:58.930100 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.930373 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.933297 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.935487 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 03:41:58.938245 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.938691 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.938992 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.939277 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.939590 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.939872 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80376) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 03:41:58.943043 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.943336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.943647 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.943919 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.948704 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 03:41:58.948994 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.949279 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.953058 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80376) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 03:41:58.953378 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.953718 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.957054 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 03:41:58.957338 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.957623 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.957901 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.958172 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.962086 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.962086 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.962086 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.962086 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.962086 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.962086 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.962480 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.962480 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.962480 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.962682 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80376) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 03:41:58.962682 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.962682 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.962682 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.962682 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.962993 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.963161 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.963474 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.963858 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.964126 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.964400 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.964659 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.964920 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.965188 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80376) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 03:41:58.998992 dv-cinder-846842-8-smb devstack@keystone.service[80377]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a4590a19c0 pid: 80377 (default app) Jul 01 03:41:59.002461 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f9f98-618f-4141-9207-775521cb1d85 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:41:59.002764 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f9f98-618f-4141-9207-775521cb1d85 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:41:59.003046 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f9f98-618f-4141-9207-775521cb1d85 None None] PATH_INFO: `/v3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:41:59.003874 dv-cinder-846842-8-smb devstack@keystone.service[80376]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55a4590a19c0 pid: 80376 (default app) Jul 01 03:41:59.007242 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 791 bytes} [Fri Jul 1 03:41:58 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:07.553276 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe88aa-d06b-48ce-a23f-6aedf62d2c67 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:07.553789 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe88aa-d06b-48ce-a23f-6aedf62d2c67 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:07.553873 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe88aa-d06b-48ce-a23f-6aedf62d2c67 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:07.558158 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1/2] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:42:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 03:42:07.563327 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343d86e-1ac9-4752-baec-a341db863793 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:07.563705 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343d86e-1ac9-4752-baec-a341db863793 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:07.563912 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343d86e-1ac9-4752-baec-a341db863793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:07.632516 dv-cinder-846842-8-smb devstack@keystone.service[80377]: INFO dbcounter [None req-e343d86e-1ac9-4752-baec-a341db863793 None None] Registered counter for database keystone Jul 01 03:42:07.654017 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG oslo_db.sqlalchemy.engines [None req-e343d86e-1ac9-4752-baec-a341db863793 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80377) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 03:42:07.660415 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writer thread running {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 03:42:07.834496 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG passlib.handlers.bcrypt [None req-e343d86e-1ac9-4752-baec-a341db863793 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80377) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 01 03:42:07.834816 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG passlib.handlers.bcrypt [None req-e343d86e-1ac9-4752-baec-a341db863793 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80377) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 01 03:42:07.888697 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-e343d86e-1ac9-4752-baec-a341db863793 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:42:07.890270 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e343d86e-1ac9-4752-baec-a341db863793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:42:08.009554 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 2/3] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:42:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 447 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 01 03:42:08.082804 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe88aa-d06b-48ce-a23f-6aedf62d2c67 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:08.152174 dv-cinder-846842-8-smb devstack@keystone.service[80376]: INFO dbcounter [None req-9fbe88aa-d06b-48ce-a23f-6aedf62d2c67 None None] Registered counter for database keystone Jul 01 03:42:08.171399 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG oslo_db.sqlalchemy.engines [None req-9fbe88aa-d06b-48ce-a23f-6aedf62d2c67 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80376) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 03:42:08.177606 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writer thread running {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 03:42:08.303142 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe88aa-d06b-48ce-a23f-6aedf62d2c67 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:08.307351 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc3ca3-dc9b-4c5b-b236-9ee93079ff55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:08.308034 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc3ca3-dc9b-4c5b-b236-9ee93079ff55 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:08.308318 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc3ca3-dc9b-4c5b-b236-9ee93079ff55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:08.309108 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc3ca3-dc9b-4c5b-b236-9ee93079ff55 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:08.317226 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc3ca3-dc9b-4c5b-b236-9ee93079ff55 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:08.368054 dv-cinder-846842-8-smb devstack@keystone.service[80376]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ccdc3ca3-dc9b-4c5b-b236-9ee93079ff55 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 01 03:42:08.368394 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc3ca3-dc9b-4c5b-b236-9ee93079ff55 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:08.378675 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 2/4] 10.222.0.46 () {58 vars in 1324 bytes} [Fri Jul 1 03:42:08 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 01 03:42:08.384735 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343d86e-1ac9-4752-baec-a341db863793 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:08.399670 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343d86e-1ac9-4752-baec-a341db863793 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:08.404129 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed25466-a9ab-4125-b7f0-0eab1e289569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:08.405180 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed25466-a9ab-4125-b7f0-0eab1e289569 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:08.405464 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed25466-a9ab-4125-b7f0-0eab1e289569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:08.405740 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed25466-a9ab-4125-b7f0-0eab1e289569 admin admin] PATH_INFO: `/v3/projects/e246a3f333f94971a10397b9c77aad47` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:08.410010 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed25466-a9ab-4125-b7f0-0eab1e289569 admin admin] RBAC: Authorizing `identity:get_project(project_id=e246a3f333f94971a10397b9c77aad47)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:08.460951 dv-cinder-846842-8-smb devstack@keystone.service[80377]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bed25466-a9ab-4125-b7f0-0eab1e289569 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 01 03:42:08.461295 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed25466-a9ab-4125-b7f0-0eab1e289569 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:08.466011 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 3/5] 10.222.0.46 () {56 vars in 1207 bytes} [Fri Jul 1 03:42:08 2022] GET /identity/v3/projects/e246a3f333f94971a10397b9c77aad47 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:10.489327 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9e35b-039c-4445-a94a-11cf19cbb080 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:10.489832 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9e35b-039c-4445-a94a-11cf19cbb080 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:10.489913 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9e35b-039c-4445-a94a-11cf19cbb080 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:10.493996 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 3/6] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:42:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:42:10.499942 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36883304-c6f8-4f5b-8669-848aae12099e None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:10.500308 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36883304-c6f8-4f5b-8669-848aae12099e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:10.500501 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36883304-c6f8-4f5b-8669-848aae12099e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:10.519580 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-36883304-c6f8-4f5b-8669-848aae12099e None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:42:10.521099 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-36883304-c6f8-4f5b-8669-848aae12099e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:42:10.528816 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 4/7] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:42:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 01 03:42:10.551001 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9e35b-039c-4445-a94a-11cf19cbb080 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:10.563510 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9e35b-039c-4445-a94a-11cf19cbb080 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:10.567689 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c5ea0-349a-47d9-afde-f6eb333d6485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:10.568336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c5ea0-349a-47d9-afde-f6eb333d6485 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:10.568623 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c5ea0-349a-47d9-afde-f6eb333d6485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:10.568902 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c5ea0-349a-47d9-afde-f6eb333d6485 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:10.577295 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c5ea0-349a-47d9-afde-f6eb333d6485 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:10.579095 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c5ea0-349a-47d9-afde-f6eb333d6485 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:10.587847 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 4/8] 10.222.0.46 () {58 vars in 1324 bytes} [Fri Jul 1 03:42:10 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 03:42:10.593690 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36883304-c6f8-4f5b-8669-848aae12099e None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:10.605571 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36883304-c6f8-4f5b-8669-848aae12099e None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:10.609962 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb7516-b57f-4070-8be0-cc98982844ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:10.610830 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb7516-b57f-4070-8be0-cc98982844ca admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:10.611113 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb7516-b57f-4070-8be0-cc98982844ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:10.611388 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb7516-b57f-4070-8be0-cc98982844ca admin admin] PATH_INFO: `/v3/users/25426a981a294fbbafc4d23f43e2ba63` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:10.612809 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeb7516-b57f-4070-8be0-cc98982844ca admin admin] RBAC: Authorizing `identity:get_user(user_id=25426a981a294fbbafc4d23f43e2ba63)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:10.614645 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeb7516-b57f-4070-8be0-cc98982844ca admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:10.616268 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 5/9] 10.222.0.46 () {56 vars in 1198 bytes} [Fri Jul 1 03:42:10 2022] GET /identity/v3/users/25426a981a294fbbafc4d23f43e2ba63 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:12.716611 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62dd98-468b-4a01-a4b4-5e87fbcd6b2e None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:12.717151 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62dd98-468b-4a01-a4b4-5e87fbcd6b2e None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:12.717517 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62dd98-468b-4a01-a4b4-5e87fbcd6b2e None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:12.719897 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 5/10] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:42:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:42:12.727508 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d924e90-84aa-438b-984e-49be1defb0f8 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:12.728243 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d924e90-84aa-438b-984e-49be1defb0f8 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:12.728536 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d924e90-84aa-438b-984e-49be1defb0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:12.746913 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-2d924e90-84aa-438b-984e-49be1defb0f8 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:42:12.748328 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2d924e90-84aa-438b-984e-49be1defb0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:42:12.780143 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636b8f3-d839-4625-9e62-97a06a6f6c0b None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:12.780311 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636b8f3-d839-4625-9e62-97a06a6f6c0b None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:12.780591 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636b8f3-d839-4625-9e62-97a06a6f6c0b None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:12.781954 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 6/11] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 03:42:12.787706 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49647d-8f2d-493d-8137-6dfd19bede54 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:12.787994 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49647d-8f2d-493d-8137-6dfd19bede54 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:12.788276 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49647d-8f2d-493d-8137-6dfd19bede54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:12.829490 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG passlib.handlers.bcrypt [None req-bf49647d-8f2d-493d-8137-6dfd19bede54 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80376) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 01 03:42:12.830013 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG passlib.handlers.bcrypt [None req-bf49647d-8f2d-493d-8137-6dfd19bede54 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80376) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 01 03:42:12.856117 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 6/12] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:42:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:42:12.877000 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-bf49647d-8f2d-493d-8137-6dfd19bede54 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:42:12.878857 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-bf49647d-8f2d-493d-8137-6dfd19bede54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:42:12.879123 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d924e90-84aa-438b-984e-49be1defb0f8 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:12.906747 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:13.001425 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 7/13] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:42:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 03:42:13.008356 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d924e90-84aa-438b-984e-49be1defb0f8 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:13.029759 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf49647d-8f2d-493d-8137-6dfd19bede54 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:13.050229 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e318dfd-e917-4983-9f93-e6164ece534b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:13.050950 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e318dfd-e917-4983-9f93-e6164ece534b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:13.051258 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e318dfd-e917-4983-9f93-e6164ece534b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:13.051557 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e318dfd-e917-4983-9f93-e6164ece534b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:13.064238 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e318dfd-e917-4983-9f93-e6164ece534b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:42:13.076074 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-3e318dfd-e917-4983-9f93-e6164ece534b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:42:13.076074 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:42:13.076074 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:42:13.076074 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:42:13.076074 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:42:13.076074 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:42:13.076074 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:42:13.076074 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:42:13.076074 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:42:13.076074 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:42:13.076074 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:42:13.076074 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:42:13.076074 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:42:13.076074 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:42:13.076074 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:42:13.076074 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:42:13.077832 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:42:13.077832 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:42:13.077832 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:42:13.077832 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:42:13.077832 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:42:13.077832 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:42:13.077832 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:42:13.077832 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:42:13.077832 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:42:13.077832 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:42:13.077832 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:42:13.077832 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:42:13.077832 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:42:13.077832 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:42:13.077832 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:42:13.077832 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:42:13.079399 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:42:13.079399 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:42:13.079399 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:42:13.079399 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:42:13.079399 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:42:13.079399 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:42:13.079399 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:42:13.079399 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:42:13.079399 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:42:13.079399 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:42:13.079399 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:42:13.079399 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:42:13.079399 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 7/14] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 1 03:42:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 03:42:13.083199 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e318dfd-e917-4983-9f93-e6164ece534b None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:13.172064 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:13.179180 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf49647d-8f2d-493d-8137-6dfd19bede54 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:13.183036 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:13.194048 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e318dfd-e917-4983-9f93-e6164ece534b None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:13.230972 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2e7de-8456-455b-b92d-44dc8e652a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:13.231678 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2e7de-8456-455b-b92d-44dc8e652a0f None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:13.231965 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2e7de-8456-455b-b92d-44dc8e652a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:13.232243 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2e7de-8456-455b-b92d-44dc8e652a0f None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:13.232366 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55f499-9838-4273-bc9e-68e64cb01d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:13.233003 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2e7de-8456-455b-b92d-44dc8e652a0f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:42:13.233312 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2e7de-8456-455b-b92d-44dc8e652a0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:13.233912 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55f499-9838-4273-bc9e-68e64cb01d6b None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:13.234418 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55f499-9838-4273-bc9e-68e64cb01d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:13.234823 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2e7de-8456-455b-b92d-44dc8e652a0f None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:13.234956 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55f499-9838-4273-bc9e-68e64cb01d6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:13.247669 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 8/15] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:42:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:42:13.253273 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2e7de-8456-455b-b92d-44dc8e652a0f None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:13.337421 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da55f499-9838-4273-bc9e-68e64cb01d6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:13.340572 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da55f499-9838-4273-bc9e-68e64cb01d6b None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:13.383866 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2e7de-8456-455b-b92d-44dc8e652a0f None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:13.440096 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18c2ea-eb00-46fd-bea2-a0f8f6316094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:13.440988 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18c2ea-eb00-46fd-bea2-a0f8f6316094 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:13.441271 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18c2ea-eb00-46fd-bea2-a0f8f6316094 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:13.441548 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18c2ea-eb00-46fd-bea2-a0f8f6316094 None admin] PATH_INFO: `/v3/users/25426a981a294fbbafc4d23f43e2ba63` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:13.442761 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18c2ea-eb00-46fd-bea2-a0f8f6316094 None admin] RBAC: Authorizing `identity:get_user(user_id=25426a981a294fbbafc4d23f43e2ba63)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:13.444272 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18c2ea-eb00-46fd-bea2-a0f8f6316094 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:13.445937 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 9/16] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:42:13 2022] GET /identity/v3/users/25426a981a294fbbafc4d23f43e2ba63 => generated 247 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:42:13.452164 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18c2ea-eb00-46fd-bea2-a0f8f6316094 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:13.452959 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 8/17] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:42:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 01 03:42:13.459775 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55f499-9838-4273-bc9e-68e64cb01d6b None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:13.464902 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:13.469671 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:13.580361 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18c2ea-eb00-46fd-bea2-a0f8f6316094 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:13.597420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55f499-9838-4273-bc9e-68e64cb01d6b None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:13.627695 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786949f-e1ad-412a-89a2-42f74047209d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:13.629070 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786949f-e1ad-412a-89a2-42f74047209d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:13.629580 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786949f-e1ad-412a-89a2-42f74047209d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:13.630096 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786949f-e1ad-412a-89a2-42f74047209d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:13.632207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786949f-e1ad-412a-89a2-42f74047209d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:13.635005 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786949f-e1ad-412a-89a2-42f74047209d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:13.637466 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7833e8d-e1a4-4c51-8daa-d2ff5d22a141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:13.638264 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7833e8d-e1a4-4c51-8daa-d2ff5d22a141 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:13.638550 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7833e8d-e1a4-4c51-8daa-d2ff5d22a141 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:13.638712 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 10/18] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:42:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:13.638843 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7833e8d-e1a4-4c51-8daa-d2ff5d22a141 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:13.645451 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786949f-e1ad-412a-89a2-42f74047209d None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:13.658314 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7833e8d-e1a4-4c51-8daa-d2ff5d22a141 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:13.659972 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7833e8d-e1a4-4c51-8daa-d2ff5d22a141 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:13.684986 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-b7833e8d-e1a4-4c51-8daa-d2ff5d22a141 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:42:13.684986 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:42:13.684986 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:42:13.684986 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:42:13.684986 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:42:13.684986 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:42:13.684986 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:42:13.684986 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:42:13.684986 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:42:13.684986 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:42:13.684986 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:42:13.684986 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:42:13.684986 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:42:13.684986 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:42:13.684986 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:42:13.686560 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:42:13.686560 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:42:13.686560 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:42:13.686560 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:42:13.686560 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:42:13.686560 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:42:13.686560 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:42:13.686560 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:42:13.686560 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:42:13.686560 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:42:13.686560 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:42:13.686560 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:42:13.686560 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:42:13.686560 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:42:13.686560 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:42:13.686560 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:42:13.686560 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:42:13.688138 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:42:13.688138 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:42:13.688138 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:42:13.688138 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:42:13.688138 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 9/19] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:42:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 03:42:13.694155 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7833e8d-e1a4-4c51-8daa-d2ff5d22a141 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:13.755728 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:13.757924 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:13.777576 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786949f-e1ad-412a-89a2-42f74047209d None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:13.804308 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7833e8d-e1a4-4c51-8daa-d2ff5d22a141 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:13.819801 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a559b2-4dfe-408f-b87b-fdbb3f7485cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:13.820649 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a559b2-4dfe-408f-b87b-fdbb3f7485cb None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:13.821045 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a559b2-4dfe-408f-b87b-fdbb3f7485cb None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:13.821422 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a559b2-4dfe-408f-b87b-fdbb3f7485cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:13.822409 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a559b2-4dfe-408f-b87b-fdbb3f7485cb None admin] RBAC: Adding query filter params (role.id=681755518698445fabd9a8accec13c0f, scope.domain.id=default, user.id=25426a981a294fbbafc4d23f43e2ba63) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:42:13.822852 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a559b2-4dfe-408f-b87b-fdbb3f7485cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:13.824680 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a559b2-4dfe-408f-b87b-fdbb3f7485cb None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:13.832869 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 11/20] 10.222.0.46 () {56 vars in 1322 bytes} [Fri Jul 1 03:42:13 2022] GET /identity/v3/role_assignments?user.id=25426a981a294fbbafc4d23f43e2ba63&scope.domain.id=default&role.id=681755518698445fabd9a8accec13c0f => generated 233 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:13.843626 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53acf3-c514-4984-ac1b-07b2abb9667f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:13.844393 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53acf3-c514-4984-ac1b-07b2abb9667f None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:13.844734 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53acf3-c514-4984-ac1b-07b2abb9667f None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:13.845073 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53acf3-c514-4984-ac1b-07b2abb9667f None admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:13.845904 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53acf3-c514-4984-ac1b-07b2abb9667f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:42:13.846290 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53acf3-c514-4984-ac1b-07b2abb9667f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:13.847965 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53acf3-c514-4984-ac1b-07b2abb9667f None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:13.869277 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 10/21] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:42:17.642497 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57916cc-88f0-4eed-a68f-0a2e2ef89db6 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:17.643533 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57916cc-88f0-4eed-a68f-0a2e2ef89db6 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:17.644031 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57916cc-88f0-4eed-a68f-0a2e2ef89db6 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:17.645639 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 12/22] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:42:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:42:17.655306 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49988d5e-784b-4af0-9bed-157456f7248a None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:17.656905 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49988d5e-784b-4af0-9bed-157456f7248a None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:17.657685 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49988d5e-784b-4af0-9bed-157456f7248a None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:17.660926 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f6448-d0af-4e66-9aa9-f07c20883526 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:17.661795 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f6448-d0af-4e66-9aa9-f07c20883526 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:17.662576 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f6448-d0af-4e66-9aa9-f07c20883526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:17.668083 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 11/23] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:42:17 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:42:17.674806 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207e844-7a18-477b-904f-9772da8adaa9 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:17.677660 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207e844-7a18-477b-904f-9772da8adaa9 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:17.680964 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207e844-7a18-477b-904f-9772da8adaa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:17.714085 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-572f6448-d0af-4e66-9aa9-f07c20883526 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:42:17.717063 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-572f6448-d0af-4e66-9aa9-f07c20883526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:42:17.721200 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-2207e844-7a18-477b-904f-9772da8adaa9 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:42:17.724531 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-2207e844-7a18-477b-904f-9772da8adaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:42:17.807008 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 12/24] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:42:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:42:17.815477 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ce696-0ed8-4e92-82a9-87fa7df0c264 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:17.815695 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 13/25] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:42:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 03:42:17.815695 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91136254-be8c-4542-b14b-327f9ace06bb None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:17.815695 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91136254-be8c-4542-b14b-327f9ace06bb None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:17.815695 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91136254-be8c-4542-b14b-327f9ace06bb None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:17.815695 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 14/26] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:42:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:42:17.816984 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ce696-0ed8-4e92-82a9-87fa7df0c264 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:17.817514 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ce696-0ed8-4e92-82a9-87fa7df0c264 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:17.818245 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070981a1-e03b-4e40-b708-5fbc142098bc None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:17.818551 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070981a1-e03b-4e40-b708-5fbc142098bc None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:17.818838 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070981a1-e03b-4e40-b708-5fbc142098bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:17.819902 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 13/27] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:42:17 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:42:17.826467 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc45dac-ea62-4791-be2c-9bc182fc30a0 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:17.827075 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc45dac-ea62-4791-be2c-9bc182fc30a0 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:17.827603 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc45dac-ea62-4791-be2c-9bc182fc30a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:17.837743 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-070981a1-e03b-4e40-b708-5fbc142098bc None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:42:17.839960 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-070981a1-e03b-4e40-b708-5fbc142098bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:42:17.860674 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-abc45dac-ea62-4791-be2c-9bc182fc30a0 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:42:17.862474 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-abc45dac-ea62-4791-be2c-9bc182fc30a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:42:17.922850 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:17.930389 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 15/28] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:42:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 03:42:17.931297 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070981a1-e03b-4e40-b708-5fbc142098bc None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:17.935170 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:17.953612 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 14/29] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:42:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 03:42:17.954776 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc45dac-ea62-4791-be2c-9bc182fc30a0 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:18.078349 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc45dac-ea62-4791-be2c-9bc182fc30a0 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:18.081978 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070981a1-e03b-4e40-b708-5fbc142098bc None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:18.123503 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df746626-efcf-446e-aa30-bc8ab27166f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:18.124293 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df746626-efcf-446e-aa30-bc8ab27166f9 None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:18.124679 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df746626-efcf-446e-aa30-bc8ab27166f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:18.124968 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df746626-efcf-446e-aa30-bc8ab27166f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:18.125835 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df746626-efcf-446e-aa30-bc8ab27166f9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:18.126429 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba24fa-e491-4abb-a760-908f290f67a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:18.127257 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df746626-efcf-446e-aa30-bc8ab27166f9 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:18.127798 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba24fa-e491-4abb-a760-908f290f67a3 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:18.128282 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba24fa-e491-4abb-a760-908f290f67a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:18.128750 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba24fa-e491-4abb-a760-908f290f67a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:18.140877 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba24fa-e491-4abb-a760-908f290f67a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:18.142442 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba24fa-e491-4abb-a760-908f290f67a3 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:18.160777 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-36ba24fa-e491-4abb-a760-908f290f67a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:42:18.160777 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:42:18.160777 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:42:18.160777 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:42:18.160777 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:42:18.160777 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:42:18.160777 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:42:18.160777 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:42:18.160777 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:42:18.160777 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:42:18.160777 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:42:18.160777 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:42:18.160777 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:42:18.160777 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:42:18.160777 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:42:18.161698 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:42:18.161698 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:42:18.161698 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:42:18.161698 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:42:18.161698 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:42:18.161698 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:42:18.161698 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:42:18.161698 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:42:18.161698 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:42:18.161698 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:42:18.161698 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:42:18.161698 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:42:18.161698 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:42:18.161698 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:42:18.161698 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:42:18.161698 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:42:18.161698 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:42:18.162528 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:42:18.162528 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:42:18.162528 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:42:18.162528 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:42:18.162528 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 15/30] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:42:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:42:18.162808 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba24fa-e491-4abb-a760-908f290f67a3 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:18.200399 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:18.284814 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba24fa-e491-4abb-a760-908f290f67a3 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:18.323603 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63b78d-134d-4cbb-b9dd-b67837343252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:18.324292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63b78d-134d-4cbb-b9dd-b67837343252 None admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:18.324596 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63b78d-134d-4cbb-b9dd-b67837343252 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:18.324869 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63b78d-134d-4cbb-b9dd-b67837343252 None admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:18.325717 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63b78d-134d-4cbb-b9dd-b67837343252 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:18.327170 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63b78d-134d-4cbb-b9dd-b67837343252 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:18.369119 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 16/31] 10.222.0.46 () {60 vars in 1131 bytes} [Fri Jul 1 03:42:17 2022] POST /identity/v3/roles => generated 225 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 03:42:18.371062 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df746626-efcf-446e-aa30-bc8ab27166f9 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:18.506295 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:18.552080 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df746626-efcf-446e-aa30-bc8ab27166f9 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:18.582266 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 16/32] 10.222.0.46 () {60 vars in 1131 bytes} [Fri Jul 1 03:42:18 2022] POST /identity/v3/roles => generated 219 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 03:42:18.583295 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63b78d-134d-4cbb-b9dd-b67837343252 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:18.628349 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4c808-6527-4a98-8db5-d6582436cff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:18.629104 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4c808-6527-4a98-8db5-d6582436cff1 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:18.629394 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4c808-6527-4a98-8db5-d6582436cff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:18.629677 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4c808-6527-4a98-8db5-d6582436cff1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:18.657097 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4c808-6527-4a98-8db5-d6582436cff1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:42:18.673444 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-9eb4c808-6527-4a98-8db5-d6582436cff1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:42:18.673444 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:42:18.673444 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:42:18.673444 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:42:18.673444 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:42:18.673444 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:42:18.673444 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:42:18.673444 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:42:18.673444 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:42:18.673444 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:42:18.673444 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:42:18.673444 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:42:18.673444 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:42:18.673444 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:42:18.673444 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:42:18.673444 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:42:18.674389 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:42:18.674389 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:42:18.674389 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:42:18.674389 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:42:18.674389 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:42:18.674389 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:42:18.674389 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:42:18.674389 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:42:18.674389 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:42:18.674389 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:42:18.674389 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:42:18.674389 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:42:18.674389 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:42:18.674389 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:42:18.674389 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:42:18.674389 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:42:18.675122 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:42:18.675122 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:42:18.675122 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:42:18.675122 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:42:18.675122 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:42:18.675122 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:42:18.675122 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:42:18.675122 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:42:18.675122 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:42:18.675122 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:42:18.675122 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:42:18.675122 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:42:18.675122 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 17/33] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 1 03:42:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:42:18.681049 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d26bb-81da-4337-a99d-f2ee17f89b76 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:18.681407 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d26bb-81da-4337-a99d-f2ee17f89b76 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:18.681643 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d26bb-81da-4337-a99d-f2ee17f89b76 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:18.691156 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:18.691876 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 18/34] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:42:18 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:42:18.697416 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b4295-c317-4bdb-a7a7-06a041c44c10 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:18.697721 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b4295-c317-4bdb-a7a7-06a041c44c10 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:18.697995 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b4295-c317-4bdb-a7a7-06a041c44c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:18.707853 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63b78d-134d-4cbb-b9dd-b67837343252 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:18.744891 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-e37b4295-c317-4bdb-a7a7-06a041c44c10 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:42:18.747558 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e37b4295-c317-4bdb-a7a7-06a041c44c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:42:18.758147 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416b7f9-1351-4061-a537-b3cfb55c7dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:18.758147 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416b7f9-1351-4061-a537-b3cfb55c7dfa None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:18.758147 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416b7f9-1351-4061-a537-b3cfb55c7dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:18.758480 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416b7f9-1351-4061-a537-b3cfb55c7dfa None admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:18.759176 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8416b7f9-1351-4061-a537-b3cfb55c7dfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:42:18.760223 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8416b7f9-1351-4061-a537-b3cfb55c7dfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:18.766259 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8416b7f9-1351-4061-a537-b3cfb55c7dfa None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:18.783297 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 17/35] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:18.785153 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416b7f9-1351-4061-a537-b3cfb55c7dfa None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:18.873428 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 19/36] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:42:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:42:18.877713 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdc5e7-2fc1-46ad-9de9-8b47845f7e7f None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:18.878015 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdc5e7-2fc1-46ad-9de9-8b47845f7e7f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:18.878520 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdc5e7-2fc1-46ad-9de9-8b47845f7e7f None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:18.879887 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 20/37] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:42:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:42:18.880806 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbdc5e7-2fc1-46ad-9de9-8b47845f7e7f None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:18.934884 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416b7f9-1351-4061-a537-b3cfb55c7dfa None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:18.947977 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:18.970303 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad280c29-d358-4003-8754-8705eb67fc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:18.970978 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad280c29-d358-4003-8754-8705eb67fc7c None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:18.971259 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad280c29-d358-4003-8754-8705eb67fc7c None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:18.971568 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad280c29-d358-4003-8754-8705eb67fc7c None admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:18.972321 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad280c29-d358-4003-8754-8705eb67fc7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:42:18.972630 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad280c29-d358-4003-8754-8705eb67fc7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:18.974023 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad280c29-d358-4003-8754-8705eb67fc7c None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:18.986712 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 18/38] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:42:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:18.988221 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf811f2-e238-4515-b112-f91124dcb3fa None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:18.988515 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf811f2-e238-4515-b112-f91124dcb3fa None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:18.988803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf811f2-e238-4515-b112-f91124dcb3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:18.996758 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbdc5e7-2fc1-46ad-9de9-8b47845f7e7f None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:19.007904 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-dcf811f2-e238-4515-b112-f91124dcb3fa None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:42:19.010596 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-dcf811f2-e238-4515-b112-f91124dcb3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:42:19.013468 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:19.032782 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc9d614-c4b4-44cb-ac3c-6d03b5f3261c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:19.033435 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9d614-c4b4-44cb-ac3c-6d03b5f3261c None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:19.033725 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9d614-c4b4-44cb-ac3c-6d03b5f3261c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:19.034005 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9d614-c4b4-44cb-ac3c-6d03b5f3261c None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:19.034718 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc9d614-c4b4-44cb-ac3c-6d03b5f3261c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:19.036379 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc9d614-c4b4-44cb-ac3c-6d03b5f3261c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:19.077836 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 19/39] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:42:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:42:19.078670 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf811f2-e238-4515-b112-f91124dcb3fa None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:19.152295 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 21/40] 10.222.0.46 () {60 vars in 1141 bytes} [Fri Jul 1 03:42:18 2022] POST /identity/v3/projects => generated 301 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 03:42:19.153063 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc9d614-c4b4-44cb-ac3c-6d03b5f3261c None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:19.191070 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf811f2-e238-4515-b112-f91124dcb3fa None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:19.237666 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd5d22-87f6-4424-a1fa-f0ef9780f588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:19.239025 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd5d22-87f6-4424-a1fa-f0ef9780f588 None admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:19.239343 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd5d22-87f6-4424-a1fa-f0ef9780f588 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:19.239862 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd5d22-87f6-4424-a1fa-f0ef9780f588 None admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:19.240567 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedd5d22-87f6-4424-a1fa-f0ef9780f588 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:19.242876 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedd5d22-87f6-4424-a1fa-f0ef9780f588 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:19.266005 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc9d614-c4b4-44cb-ac3c-6d03b5f3261c None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:19.273901 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:19.303949 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afafa99-3a70-403f-91b8-84c6cac207fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:19.304904 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afafa99-3a70-403f-91b8-84c6cac207fc None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:19.305204 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afafa99-3a70-403f-91b8-84c6cac207fc None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:19.305481 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afafa99-3a70-403f-91b8-84c6cac207fc None admin] PATH_INFO: `/v3/users/25426a981a294fbbafc4d23f43e2ba63` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:19.306763 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afafa99-3a70-403f-91b8-84c6cac207fc None admin] RBAC: Authorizing `identity:get_user(user_id=25426a981a294fbbafc4d23f43e2ba63)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:19.308355 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afafa99-3a70-403f-91b8-84c6cac207fc None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:19.310020 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 22/41] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:42:19 2022] GET /identity/v3/users/25426a981a294fbbafc4d23f43e2ba63 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:19.311782 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afafa99-3a70-403f-91b8-84c6cac207fc None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:19.326980 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:19.337300 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 20/42] 10.222.0.46 () {60 vars in 1131 bytes} [Fri Jul 1 03:42:19 2022] POST /identity/v3/roles => generated 223 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 03:42:19.337300 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd5d22-87f6-4424-a1fa-f0ef9780f588 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:19.449093 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afafa99-3a70-403f-91b8-84c6cac207fc None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:19.490173 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd5d22-87f6-4424-a1fa-f0ef9780f588 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:19.490805 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f640b5-05ed-4642-aac2-a389d227df01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:19.491944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f640b5-05ed-4642-aac2-a389d227df01 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:19.492083 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f640b5-05ed-4642-aac2-a389d227df01 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:19.492454 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f640b5-05ed-4642-aac2-a389d227df01 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:19.493784 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f640b5-05ed-4642-aac2-a389d227df01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:19.495897 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f640b5-05ed-4642-aac2-a389d227df01 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:19.497875 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 23/43] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:42:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:19.503689 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f640b5-05ed-4642-aac2-a389d227df01 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:19.539332 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e5f57-86c1-4f1b-ad06-e88bddd0ee0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:19.540354 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e5f57-86c1-4f1b-ad06-e88bddd0ee0d None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:19.540639 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e5f57-86c1-4f1b-ad06-e88bddd0ee0d None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:19.541280 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e5f57-86c1-4f1b-ad06-e88bddd0ee0d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:19.544508 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60e5f57-86c1-4f1b-ad06-e88bddd0ee0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:19.546953 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60e5f57-86c1-4f1b-ad06-e88bddd0ee0d None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:19.548190 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 21/44] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:42:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:19.554073 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e5f57-86c1-4f1b-ad06-e88bddd0ee0d None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:19.559889 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:19.622834 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f640b5-05ed-4642-aac2-a389d227df01 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:19.629834 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:19.659968 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd733a-49ac-4aac-a072-0b8bd082bd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:19.660810 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd733a-49ac-4aac-a072-0b8bd082bd8c None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:19.660965 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd733a-49ac-4aac-a072-0b8bd082bd8c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:19.661196 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd733a-49ac-4aac-a072-0b8bd082bd8c None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:19.661919 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd733a-49ac-4aac-a072-0b8bd082bd8c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:19.663401 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd733a-49ac-4aac-a072-0b8bd082bd8c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:19.663726 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e5f57-86c1-4f1b-ad06-e88bddd0ee0d None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:19.708758 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7ad07-5940-4036-8021-9f407fe8fbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:19.709592 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7ad07-5940-4036-8021-9f407fe8fbe8 None admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:19.709875 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7ad07-5940-4036-8021-9f407fe8fbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:19.710153 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7ad07-5940-4036-8021-9f407fe8fbe8 None admin] PATH_INFO: `/v3/domains/default/users/25426a981a294fbbafc4d23f43e2ba63/roles/681755518698445fabd9a8accec13c0f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:19.712676 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d7ad07-5940-4036-8021-9f407fe8fbe8 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=25426a981a294fbbafc4d23f43e2ba63, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:19.714274 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d7ad07-5940-4036-8021-9f407fe8fbe8 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:19.781494 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 22/45] 10.222.0.46 () {58 vars in 1361 bytes} [Fri Jul 1 03:42:19 2022] PUT /identity/v3/domains/default/users/25426a981a294fbbafc4d23f43e2ba63/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 03:42:19.884147 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 24/46] 10.222.0.46 () {60 vars in 1141 bytes} [Fri Jul 1 03:42:19 2022] POST /identity/v3/projects => generated 312 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 03:42:21.824797 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774265d-0970-422a-8983-a21b521ef94a None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:21.825292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774265d-0970-422a-8983-a21b521ef94a None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:21.825292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774265d-0970-422a-8983-a21b521ef94a None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:21.826652 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 23/47] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:42:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:42:21.831977 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ed56e-fe08-4571-9b35-3c3b2f81facf None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:21.832386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ed56e-fe08-4571-9b35-3c3b2f81facf None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:21.832653 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ed56e-fe08-4571-9b35-3c3b2f81facf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:21.849053 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-d98ed56e-fe08-4571-9b35-3c3b2f81facf None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:42:21.850228 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d98ed56e-fe08-4571-9b35-3c3b2f81facf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:42:21.914739 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 25/48] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:42:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:42:21.938143 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774265d-0970-422a-8983-a21b521ef94a None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:21.952868 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9cc2c4-0419-444c-8b34-c187dee6e62c None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:21.953164 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9cc2c4-0419-444c-8b34-c187dee6e62c None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:21.953453 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9cc2c4-0419-444c-8b34-c187dee6e62c None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:21.954843 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 26/49] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:42:21.959695 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad546e6e-359e-4b16-b94e-bc06f0747deb None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:21.959990 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad546e6e-359e-4b16-b94e-bc06f0747deb None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:21.960277 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad546e6e-359e-4b16-b94e-bc06f0747deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:21.976595 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-ad546e6e-359e-4b16-b94e-bc06f0747deb None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:42:21.977806 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ad546e6e-359e-4b16-b94e-bc06f0747deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:42:21.995969 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:22.044199 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774265d-0970-422a-8983-a21b521ef94a None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:22.046035 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 27/50] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:42:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 03:42:22.069181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad546e6e-359e-4b16-b94e-bc06f0747deb None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:22.072558 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:22.080576 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d5db2-7e0e-4295-baa5-ef4b19625225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:22.081313 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d5db2-7e0e-4295-baa5-ef4b19625225 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:22.081606 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d5db2-7e0e-4295-baa5-ef4b19625225 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:22.081909 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d5db2-7e0e-4295-baa5-ef4b19625225 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:22.093442 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d5db2-7e0e-4295-baa5-ef4b19625225 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:42:22.102616 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-497d5db2-7e0e-4295-baa5-ef4b19625225 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:42:22.102616 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:42:22.102616 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:42:22.102616 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:42:22.102616 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:42:22.102616 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:42:22.102616 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:42:22.102616 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:42:22.102616 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:42:22.102616 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:42:22.102616 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:42:22.102616 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:42:22.102616 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:42:22.102616 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:42:22.102616 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:42:22.102616 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:42:22.103704 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:42:22.103704 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:42:22.103704 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:42:22.103704 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:42:22.103704 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:42:22.103704 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:42:22.103704 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:42:22.103704 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:42:22.103704 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:42:22.103704 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:42:22.103704 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:42:22.103704 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:42:22.103704 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:42:22.103704 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:42:22.103704 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:42:22.103704 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:42:22.105209 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:42:22.105209 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:42:22.105209 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:42:22.105209 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:42:22.105209 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:42:22.105209 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:42:22.105209 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:42:22.105209 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:42:22.105209 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:42:22.105209 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:42:22.105209 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:42:22.105209 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:42:22.105209 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 24/51] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 1 03:42:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:42:22.110052 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d5db2-7e0e-4295-baa5-ef4b19625225 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:22.173574 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad546e6e-359e-4b16-b94e-bc06f0747deb None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:22.208327 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2454aa3-7878-4373-965e-2a0c0542e643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:22.209134 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2454aa3-7878-4373-965e-2a0c0542e643 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:22.209423 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2454aa3-7878-4373-965e-2a0c0542e643 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:22.209708 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2454aa3-7878-4373-965e-2a0c0542e643 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:22.210866 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d5db2-7e0e-4295-baa5-ef4b19625225 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:22.210966 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2454aa3-7878-4373-965e-2a0c0542e643 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:22.212549 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2454aa3-7878-4373-965e-2a0c0542e643 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:22.214264 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 28/52] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:42:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:42:22.219837 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2454aa3-7878-4373-965e-2a0c0542e643 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:22.244609 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:22.247737 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa5b1f-a173-45cb-aec8-76ee7f2e3d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:22.248422 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa5b1f-a173-45cb-aec8-76ee7f2e3d26 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:22.248710 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa5b1f-a173-45cb-aec8-76ee7f2e3d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:22.248982 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa5b1f-a173-45cb-aec8-76ee7f2e3d26 None admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:22.249733 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa5b1f-a173-45cb-aec8-76ee7f2e3d26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:42:22.250044 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa5b1f-a173-45cb-aec8-76ee7f2e3d26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:22.251432 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa5b1f-a173-45cb-aec8-76ee7f2e3d26 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:22.259663 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 25/53] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:42:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:42:22.265070 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa5b1f-a173-45cb-aec8-76ee7f2e3d26 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:22.328054 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2454aa3-7878-4373-965e-2a0c0542e643 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:22.365663 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0dccf-e15d-4210-9361-253d5ed54908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:22.366235 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0dccf-e15d-4210-9361-253d5ed54908 None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:22.366529 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0dccf-e15d-4210-9361-253d5ed54908 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:22.366818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0dccf-e15d-4210-9361-253d5ed54908 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:22.367576 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e0dccf-e15d-4210-9361-253d5ed54908 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:22.369063 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e0dccf-e15d-4210-9361-253d5ed54908 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:22.420762 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:22.470534 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa5b1f-a173-45cb-aec8-76ee7f2e3d26 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:22.509744 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22aaffb-7093-40f2-911f-e3f9803e6a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:22.510753 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22aaffb-7093-40f2-911f-e3f9803e6a26 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:22.511046 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22aaffb-7093-40f2-911f-e3f9803e6a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:22.511331 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22aaffb-7093-40f2-911f-e3f9803e6a26 None admin] PATH_INFO: `/v3/users/25426a981a294fbbafc4d23f43e2ba63` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:22.513758 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22aaffb-7093-40f2-911f-e3f9803e6a26 None admin] RBAC: Authorizing `identity:get_user(user_id=25426a981a294fbbafc4d23f43e2ba63)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:22.515478 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22aaffb-7093-40f2-911f-e3f9803e6a26 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:22.516928 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 26/54] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:42:22 2022] GET /identity/v3/users/25426a981a294fbbafc4d23f43e2ba63 => generated 247 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:42:22.522129 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22aaffb-7093-40f2-911f-e3f9803e6a26 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:22.565322 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 29/55] 10.222.0.46 () {60 vars in 1140 bytes} [Fri Jul 1 03:42:22 2022] POST /identity/v3/projects => generated 298 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 03:42:22.635997 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22aaffb-7093-40f2-911f-e3f9803e6a26 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:22.655338 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:22.674522 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1825db8d-06a1-4ffe-ba14-95c5f4093b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:22.675348 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825db8d-06a1-4ffe-ba14-95c5f4093b98 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:22.675676 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825db8d-06a1-4ffe-ba14-95c5f4093b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:22.675971 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825db8d-06a1-4ffe-ba14-95c5f4093b98 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:22.677496 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1825db8d-06a1-4ffe-ba14-95c5f4093b98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:22.678920 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1825db8d-06a1-4ffe-ba14-95c5f4093b98 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:22.680735 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 27/56] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:42:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:42:22.686938 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0dccf-e15d-4210-9361-253d5ed54908 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:22.775661 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:22.801292 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0dccf-e15d-4210-9361-253d5ed54908 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:22.836582 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a281d-b3f9-4f53-beb3-fa8450205478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:22.837248 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a281d-b3f9-4f53-beb3-fa8450205478 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:22.837536 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a281d-b3f9-4f53-beb3-fa8450205478 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:22.837813 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a281d-b3f9-4f53-beb3-fa8450205478 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:22.839278 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a281d-b3f9-4f53-beb3-fa8450205478 None admin] RBAC: Adding query filter params (role.id=681755518698445fabd9a8accec13c0f, scope.domain.id=default, user.id=25426a981a294fbbafc4d23f43e2ba63) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:42:22.839648 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a281d-b3f9-4f53-beb3-fa8450205478 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:22.841124 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a281d-b3f9-4f53-beb3-fa8450205478 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:22.847664 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 30/57] 10.222.0.46 () {56 vars in 1322 bytes} [Fri Jul 1 03:42:22 2022] GET /identity/v3/role_assignments?user.id=25426a981a294fbbafc4d23f43e2ba63&scope.domain.id=default&role.id=681755518698445fabd9a8accec13c0f => generated 530 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:24.630777 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721bbed9-99c2-469e-8cfb-2df89b76273a None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:24.631317 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721bbed9-99c2-469e-8cfb-2df89b76273a None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:24.631436 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721bbed9-99c2-469e-8cfb-2df89b76273a None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:24.632857 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 28/58] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:42:24.639051 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3487cdb-490c-4eab-98c2-7a98db4796f4 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:24.639602 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3487cdb-490c-4eab-98c2-7a98db4796f4 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:24.639719 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3487cdb-490c-4eab-98c2-7a98db4796f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:24.656776 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-e3487cdb-490c-4eab-98c2-7a98db4796f4 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:42:24.658041 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e3487cdb-490c-4eab-98c2-7a98db4796f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:42:24.728062 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 31/59] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:42:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:42:24.753026 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721bbed9-99c2-469e-8cfb-2df89b76273a None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:24.857823 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721bbed9-99c2-469e-8cfb-2df89b76273a None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:24.893323 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624da339-10a4-4dda-992d-eea2290562f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:24.894211 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624da339-10a4-4dda-992d-eea2290562f6 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:24.894540 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624da339-10a4-4dda-992d-eea2290562f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:24.894863 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624da339-10a4-4dda-992d-eea2290562f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:24.896112 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624da339-10a4-4dda-992d-eea2290562f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:24.897599 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624da339-10a4-4dda-992d-eea2290562f6 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:24.899279 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 29/60] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:42:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:24.905062 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3487cdb-490c-4eab-98c2-7a98db4796f4 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:24.974502 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:25.008263 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3487cdb-490c-4eab-98c2-7a98db4796f4 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:25.044729 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d64831-c71d-42da-9c0f-023cb054d1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:25.045481 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d64831-c71d-42da-9c0f-023cb054d1b5 None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:25.045807 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d64831-c71d-42da-9c0f-023cb054d1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:25.046123 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d64831-c71d-42da-9c0f-023cb054d1b5 None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:25.046914 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d64831-c71d-42da-9c0f-023cb054d1b5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:25.048470 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d64831-c71d-42da-9c0f-023cb054d1b5 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:25.124978 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 32/61] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Jul 1 03:42:24 2022] POST /identity/v3/users => generated 275 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 03:42:28.429789 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b814063-a220-4322-97a1-e2ad736c5c39 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:28.430845 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b814063-a220-4322-97a1-e2ad736c5c39 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:28.431334 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b814063-a220-4322-97a1-e2ad736c5c39 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:28.433491 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 30/62] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:42:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:42:28.439187 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a60cf-6d4d-43d8-b603-5cba195f6bdd None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:28.439681 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a60cf-6d4d-43d8-b603-5cba195f6bdd None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:28.439844 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a60cf-6d4d-43d8-b603-5cba195f6bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:28.462201 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-2e5a60cf-6d4d-43d8-b603-5cba195f6bdd None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:42:28.463736 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2e5a60cf-6d4d-43d8-b603-5cba195f6bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:42:28.568946 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 33/63] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:42:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:42:28.613027 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b814063-a220-4322-97a1-e2ad736c5c39 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:28.701432 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:28.768236 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b814063-a220-4322-97a1-e2ad736c5c39 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:28.812711 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5268352-579e-4c3f-82fd-77d63ce529a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:28.813913 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5268352-579e-4c3f-82fd-77d63ce529a8 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:28.814411 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5268352-579e-4c3f-82fd-77d63ce529a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:28.814891 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5268352-579e-4c3f-82fd-77d63ce529a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:28.832121 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5268352-579e-4c3f-82fd-77d63ce529a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:42:28.840518 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-d5268352-579e-4c3f-82fd-77d63ce529a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 03:42:28.840518 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:42:28.840518 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:42:28.840518 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:42:28.840518 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:42:28.840518 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:42:28.840518 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:42:28.840518 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:42:28.840518 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:42:28.840518 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:42:28.840518 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:42:28.840518 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:42:28.840518 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:42:28.840518 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:42:28.840518 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:42:28.840518 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:42:28.841404 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:42:28.841404 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:42:28.841404 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:42:28.841404 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:42:28.841404 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:42:28.841404 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:42:28.841404 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:42:28.841404 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:42:28.841404 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:42:28.841404 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:42:28.841404 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:42:28.841404 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:42:28.841404 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:42:28.841404 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:42:28.841404 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:42:28.841404 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:42:28.842178 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:42:28.842178 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:42:28.842178 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:42:28.842178 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:42:28.842178 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:42:28.842178 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:42:28.842178 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:42:28.842178 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:42:28.842178 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:42:28.842178 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:42:28.842178 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 03:42:28.842178 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:42:28.844610 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 31/64] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:42:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:42:28.850632 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a60cf-6d4d-43d8-b603-5cba195f6bdd None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:28.932684 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:29.013320 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a60cf-6d4d-43d8-b603-5cba195f6bdd None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:29.068963 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d556f3a-000f-4ced-9afa-d3e153cb7892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:29.069676 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d556f3a-000f-4ced-9afa-d3e153cb7892 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:29.069967 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d556f3a-000f-4ced-9afa-d3e153cb7892 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:29.070251 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d556f3a-000f-4ced-9afa-d3e153cb7892 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:29.071042 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d556f3a-000f-4ced-9afa-d3e153cb7892 None admin] RBAC: Adding query filter params (name=member) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:42:29.071359 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d556f3a-000f-4ced-9afa-d3e153cb7892 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:29.074673 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d556f3a-000f-4ced-9afa-d3e153cb7892 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:29.088809 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 34/65] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 1 03:42:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:29.094842 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5268352-579e-4c3f-82fd-77d63ce529a8 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:29.134232 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbdbdf-bea9-4beb-bb86-9c48f3923e89 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:29.134743 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbdbdf-bea9-4beb-bb86-9c48f3923e89 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:29.135877 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbdbdf-bea9-4beb-bb86-9c48f3923e89 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:29.138602 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 35/66] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:42:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:42:29.148568 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883583a-bb40-4301-9087-1f9dd790ff2a None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:29.149087 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883583a-bb40-4301-9087-1f9dd790ff2a None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:29.149591 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883583a-bb40-4301-9087-1f9dd790ff2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:29.178422 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-f883583a-bb40-4301-9087-1f9dd790ff2a None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:42:29.180920 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f883583a-bb40-4301-9087-1f9dd790ff2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:42:29.285268 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5268352-579e-4c3f-82fd-77d63ce529a8 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:29.303879 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:29.352791 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf64612-abf4-4c77-ac40-e69980828774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:29.354445 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf64612-abf4-4c77-ac40-e69980828774 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:29.354835 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf64612-abf4-4c77-ac40-e69980828774 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:29.355216 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf64612-abf4-4c77-ac40-e69980828774 None admin] PATH_INFO: `/v3/users/ebf9d6d679ef4fc29f52a567ec264b4f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:29.359588 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 36/67] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:42:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 03:42:29.367494 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168ff6a-2275-40df-9363-1dd7dfb191ca None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:29.368456 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168ff6a-2275-40df-9363-1dd7dfb191ca None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:29.369129 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168ff6a-2275-40df-9363-1dd7dfb191ca None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:29.371840 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 37/68] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:42:29 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:42:29.378668 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5042b9-c988-4c7d-9cfa-0d8095d5ec0d None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:29.379559 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5042b9-c988-4c7d-9cfa-0d8095d5ec0d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:29.379709 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf64612-abf4-4c77-ac40-e69980828774 None admin] RBAC: Authorizing `identity:get_user(user_id=ebf9d6d679ef4fc29f52a567ec264b4f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:29.380418 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5042b9-c988-4c7d-9cfa-0d8095d5ec0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:29.381408 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf64612-abf4-4c77-ac40-e69980828774 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:29.387523 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 32/69] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:42:29 2022] GET /identity/v3/users/ebf9d6d679ef4fc29f52a567ec264b4f => generated 275 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:29.389735 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf64612-abf4-4c77-ac40-e69980828774 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:29.420733 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-4b5042b9-c988-4c7d-9cfa-0d8095d5ec0d None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:42:29.421988 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-4b5042b9-c988-4c7d-9cfa-0d8095d5ec0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:42:29.489769 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:29.519174 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 38/70] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:42:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 03:42:29.520455 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5042b9-c988-4c7d-9cfa-0d8095d5ec0d None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:29.536585 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf64612-abf4-4c77-ac40-e69980828774 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:29.578363 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7734cdd4-46e4-43aa-9a3f-9ce9f617bd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:29.579046 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734cdd4-46e4-43aa-9a3f-9ce9f617bd03 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:29.579338 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734cdd4-46e4-43aa-9a3f-9ce9f617bd03 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:29.579656 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734cdd4-46e4-43aa-9a3f-9ce9f617bd03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:29.627382 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:29.643869 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5042b9-c988-4c7d-9cfa-0d8095d5ec0d None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:29.656686 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7734cdd4-46e4-43aa-9a3f-9ce9f617bd03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:29.658174 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7734cdd4-46e4-43aa-9a3f-9ce9f617bd03 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:29.683101 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9c46b-6129-426b-a5ce-8bf89b1c0386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:29.683970 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9c46b-6129-426b-a5ce-8bf89b1c0386 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:29.684261 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9c46b-6129-426b-a5ce-8bf89b1c0386 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:29.684550 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9c46b-6129-426b-a5ce-8bf89b1c0386 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:29.695970 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee9c46b-6129-426b-a5ce-8bf89b1c0386 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:42:29.704748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-0ee9c46b-6129-426b-a5ce-8bf89b1c0386 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 03:42:29.704748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:42:29.704748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:42:29.704748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:42:29.704748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:42:29.704748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:42:29.704748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:42:29.704748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:42:29.704748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:42:29.704748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:42:29.704748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:42:29.704748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:42:29.704748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:42:29.704748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:42:29.704748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:42:29.704748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:42:29.713344 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:42:29.713344 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:42:29.713344 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:42:29.713344 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:42:29.713344 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:42:29.713344 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:42:29.713344 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:42:29.713344 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:42:29.713344 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:42:29.713344 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:42:29.713344 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:42:29.713344 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:42:29.713344 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:42:29.713344 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:42:29.713344 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:42:29.713344 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:42:29.715030 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:42:29.715030 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:42:29.715030 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:42:29.715030 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:42:29.715030 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:42:29.715030 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:42:29.715030 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:42:29.715030 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:42:29.715030 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:42:29.715030 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:42:29.715030 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 03:42:29.715030 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:42:29.715030 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 39/71] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Jul 1 03:42:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:42:29.715030 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18ad5b-8c16-49ee-99f6-f3cb9f00f4fd None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:29.716588 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18ad5b-8c16-49ee-99f6-f3cb9f00f4fd None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:29.716588 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18ad5b-8c16-49ee-99f6-f3cb9f00f4fd None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:29.716588 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 40/72] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:42:29.716588 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f612b2-797b-4669-bbb4-552a33e7afe7 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:29.716588 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f612b2-797b-4669-bbb4-552a33e7afe7 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:29.716588 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f612b2-797b-4669-bbb4-552a33e7afe7 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:29.716588 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 41/73] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:42:29.717467 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f612b2-797b-4669-bbb4-552a33e7afe7 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:29.760489 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:29.780515 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 33/74] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:42:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 03:42:29.782015 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7734cdd4-46e4-43aa-9a3f-9ce9f617bd03 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:29.835492 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f612b2-797b-4669-bbb4-552a33e7afe7 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:29.865074 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:29.873096 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10023a28-3770-4a00-8982-81e720ab2986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:29.878589 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10023a28-3770-4a00-8982-81e720ab2986 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:29.878589 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10023a28-3770-4a00-8982-81e720ab2986 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:29.878589 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10023a28-3770-4a00-8982-81e720ab2986 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:29.886088 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10023a28-3770-4a00-8982-81e720ab2986 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:42:29.894072 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-10023a28-3770-4a00-8982-81e720ab2986 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:42:29.894072 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:42:29.894072 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:42:29.894072 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:42:29.894072 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:42:29.894072 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:42:29.894072 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:42:29.894072 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:42:29.894072 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:42:29.894072 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:42:29.894072 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:42:29.894072 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:42:29.894072 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:42:29.894072 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:42:29.894072 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:42:29.894072 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:42:29.895197 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:42:29.895197 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:42:29.895197 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:42:29.895197 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:42:29.895197 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:42:29.895197 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:42:29.895197 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:42:29.895197 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:42:29.895197 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:42:29.895197 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:42:29.895197 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:42:29.895197 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:42:29.895197 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:42:29.895197 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:42:29.895197 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:42:29.895197 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:42:29.897446 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:42:29.897446 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:42:29.897446 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:42:29.897446 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:42:29.897446 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:42:29.897446 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:42:29.897446 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:42:29.897446 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:42:29.897446 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:42:29.897446 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:42:29.897446 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:42:29.897446 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:42:29.897446 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 42/75] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 1 03:42:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:42:29.897446 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d408e-23cf-45e6-9027-ffaaeaf9f4d0 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:29.898807 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d408e-23cf-45e6-9027-ffaaeaf9f4d0 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:29.898807 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d408e-23cf-45e6-9027-ffaaeaf9f4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:29.901175 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7734cdd4-46e4-43aa-9a3f-9ce9f617bd03 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:29.917122 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-355d408e-23cf-45e6-9027-ffaaeaf9f4d0 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:42:29.918361 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-355d408e-23cf-45e6-9027-ffaaeaf9f4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:42:29.942767 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79615e6-852a-46be-9082-14ebd44056b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:29.944014 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79615e6-852a-46be-9082-14ebd44056b8 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:29.944538 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79615e6-852a-46be-9082-14ebd44056b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:29.945060 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79615e6-852a-46be-9082-14ebd44056b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:29.946512 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79615e6-852a-46be-9082-14ebd44056b8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:42:29.947088 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79615e6-852a-46be-9082-14ebd44056b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:29.949801 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79615e6-852a-46be-9082-14ebd44056b8 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:29.964872 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 34/76] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:42:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:29.966295 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c6f41-6c48-4eb4-81aa-418ef9f23041 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:29.966598 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c6f41-6c48-4eb4-81aa-418ef9f23041 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:29.966882 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c6f41-6c48-4eb4-81aa-418ef9f23041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:29.985811 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-ea1c6f41-6c48-4eb4-81aa-418ef9f23041 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:42:29.987041 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-ea1c6f41-6c48-4eb4-81aa-418ef9f23041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:42:29.991959 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 43/77] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:42:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:42:29.992845 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d408e-23cf-45e6-9027-ffaaeaf9f4d0 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:30.027662 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:30.080077 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 35/78] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:42:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:42:30.080930 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c6f41-6c48-4eb4-81aa-418ef9f23041 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:30.111051 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d408e-23cf-45e6-9027-ffaaeaf9f4d0 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:30.151280 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12868440-daad-4633-b726-4fc29dd75d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:30.152192 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12868440-daad-4633-b726-4fc29dd75d9a None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:30.152478 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12868440-daad-4633-b726-4fc29dd75d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:30.152753 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12868440-daad-4633-b726-4fc29dd75d9a None admin] PATH_INFO: `/v3/projects/c908bfb9e6e34f1589114650c691c8c1` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:30.154393 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12868440-daad-4633-b726-4fc29dd75d9a None admin] RBAC: Authorizing `identity:get_project(project_id=c908bfb9e6e34f1589114650c691c8c1)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:30.155562 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12868440-daad-4633-b726-4fc29dd75d9a None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:30.157335 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 44/79] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:42:29 2022] GET /identity/v3/projects/c908bfb9e6e34f1589114650c691c8c1 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:30.158109 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12868440-daad-4633-b726-4fc29dd75d9a None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:30.165511 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:30.204390 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c6f41-6c48-4eb4-81aa-418ef9f23041 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:30.241842 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55d116-791c-46a1-b9a6-538b8c8a3560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:30.242522 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55d116-791c-46a1-b9a6-538b8c8a3560 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:30.242805 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55d116-791c-46a1-b9a6-538b8c8a3560 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:30.243084 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55d116-791c-46a1-b9a6-538b8c8a3560 None admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:30.243882 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f55d116-791c-46a1-b9a6-538b8c8a3560 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:42:30.244187 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f55d116-791c-46a1-b9a6-538b8c8a3560 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:30.245591 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f55d116-791c-46a1-b9a6-538b8c8a3560 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:30.254268 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 36/80] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:42:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:30.254268 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55d116-791c-46a1-b9a6-538b8c8a3560 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:30.260412 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:30.267941 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12868440-daad-4633-b726-4fc29dd75d9a None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:30.309351 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24260545-8b35-4bce-95dd-30dc6019c4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:30.310331 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24260545-8b35-4bce-95dd-30dc6019c4da None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:30.310759 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24260545-8b35-4bce-95dd-30dc6019c4da None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:30.311137 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24260545-8b35-4bce-95dd-30dc6019c4da None admin] PATH_INFO: `/v3/users/ebf9d6d679ef4fc29f52a567ec264b4f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:30.312768 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24260545-8b35-4bce-95dd-30dc6019c4da None admin] RBAC: Authorizing `identity:get_user(user_id=ebf9d6d679ef4fc29f52a567ec264b4f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:30.314619 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24260545-8b35-4bce-95dd-30dc6019c4da None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:30.316718 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 45/81] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:42:30 2022] GET /identity/v3/users/ebf9d6d679ef4fc29f52a567ec264b4f => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:30.318705 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24260545-8b35-4bce-95dd-30dc6019c4da None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:30.374909 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55d116-791c-46a1-b9a6-538b8c8a3560 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:30.404173 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:30.412880 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4d849-7a0f-4a3a-9eb3-9d9df51cebf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:30.413696 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4d849-7a0f-4a3a-9eb3-9d9df51cebf7 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:30.413981 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4d849-7a0f-4a3a-9eb3-9d9df51cebf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:30.419880 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4d849-7a0f-4a3a-9eb3-9d9df51cebf7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:30.427521 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e4d849-7a0f-4a3a-9eb3-9d9df51cebf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:42:30.433010 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24260545-8b35-4bce-95dd-30dc6019c4da None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:30.435584 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-69e4d849-7a0f-4a3a-9eb3-9d9df51cebf7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 03:42:30.435584 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:42:30.435584 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:42:30.435584 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:42:30.435584 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:42:30.435584 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:42:30.435584 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:42:30.435584 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:42:30.435584 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:42:30.435584 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:42:30.435584 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:42:30.435584 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:42:30.435584 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:42:30.435584 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:42:30.435584 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:42:30.435584 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:42:30.436448 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:42:30.436448 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:42:30.436448 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:42:30.436448 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:42:30.436448 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:42:30.436448 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:42:30.436448 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:42:30.436448 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:42:30.436448 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:42:30.436448 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:42:30.436448 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:42:30.436448 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:42:30.436448 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:42:30.436448 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:42:30.436448 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:42:30.436448 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:42:30.438860 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:42:30.438860 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:42:30.438860 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:42:30.438860 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:42:30.438860 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:42:30.438860 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:42:30.438860 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:42:30.438860 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:42:30.438860 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:42:30.438860 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:42:30.438860 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 03:42:30.438860 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:42:30.438860 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 37/82] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:42:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:42:30.438860 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4d849-7a0f-4a3a-9eb3-9d9df51cebf7 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:30.475863 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee484d3-9c11-4eaf-8939-3e73932136e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:30.476988 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee484d3-9c11-4eaf-8939-3e73932136e2 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:30.477278 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee484d3-9c11-4eaf-8939-3e73932136e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:30.477561 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee484d3-9c11-4eaf-8939-3e73932136e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:30.478897 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee484d3-9c11-4eaf-8939-3e73932136e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:30.480422 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee484d3-9c11-4eaf-8939-3e73932136e2 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:30.486761 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 46/83] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:42:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:30.486761 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee484d3-9c11-4eaf-8939-3e73932136e2 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:30.519911 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:30.554363 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4d849-7a0f-4a3a-9eb3-9d9df51cebf7 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:30.596239 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb71846-8c14-4ced-a9f4-e99c47058dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:30.596925 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb71846-8c14-4ced-a9f4-e99c47058dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:30.597214 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb71846-8c14-4ced-a9f4-e99c47058dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:30.597493 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb71846-8c14-4ced-a9f4-e99c47058dd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:30.598351 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb71846-8c14-4ced-a9f4-e99c47058dd4 None admin] RBAC: Adding query filter params (role.id=c0b595782ebc410db693ef7fa70522a3, scope.project.id=c908bfb9e6e34f1589114650c691c8c1, user.id=ebf9d6d679ef4fc29f52a567ec264b4f) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:42:30.598444 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee484d3-9c11-4eaf-8939-3e73932136e2 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:30.598673 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb71846-8c14-4ced-a9f4-e99c47058dd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:30.600194 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb71846-8c14-4ced-a9f4-e99c47058dd4 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:30.609294 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 38/84] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:42:30 2022] GET /identity/v3/role_assignments?user.id=ebf9d6d679ef4fc29f52a567ec264b4f&scope.project.id=c908bfb9e6e34f1589114650c691c8c1&role.id=c0b595782ebc410db693ef7fa70522a3 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:30.610161 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb71846-8c14-4ced-a9f4-e99c47058dd4 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:30.640462 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70ac1a-ef59-4916-a386-a596550c6d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:30.641273 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70ac1a-ef59-4916-a386-a596550c6d02 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:30.641561 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70ac1a-ef59-4916-a386-a596550c6d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:30.641839 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70ac1a-ef59-4916-a386-a596550c6d02 None admin] PATH_INFO: `/v3/users/25426a981a294fbbafc4d23f43e2ba63` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:30.643242 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad70ac1a-ef59-4916-a386-a596550c6d02 None admin] RBAC: Authorizing `identity:get_user(user_id=25426a981a294fbbafc4d23f43e2ba63)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:30.644811 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad70ac1a-ef59-4916-a386-a596550c6d02 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:30.646605 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 47/85] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:42:30 2022] GET /identity/v3/users/25426a981a294fbbafc4d23f43e2ba63 => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:30.647428 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70ac1a-ef59-4916-a386-a596550c6d02 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:30.694191 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:30.758464 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb71846-8c14-4ced-a9f4-e99c47058dd4 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:30.775218 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:30.780024 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70ac1a-ef59-4916-a386-a596550c6d02 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:30.813015 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d35e4-560a-416c-8404-820d36f40350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:30.814103 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d35e4-560a-416c-8404-820d36f40350 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:30.814598 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d35e4-560a-416c-8404-820d36f40350 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:30.815082 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d35e4-560a-416c-8404-820d36f40350 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:30.816872 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b27db-bc52-47ce-840e-3e981e208148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:30.817681 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b27db-bc52-47ce-840e-3e981e208148 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:30.818068 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b27db-bc52-47ce-840e-3e981e208148 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:30.818448 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b27db-bc52-47ce-840e-3e981e208148 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:30.819317 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b27db-bc52-47ce-840e-3e981e208148 None admin] RBAC: Adding query filter params (name=member) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:42:30.819844 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b27db-bc52-47ce-840e-3e981e208148 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:30.821365 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b27db-bc52-47ce-840e-3e981e208148 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:30.830950 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 48/86] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 1 03:42:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:30.831951 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b27db-bc52-47ce-840e-3e981e208148 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:30.906583 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d35e4-560a-416c-8404-820d36f40350 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:30.908160 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d35e4-560a-416c-8404-820d36f40350 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:30.963412 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:31.003515 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b27db-bc52-47ce-840e-3e981e208148 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:31.022544 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 39/87] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:42:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 03:42:31.023669 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d35e4-560a-416c-8404-820d36f40350 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:31.055473 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d535a4-5762-4df1-af17-7aad1342f0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:31.056260 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d535a4-5762-4df1-af17-7aad1342f0d7 None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:31.056613 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d535a4-5762-4df1-af17-7aad1342f0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:31.057673 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d535a4-5762-4df1-af17-7aad1342f0d7 None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:31.058466 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d535a4-5762-4df1-af17-7aad1342f0d7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:31.060728 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d535a4-5762-4df1-af17-7aad1342f0d7 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:31.143698 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 49/88] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Jul 1 03:42:30 2022] POST /identity/v3/users => generated 289 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 03:42:31.144755 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d535a4-5762-4df1-af17-7aad1342f0d7 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:31.176984 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:31.200583 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d35e4-560a-416c-8404-820d36f40350 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:31.271798 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeff45a-7a3c-4454-ba68-ff66c8064a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:31.273153 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeff45a-7a3c-4454-ba68-ff66c8064a81 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:31.273646 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeff45a-7a3c-4454-ba68-ff66c8064a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:31.274234 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeff45a-7a3c-4454-ba68-ff66c8064a81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:31.294776 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d535a4-5762-4df1-af17-7aad1342f0d7 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:31.307472 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:31.367249 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae419d1-7d9e-4ba2-b70f-d250751b1941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:31.368942 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae419d1-7d9e-4ba2-b70f-d250751b1941 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:31.370052 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae419d1-7d9e-4ba2-b70f-d250751b1941 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:31.370555 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae419d1-7d9e-4ba2-b70f-d250751b1941 None admin] PATH_INFO: `/v3/users/ebf9d6d679ef4fc29f52a567ec264b4f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:31.373699 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae419d1-7d9e-4ba2-b70f-d250751b1941 None admin] RBAC: Authorizing `identity:get_user(user_id=ebf9d6d679ef4fc29f52a567ec264b4f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:31.376980 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae419d1-7d9e-4ba2-b70f-d250751b1941 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:31.381201 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeff45a-7a3c-4454-ba68-ff66c8064a81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:31.386011 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 50/89] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:42:31 2022] GET /identity/v3/users/ebf9d6d679ef4fc29f52a567ec264b4f => generated 275 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:31.386011 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae419d1-7d9e-4ba2-b70f-d250751b1941 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:31.388254 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeff45a-7a3c-4454-ba68-ff66c8064a81 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:31.516969 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:31.540647 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 40/90] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:42:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 03:42:31.542636 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeff45a-7a3c-4454-ba68-ff66c8064a81 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:31.561746 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae419d1-7d9e-4ba2-b70f-d250751b1941 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:31.618646 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae25cfb-4ea9-4a8f-87d4-dbbf3ec275c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:31.623150 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae25cfb-4ea9-4a8f-87d4-dbbf3ec275c6 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:31.623643 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae25cfb-4ea9-4a8f-87d4-dbbf3ec275c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:31.624118 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae25cfb-4ea9-4a8f-87d4-dbbf3ec275c6 None admin] PATH_INFO: `/v3/projects/c908bfb9e6e34f1589114650c691c8c1` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:31.624998 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:31.626717 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae25cfb-4ea9-4a8f-87d4-dbbf3ec275c6 None admin] RBAC: Authorizing `identity:get_project(project_id=c908bfb9e6e34f1589114650c691c8c1)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:31.629806 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae25cfb-4ea9-4a8f-87d4-dbbf3ec275c6 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:31.632673 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 51/91] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:42:31 2022] GET /identity/v3/projects/c908bfb9e6e34f1589114650c691c8c1 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:31.637064 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae25cfb-4ea9-4a8f-87d4-dbbf3ec275c6 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:31.721380 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeff45a-7a3c-4454-ba68-ff66c8064a81 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:31.784559 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268ab08-9963-4742-826e-72d441373c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:31.785966 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268ab08-9963-4742-826e-72d441373c65 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:31.786397 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268ab08-9963-4742-826e-72d441373c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:31.787104 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268ab08-9963-4742-826e-72d441373c65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:31.790427 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae25cfb-4ea9-4a8f-87d4-dbbf3ec275c6 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:31.868996 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c268ab08-9963-4742-826e-72d441373c65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:31.871039 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c268ab08-9963-4742-826e-72d441373c65 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:31.929270 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:31.933686 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa1b87-e606-41a4-91fa-3813184ee7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:31.935295 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa1b87-e606-41a4-91fa-3813184ee7e8 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:31.935897 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa1b87-e606-41a4-91fa-3813184ee7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:31.936408 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa1b87-e606-41a4-91fa-3813184ee7e8 None admin] PATH_INFO: `/v3/projects/c908bfb9e6e34f1589114650c691c8c1` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:31.938557 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa1b87-e606-41a4-91fa-3813184ee7e8 None admin] RBAC: Authorizing `identity:get_project(project_id=c908bfb9e6e34f1589114650c691c8c1)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:31.941449 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa1b87-e606-41a4-91fa-3813184ee7e8 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:31.950341 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 52/92] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:42:31 2022] GET /identity/v3/projects/c908bfb9e6e34f1589114650c691c8c1 => generated 298 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:31.950341 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa1b87-e606-41a4-91fa-3813184ee7e8 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:32.019830 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:32.058140 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 41/93] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:42:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 03:42:32.059129 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268ab08-9963-4742-826e-72d441373c65 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:32.207283 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa1b87-e606-41a4-91fa-3813184ee7e8 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:32.226892 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268ab08-9963-4742-826e-72d441373c65 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:32.273886 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660a700-231c-45dc-bece-46e46c417465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:32.274583 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660a700-231c-45dc-bece-46e46c417465 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:32.274871 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660a700-231c-45dc-bece-46e46c417465 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:32.275150 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660a700-231c-45dc-bece-46e46c417465 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:32.276115 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660a700-231c-45dc-bece-46e46c417465 None admin] RBAC: Adding query filter params (role.id=681755518698445fabd9a8accec13c0f, scope.project.id=c908bfb9e6e34f1589114650c691c8c1, user.id=25426a981a294fbbafc4d23f43e2ba63) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:42:32.276435 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660a700-231c-45dc-bece-46e46c417465 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:32.277956 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660a700-231c-45dc-bece-46e46c417465 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:32.291648 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9835d-ffc5-4295-9628-7094e638500e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:32.292335 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9835d-ffc5-4295-9628-7094e638500e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:32.292621 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9835d-ffc5-4295-9628-7094e638500e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:32.292904 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9835d-ffc5-4295-9628-7094e638500e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:32.293758 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d9835d-ffc5-4295-9628-7094e638500e None admin] RBAC: Adding query filter params (role.id=132287c7d1f9428d9195f2b4ed60756b, scope.project.id=c908bfb9e6e34f1589114650c691c8c1, user.id=ebf9d6d679ef4fc29f52a567ec264b4f) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:42:32.294078 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d9835d-ffc5-4295-9628-7094e638500e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:32.295608 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d9835d-ffc5-4295-9628-7094e638500e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:32.297578 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 42/94] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:42:32 2022] GET /identity/v3/role_assignments?user.id=25426a981a294fbbafc4d23f43e2ba63&scope.project.id=c908bfb9e6e34f1589114650c691c8c1&role.id=681755518698445fabd9a8accec13c0f => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:32.298730 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660a700-231c-45dc-bece-46e46c417465 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:32.307397 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 53/95] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:42:31 2022] GET /identity/v3/role_assignments?user.id=ebf9d6d679ef4fc29f52a567ec264b4f&scope.project.id=c908bfb9e6e34f1589114650c691c8c1&role.id=132287c7d1f9428d9195f2b4ed60756b => generated 259 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:32.348058 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:32.491893 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660a700-231c-45dc-bece-46e46c417465 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:32.546647 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d414d-40de-4f42-a9f5-daf48ec76a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:32.547599 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d414d-40de-4f42-a9f5-daf48ec76a7e None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:32.547891 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d414d-40de-4f42-a9f5-daf48ec76a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:32.548173 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d414d-40de-4f42-a9f5-daf48ec76a7e None admin] PATH_INFO: `/v3/projects/7353df3204b3473281ba1740cbb4eaa5` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:32.549564 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249d414d-40de-4f42-a9f5-daf48ec76a7e None admin] RBAC: Authorizing `identity:get_project(project_id=7353df3204b3473281ba1740cbb4eaa5)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:32.552779 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249d414d-40de-4f42-a9f5-daf48ec76a7e None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:32.554954 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 43/96] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:42:32 2022] GET /identity/v3/projects/7353df3204b3473281ba1740cbb4eaa5 => generated 312 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:32.560860 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9835d-ffc5-4295-9628-7094e638500e None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:32.668514 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:32.685062 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9835d-ffc5-4295-9628-7094e638500e None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:32.730755 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25942b8-37c7-4a71-b937-db7a90b09065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:32.731463 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25942b8-37c7-4a71-b937-db7a90b09065 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:32.731764 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25942b8-37c7-4a71-b937-db7a90b09065 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:32.732044 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25942b8-37c7-4a71-b937-db7a90b09065 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:32.732905 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25942b8-37c7-4a71-b937-db7a90b09065 None admin] RBAC: Adding query filter params (role.id=c0b595782ebc410db693ef7fa70522a3, scope.project.id=7353df3204b3473281ba1740cbb4eaa5, user.id=ebf9d6d679ef4fc29f52a567ec264b4f) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:42:32.733225 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25942b8-37c7-4a71-b937-db7a90b09065 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:32.734800 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25942b8-37c7-4a71-b937-db7a90b09065 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:32.741561 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 54/97] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:42:32 2022] GET /identity/v3/role_assignments?user.id=ebf9d6d679ef4fc29f52a567ec264b4f&scope.project.id=7353df3204b3473281ba1740cbb4eaa5&role.id=c0b595782ebc410db693ef7fa70522a3 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:33.441703 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c67f2-d6cf-4776-867f-157e68058d1d None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:33.442214 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c67f2-d6cf-4776-867f-157e68058d1d None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:33.442326 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c67f2-d6cf-4776-867f-157e68058d1d None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:33.443946 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 44/98] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:42:33.452677 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abfc76-720e-451e-87dd-e61e335e1237 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:33.453186 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abfc76-720e-451e-87dd-e61e335e1237 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:33.453685 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abfc76-720e-451e-87dd-e61e335e1237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:33.493428 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-61abfc76-720e-451e-87dd-e61e335e1237 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:42:33.496218 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-61abfc76-720e-451e-87dd-e61e335e1237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:42:33.633370 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 55/99] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:42:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:42:33.710598 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c67f2-d6cf-4776-867f-157e68058d1d None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:33.925306 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:33.972676 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c67f2-d6cf-4776-867f-157e68058d1d None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:34.055521 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2244fdeb-e437-4595-91d2-3a1b3ef9f560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:34.057560 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244fdeb-e437-4595-91d2-3a1b3ef9f560 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:34.058066 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244fdeb-e437-4595-91d2-3a1b3ef9f560 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:34.058563 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244fdeb-e437-4595-91d2-3a1b3ef9f560 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:34.089142 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2244fdeb-e437-4595-91d2-3a1b3ef9f560 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:42:34.108933 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-2244fdeb-e437-4595-91d2-3a1b3ef9f560 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 03:42:34.108933 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:42:34.108933 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:42:34.108933 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:42:34.108933 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:42:34.108933 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:42:34.108933 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:42:34.108933 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:42:34.108933 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:42:34.108933 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:42:34.108933 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:42:34.108933 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:42:34.108933 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:42:34.108933 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:42:34.108933 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:42:34.108933 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:42:34.109853 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:42:34.109853 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:42:34.109853 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:42:34.109853 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:42:34.109853 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:42:34.109853 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:42:34.109853 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:42:34.109853 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:42:34.109853 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:42:34.109853 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:42:34.109853 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:42:34.109853 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:42:34.109853 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:42:34.109853 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:42:34.109853 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:42:34.109853 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:42:34.110597 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:42:34.110597 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:42:34.110597 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:42:34.110597 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:42:34.110597 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:42:34.110597 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:42:34.110597 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:42:34.110597 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:42:34.110597 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:42:34.110597 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:42:34.110597 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 03:42:34.110597 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:42:34.111318 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 45/100] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:42:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 402 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:42:34.124708 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61abfc76-720e-451e-87dd-e61e335e1237 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:34.260206 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:34.262688 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd733a95-df66-4eae-87f2-1cf5ff3191dd None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:34.263260 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd733a95-df66-4eae-87f2-1cf5ff3191dd None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:34.263809 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd733a95-df66-4eae-87f2-1cf5ff3191dd None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:34.274525 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 46/101] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:42:34 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:42:34.283267 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b3c4a-18ac-41fd-b153-2d218f6aa506 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:34.283800 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b3c4a-18ac-41fd-b153-2d218f6aa506 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:34.284296 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b3c4a-18ac-41fd-b153-2d218f6aa506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:34.289250 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61abfc76-720e-451e-87dd-e61e335e1237 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:34.329468 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-844b3c4a-18ac-41fd-b153-2d218f6aa506 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:42:34.332533 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-844b3c4a-18ac-41fd-b153-2d218f6aa506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:42:34.355702 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc366b4b-5f8b-42f6-b496-3fdef8b34b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:34.356405 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc366b4b-5f8b-42f6-b496-3fdef8b34b3d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:34.356689 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc366b4b-5f8b-42f6-b496-3fdef8b34b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:34.356968 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc366b4b-5f8b-42f6-b496-3fdef8b34b3d None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:34.357738 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc366b4b-5f8b-42f6-b496-3fdef8b34b3d None admin] RBAC: Adding query filter params (name=member) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:42:34.358048 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc366b4b-5f8b-42f6-b496-3fdef8b34b3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:34.359477 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc366b4b-5f8b-42f6-b496-3fdef8b34b3d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:34.379089 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 56/102] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 1 03:42:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:34.387888 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc366b4b-5f8b-42f6-b496-3fdef8b34b3d None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:34.488535 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 47/103] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:42:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 03:42:34.557850 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b3c4a-18ac-41fd-b153-2d218f6aa506 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:34.617754 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc366b4b-5f8b-42f6-b496-3fdef8b34b3d None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:34.706587 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:34.719277 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb596c-37a6-433b-b4eb-7df25943db2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:34.720235 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb596c-37a6-433b-b4eb-7df25943db2c None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:34.729907 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb596c-37a6-433b-b4eb-7df25943db2c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:34.729907 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb596c-37a6-433b-b4eb-7df25943db2c None admin] PATH_INFO: `/v3/users/ebf9d6d679ef4fc29f52a567ec264b4f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:34.729907 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beb596c-37a6-433b-b4eb-7df25943db2c None admin] RBAC: Authorizing `identity:get_user(user_id=ebf9d6d679ef4fc29f52a567ec264b4f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:34.729907 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beb596c-37a6-433b-b4eb-7df25943db2c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:34.729907 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 57/104] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:42:34 2022] GET /identity/v3/users/ebf9d6d679ef4fc29f52a567ec264b4f => generated 275 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:42:34.733717 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb596c-37a6-433b-b4eb-7df25943db2c None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:34.758471 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:34.772802 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b3c4a-18ac-41fd-b153-2d218f6aa506 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:34.848349 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cda11-1fb5-4b93-9a04-e44092c67d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:34.849556 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cda11-1fb5-4b93-9a04-e44092c67d5d None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:34.850067 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cda11-1fb5-4b93-9a04-e44092c67d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:34.850558 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cda11-1fb5-4b93-9a04-e44092c67d5d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:34.854746 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8cda11-1fb5-4b93-9a04-e44092c67d5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:34.856631 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8cda11-1fb5-4b93-9a04-e44092c67d5d None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:34.859288 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 48/105] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:42:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:42:34.868745 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cda11-1fb5-4b93-9a04-e44092c67d5d None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:34.996272 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb596c-37a6-433b-b4eb-7df25943db2c None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:35.056243 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cda11-1fb5-4b93-9a04-e44092c67d5d None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:35.109569 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11eb87-a7ad-4555-b858-b9052df38c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:35.111719 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11eb87-a7ad-4555-b858-b9052df38c9b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:35.112584 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11eb87-a7ad-4555-b858-b9052df38c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:35.113316 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11eb87-a7ad-4555-b858-b9052df38c9b None admin] PATH_INFO: `/v3/projects/c908bfb9e6e34f1589114650c691c8c1` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:35.125936 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11eb87-a7ad-4555-b858-b9052df38c9b None admin] RBAC: Authorizing `identity:get_project(project_id=c908bfb9e6e34f1589114650c691c8c1)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:35.129864 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11eb87-a7ad-4555-b858-b9052df38c9b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:35.138551 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b362bd2e-49dc-4487-a2ef-ac2ec2703c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:35.139514 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362bd2e-49dc-4487-a2ef-ac2ec2703c1e None admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:35.139958 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362bd2e-49dc-4487-a2ef-ac2ec2703c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:35.140438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362bd2e-49dc-4487-a2ef-ac2ec2703c1e None admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:35.141704 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b362bd2e-49dc-4487-a2ef-ac2ec2703c1e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:35.142751 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 58/106] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:42:34 2022] GET /identity/v3/projects/c908bfb9e6e34f1589114650c691c8c1 => generated 298 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:42:35.144402 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b362bd2e-49dc-4487-a2ef-ac2ec2703c1e None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:35.152670 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff56206-c3b2-4fa3-88e9-a3f86c508ab9 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:35.153656 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff56206-c3b2-4fa3-88e9-a3f86c508ab9 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:35.154384 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff56206-c3b2-4fa3-88e9-a3f86c508ab9 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:35.157190 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 59/107] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:42:35 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:42:35.158848 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff56206-c3b2-4fa3-88e9-a3f86c508ab9 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:35.164403 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:35.282976 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 49/108] 10.222.0.46 () {60 vars in 1141 bytes} [Fri Jul 1 03:42:34 2022] POST /identity/v3/projects => generated 302 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 03:42:35.285151 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a1a82-5306-42ac-9719-cfb8e75c058a None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:35.285648 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a1a82-5306-42ac-9719-cfb8e75c058a None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:35.286186 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a1a82-5306-42ac-9719-cfb8e75c058a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:35.321178 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:35.338916 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-f21a1a82-5306-42ac-9719-cfb8e75c058a None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:42:35.341371 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-f21a1a82-5306-42ac-9719-cfb8e75c058a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:42:35.365927 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff56206-c3b2-4fa3-88e9-a3f86c508ab9 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:35.433542 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e81dc-32a5-40ad-834a-6b01652b51b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:35.435333 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e81dc-32a5-40ad-834a-6b01652b51b0 None admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:35.436000 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e81dc-32a5-40ad-834a-6b01652b51b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:35.436617 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e81dc-32a5-40ad-834a-6b01652b51b0 None admin] PATH_INFO: `/v3/projects/c908bfb9e6e34f1589114650c691c8c1/users/ebf9d6d679ef4fc29f52a567ec264b4f/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:35.440506 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4e81dc-32a5-40ad-834a-6b01652b51b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=c908bfb9e6e34f1589114650c691c8c1, user_id=ebf9d6d679ef4fc29f52a567ec264b4f, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:35.443405 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4e81dc-32a5-40ad-834a-6b01652b51b0 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:35.571366 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 50/109] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:42:35.575126 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 60/110] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 1 03:42:35 2022] PUT /identity/v3/projects/c908bfb9e6e34f1589114650c691c8c1/users/ebf9d6d679ef4fc29f52a567ec264b4f/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 03:42:35.616373 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a1a82-5306-42ac-9719-cfb8e75c058a None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:35.687752 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81338e2d-8228-4281-a859-72b95577af4a None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:35.688247 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81338e2d-8228-4281-a859-72b95577af4a None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:35.688730 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81338e2d-8228-4281-a859-72b95577af4a None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:35.691618 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 61/111] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:42:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:42:35.700542 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879ba83-95ec-4c17-b1dd-7dba75e85b16 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:35.700997 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879ba83-95ec-4c17-b1dd-7dba75e85b16 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:35.701456 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879ba83-95ec-4c17-b1dd-7dba75e85b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:35.753060 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-1879ba83-95ec-4c17-b1dd-7dba75e85b16 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:42:35.755358 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1879ba83-95ec-4c17-b1dd-7dba75e85b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:42:35.867347 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a1a82-5306-42ac-9719-cfb8e75c058a None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:35.899847 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:35.930382 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf888c-a2f7-4c51-8c2a-a41230b215c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:35.934611 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf888c-a2f7-4c51-8c2a-a41230b215c3 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:35.937298 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf888c-a2f7-4c51-8c2a-a41230b215c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:35.937787 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf888c-a2f7-4c51-8c2a-a41230b215c3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:35.960712 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daf888c-a2f7-4c51-8c2a-a41230b215c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:42:35.970042 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-3daf888c-a2f7-4c51-8c2a-a41230b215c3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 03:42:35.970042 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:42:35.970042 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:42:35.970042 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:42:35.970042 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:42:35.970042 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:42:35.970042 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:42:35.970042 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:42:35.970042 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:42:35.970042 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:42:35.970042 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:42:35.970042 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:42:35.970042 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:42:35.970042 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:42:35.970042 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:42:35.970042 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:42:35.970924 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:42:35.970924 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:42:35.970924 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:42:35.970924 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:42:35.970924 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:42:35.970924 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:42:35.970924 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:42:35.970924 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:42:35.970924 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:42:35.970924 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:42:35.970924 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:42:35.970924 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:42:35.970924 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:42:35.970924 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:42:35.970924 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:42:35.970924 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:42:35.971713 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:42:35.971713 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:42:35.971713 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:42:35.971713 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:42:35.971713 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:42:35.971713 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:42:35.971713 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:42:35.971713 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:42:35.971713 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:42:35.971713 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:42:35.971713 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 03:42:35.971713 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:42:35.974846 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 51/112] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:42:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:42:35.982208 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 62/113] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:42:35.986532 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf888c-a2f7-4c51-8c2a-a41230b215c3 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:36.010200 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22530193-3956-4ab6-9f8b-0a3abb9b8534 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:36.010658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22530193-3956-4ab6-9f8b-0a3abb9b8534 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:36.012021 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22530193-3956-4ab6-9f8b-0a3abb9b8534 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:36.014712 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 63/114] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:42:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:42:36.024331 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11225e74-3840-4707-857a-323ea86c0b5c None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:36.024808 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11225e74-3840-4707-857a-323ea86c0b5c None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:36.025308 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11225e74-3840-4707-857a-323ea86c0b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:36.052965 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-11225e74-3840-4707-857a-323ea86c0b5c None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:42:36.054882 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-11225e74-3840-4707-857a-323ea86c0b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:42:36.187983 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:36.202858 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 64/115] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:42:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:42:36.209198 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11225e74-3840-4707-857a-323ea86c0b5c None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:36.225333 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf888c-a2f7-4c51-8c2a-a41230b215c3 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:36.309234 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394cbc3-c75c-487d-927f-716be2563dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:36.310467 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394cbc3-c75c-487d-927f-716be2563dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:36.310980 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394cbc3-c75c-487d-927f-716be2563dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:36.311497 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394cbc3-c75c-487d-927f-716be2563dd9 None admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:36.312963 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d394cbc3-c75c-487d-927f-716be2563dd9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:42:36.313522 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d394cbc3-c75c-487d-927f-716be2563dd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:36.316252 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d394cbc3-c75c-487d-927f-716be2563dd9 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:36.340023 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 52/116] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 1 03:42:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:36.345378 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394cbc3-c75c-487d-927f-716be2563dd9 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:36.486071 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:36.495178 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11225e74-3840-4707-857a-323ea86c0b5c None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:36.563409 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e8d034-edbb-419f-817f-a1eeff1f4ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:36.564820 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8d034-edbb-419f-817f-a1eeff1f4ead None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:36.565473 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8d034-edbb-419f-817f-a1eeff1f4ead None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:36.565969 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8d034-edbb-419f-817f-a1eeff1f4ead None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:36.586224 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e8d034-edbb-419f-817f-a1eeff1f4ead None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:42:36.603716 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-86e8d034-edbb-419f-817f-a1eeff1f4ead None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 03:42:36.603716 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:42:36.603716 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:42:36.603716 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:42:36.603716 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:42:36.603716 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:42:36.603716 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:42:36.603716 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:42:36.603716 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:42:36.603716 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:42:36.603716 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:42:36.603716 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:42:36.603716 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:42:36.603716 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:42:36.603716 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:42:36.603716 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:42:36.604623 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:42:36.604623 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:42:36.604623 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:42:36.604623 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:42:36.604623 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:42:36.604623 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:42:36.604623 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:42:36.604623 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:42:36.604623 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:42:36.604623 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:42:36.604623 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:42:36.604623 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:42:36.604623 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:42:36.604623 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:42:36.604623 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:42:36.604623 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:42:36.605343 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:42:36.605343 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:42:36.605343 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:42:36.605343 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:42:36.605343 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:42:36.605343 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:42:36.605343 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:42:36.605343 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:42:36.605343 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:42:36.605343 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:42:36.605343 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 03:42:36.605343 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:42:36.606531 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 65/117] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Jul 1 03:42:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 398 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:42:36.607468 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e8d034-edbb-419f-817f-a1eeff1f4ead None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:36.666978 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394cbc3-c75c-487d-927f-716be2563dd9 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:36.691402 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:36.749920 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e8d034-edbb-419f-817f-a1eeff1f4ead None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:36.754572 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada97cc-c73f-4054-a5d1-3c2cd35907b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:36.756177 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada97cc-c73f-4054-a5d1-3c2cd35907b8 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:36.756768 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada97cc-c73f-4054-a5d1-3c2cd35907b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:36.757352 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada97cc-c73f-4054-a5d1-3c2cd35907b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:36.781203 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada97cc-c73f-4054-a5d1-3c2cd35907b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:42:36.789420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-eada97cc-c73f-4054-a5d1-3c2cd35907b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:42:36.789420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:42:36.789420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:42:36.789420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:42:36.789420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:42:36.789420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:42:36.789420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:42:36.789420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:42:36.789420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:42:36.789420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:42:36.789420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:42:36.789420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:42:36.789420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:42:36.789420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:42:36.789420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:42:36.789420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:42:36.790317 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:42:36.790317 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:42:36.790317 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:42:36.790317 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:42:36.790317 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:42:36.790317 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:42:36.790317 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:42:36.790317 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:42:36.790317 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:42:36.790317 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:42:36.790317 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:42:36.790317 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:42:36.790317 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:42:36.790317 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:42:36.790317 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:42:36.790317 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:42:36.792040 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:42:36.792040 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:42:36.792040 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:42:36.792040 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:42:36.792040 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:42:36.792040 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:42:36.792040 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:42:36.792040 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:42:36.792040 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:42:36.792040 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:42:36.792040 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:42:36.792040 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:42:36.794876 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 53/118] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 1 03:42:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 454 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:42:36.796234 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada97cc-c73f-4054-a5d1-3c2cd35907b8 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:36.804386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8379f22d-1059-431b-bf44-88a6935e2842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:36.805302 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379f22d-1059-431b-bf44-88a6935e2842 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:36.805589 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379f22d-1059-431b-bf44-88a6935e2842 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:36.805871 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379f22d-1059-431b-bf44-88a6935e2842 None admin] PATH_INFO: `/v3/users/dcb773acde5446b7a2e7fb8e5a50fb69` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:36.822551 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8379f22d-1059-431b-bf44-88a6935e2842 None admin] RBAC: Authorizing `identity:get_user(user_id=dcb773acde5446b7a2e7fb8e5a50fb69)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:36.824564 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8379f22d-1059-431b-bf44-88a6935e2842 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:36.826655 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 66/119] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:42:36 2022] GET /identity/v3/users/dcb773acde5446b7a2e7fb8e5a50fb69 => generated 289 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:36.832949 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e46d9-e5a5-447c-b15c-1c6431e8b1cd None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:36.833525 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e46d9-e5a5-447c-b15c-1c6431e8b1cd None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:36.834049 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e46d9-e5a5-447c-b15c-1c6431e8b1cd None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:36.840939 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 67/120] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:42:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:42:36.842158 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e46d9-e5a5-447c-b15c-1c6431e8b1cd None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:36.921101 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada97cc-c73f-4054-a5d1-3c2cd35907b8 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:36.924145 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:36.959679 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b9019-eb76-4412-a96c-f73c133d35fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:36.960379 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b9019-eb76-4412-a96c-f73c133d35fb None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:36.960669 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b9019-eb76-4412-a96c-f73c133d35fb None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:36.960949 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b9019-eb76-4412-a96c-f73c133d35fb None admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:36.961724 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b9019-eb76-4412-a96c-f73c133d35fb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:42:36.962035 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b9019-eb76-4412-a96c-f73c133d35fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:36.964179 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b9019-eb76-4412-a96c-f73c133d35fb None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:36.975119 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 54/121] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:42:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:36.976034 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b9019-eb76-4412-a96c-f73c133d35fb None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:37.004732 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e46d9-e5a5-447c-b15c-1c6431e8b1cd None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:37.022771 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:37.046584 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598af83-0c80-462b-8160-7c90deea8837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:37.047133 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598af83-0c80-462b-8160-7c90deea8837 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:37.047424 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598af83-0c80-462b-8160-7c90deea8837 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:37.047735 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598af83-0c80-462b-8160-7c90deea8837 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:37.048503 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f598af83-0c80-462b-8160-7c90deea8837 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:42:37.049111 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f598af83-0c80-462b-8160-7c90deea8837 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:37.050610 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f598af83-0c80-462b-8160-7c90deea8837 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:37.065532 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 68/122] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:42:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:37.065532 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28a083-4f12-43f6-a861-5bae9006c707 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:37.065532 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28a083-4f12-43f6-a861-5bae9006c707 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:37.065532 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28a083-4f12-43f6-a861-5bae9006c707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:37.083239 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-fd28a083-4f12-43f6-a861-5bae9006c707 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:42:37.084943 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-fd28a083-4f12-43f6-a861-5bae9006c707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:42:37.138781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b9019-eb76-4412-a96c-f73c133d35fb None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:37.179185 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baede8a-182e-4484-acf5-e00f3a8c1682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:37.179890 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baede8a-182e-4484-acf5-e00f3a8c1682 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:37.180178 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baede8a-182e-4484-acf5-e00f3a8c1682 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:37.180481 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baede8a-182e-4484-acf5-e00f3a8c1682 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:37.185345 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 69/123] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:42:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:42:37.187242 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd28a083-4f12-43f6-a861-5bae9006c707 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:37.219861 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:37.258698 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baede8a-182e-4484-acf5-e00f3a8c1682 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:37.260756 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baede8a-182e-4484-acf5-e00f3a8c1682 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:37.353075 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd28a083-4f12-43f6-a861-5bae9006c707 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:37.362493 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:37.376053 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 55/124] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:42:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 03:42:37.377309 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baede8a-182e-4484-acf5-e00f3a8c1682 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:37.396762 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35ac47-8197-4376-b1f3-1f7c476f8926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:37.397798 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35ac47-8197-4376-b1f3-1f7c476f8926 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:37.398155 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35ac47-8197-4376-b1f3-1f7c476f8926 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:37.398507 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35ac47-8197-4376-b1f3-1f7c476f8926 None admin] PATH_INFO: `/v3/users/ebf9d6d679ef4fc29f52a567ec264b4f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:37.400358 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc35ac47-8197-4376-b1f3-1f7c476f8926 None admin] RBAC: Authorizing `identity:get_user(user_id=ebf9d6d679ef4fc29f52a567ec264b4f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:37.402126 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc35ac47-8197-4376-b1f3-1f7c476f8926 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:37.404217 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 70/125] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:42:37 2022] GET /identity/v3/users/ebf9d6d679ef4fc29f52a567ec264b4f => generated 275 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:37.405578 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35ac47-8197-4376-b1f3-1f7c476f8926 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:37.458898 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:37.509037 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baede8a-182e-4484-acf5-e00f3a8c1682 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:37.536757 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35ac47-8197-4376-b1f3-1f7c476f8926 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:37.560428 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5074b-84be-4ba9-ac3d-6e284838cccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:37.561655 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5074b-84be-4ba9-ac3d-6e284838cccc None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:37.562155 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5074b-84be-4ba9-ac3d-6e284838cccc None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:37.562615 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5074b-84be-4ba9-ac3d-6e284838cccc None admin] PATH_INFO: `/v3/users/25426a981a294fbbafc4d23f43e2ba63` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:37.564365 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5074b-84be-4ba9-ac3d-6e284838cccc None admin] RBAC: Authorizing `identity:get_user(user_id=25426a981a294fbbafc4d23f43e2ba63)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:37.566200 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5074b-84be-4ba9-ac3d-6e284838cccc None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:37.568530 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 56/126] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:42:37 2022] GET /identity/v3/users/25426a981a294fbbafc4d23f43e2ba63 => generated 247 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:37.574836 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5074b-84be-4ba9-ac3d-6e284838cccc None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:37.582517 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b3695-dad0-4bac-a3cd-defb24af53c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:37.583531 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b3695-dad0-4bac-a3cd-defb24af53c4 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:37.583826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b3695-dad0-4bac-a3cd-defb24af53c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:37.584108 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b3695-dad0-4bac-a3cd-defb24af53c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:37.599229 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b3695-dad0-4bac-a3cd-defb24af53c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:42:37.608674 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-fc3b3695-dad0-4bac-a3cd-defb24af53c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 03:42:37.608674 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:42:37.608674 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:42:37.608674 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:42:37.608674 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:42:37.608674 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:42:37.608674 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:42:37.608674 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:42:37.608674 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:42:37.608674 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:42:37.608674 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:42:37.608674 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:42:37.608674 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:42:37.608674 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:42:37.608674 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:42:37.608674 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:42:37.609627 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:42:37.609627 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:42:37.609627 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:42:37.609627 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:42:37.609627 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:42:37.609627 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:42:37.609627 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:42:37.609627 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:42:37.609627 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:42:37.609627 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:42:37.609627 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:42:37.609627 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:42:37.609627 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:42:37.609627 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:42:37.609627 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:42:37.609627 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:42:37.610381 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:42:37.610381 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:42:37.610381 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:42:37.610381 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:42:37.610381 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:42:37.610381 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:42:37.610381 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:42:37.610381 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:42:37.610381 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:42:37.610381 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:42:37.610381 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 03:42:37.610381 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:42:37.610381 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 71/127] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:42:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:42:37.610992 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b3695-dad0-4bac-a3cd-defb24af53c4 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:37.654574 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:37.705682 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5074b-84be-4ba9-ac3d-6e284838cccc None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:37.738718 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b3695-dad0-4bac-a3cd-defb24af53c4 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:37.749773 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbfc0d1-e98b-4786-8b04-2f91ee15024c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:37.751091 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbfc0d1-e98b-4786-8b04-2f91ee15024c None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:37.751755 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbfc0d1-e98b-4786-8b04-2f91ee15024c None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:37.752235 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbfc0d1-e98b-4786-8b04-2f91ee15024c None admin] PATH_INFO: `/v3/projects/c908bfb9e6e34f1589114650c691c8c1` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:37.753773 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbfc0d1-e98b-4786-8b04-2f91ee15024c None admin] RBAC: Authorizing `identity:get_project(project_id=c908bfb9e6e34f1589114650c691c8c1)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:37.755732 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbfc0d1-e98b-4786-8b04-2f91ee15024c None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:37.758194 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 57/128] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:42:37 2022] GET /identity/v3/projects/c908bfb9e6e34f1589114650c691c8c1 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:37.760181 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbfc0d1-e98b-4786-8b04-2f91ee15024c None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:37.763408 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:37.782470 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd649085-0116-4943-9267-20b5f8469527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:37.783694 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd649085-0116-4943-9267-20b5f8469527 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:37.783694 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd649085-0116-4943-9267-20b5f8469527 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:37.783981 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd649085-0116-4943-9267-20b5f8469527 None admin] PATH_INFO: `/v3/projects/c908bfb9e6e34f1589114650c691c8c1` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:37.785437 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd649085-0116-4943-9267-20b5f8469527 None admin] RBAC: Authorizing `identity:get_project(project_id=c908bfb9e6e34f1589114650c691c8c1)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:37.787284 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd649085-0116-4943-9267-20b5f8469527 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:37.789545 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 72/129] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:42:37 2022] GET /identity/v3/projects/c908bfb9e6e34f1589114650c691c8c1 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:37.790792 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd649085-0116-4943-9267-20b5f8469527 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:37.883799 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbfc0d1-e98b-4786-8b04-2f91ee15024c None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:37.913611 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd649085-0116-4943-9267-20b5f8469527 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:37.916403 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:37.928627 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3fd99-b572-446b-9b98-87aa78fcf351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:37.929871 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3fd99-b572-446b-9b98-87aa78fcf351 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:37.930356 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3fd99-b572-446b-9b98-87aa78fcf351 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:37.930876 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3fd99-b572-446b-9b98-87aa78fcf351 None admin] PATH_INFO: `/v3/projects/c908bfb9e6e34f1589114650c691c8c1` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:37.933128 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a3fd99-b572-446b-9b98-87aa78fcf351 None admin] RBAC: Authorizing `identity:get_project(project_id=c908bfb9e6e34f1589114650c691c8c1)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:37.934898 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a3fd99-b572-446b-9b98-87aa78fcf351 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:37.937050 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 58/130] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:42:37 2022] GET /identity/v3/projects/c908bfb9e6e34f1589114650c691c8c1 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:37.943034 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3fd99-b572-446b-9b98-87aa78fcf351 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:37.956461 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c36adf-1320-4532-88e7-431919a89f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:37.957212 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c36adf-1320-4532-88e7-431919a89f7d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:37.957503 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c36adf-1320-4532-88e7-431919a89f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:37.957792 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c36adf-1320-4532-88e7-431919a89f7d None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:37.958929 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c36adf-1320-4532-88e7-431919a89f7d None admin] RBAC: Adding query filter params (name=member) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:42:37.959037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c36adf-1320-4532-88e7-431919a89f7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:37.960477 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c36adf-1320-4532-88e7-431919a89f7d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:37.971401 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 73/131] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 1 03:42:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:37.972133 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c36adf-1320-4532-88e7-431919a89f7d None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:38.028011 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:38.065219 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3fd99-b572-446b-9b98-87aa78fcf351 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:38.094964 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c36adf-1320-4532-88e7-431919a89f7d None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:38.106967 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed7271-c99f-46d0-8506-a859e5861488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:38.108167 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed7271-c99f-46d0-8506-a859e5861488 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:38.108657 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed7271-c99f-46d0-8506-a859e5861488 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:38.109157 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed7271-c99f-46d0-8506-a859e5861488 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:38.110214 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed7271-c99f-46d0-8506-a859e5861488 None admin] RBAC: Adding query filter params (role.id=29f86d307e104b0bbbcf69660a405cea, scope.project.id=c908bfb9e6e34f1589114650c691c8c1, user.id=dcb773acde5446b7a2e7fb8e5a50fb69) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:42:38.110831 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed7271-c99f-46d0-8506-a859e5861488 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:38.112661 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed7271-c99f-46d0-8506-a859e5861488 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:38.120116 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 59/132] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:42:37 2022] GET /identity/v3/role_assignments?user.id=dcb773acde5446b7a2e7fb8e5a50fb69&scope.project.id=c908bfb9e6e34f1589114650c691c8c1&role.id=29f86d307e104b0bbbcf69660a405cea => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:38.121285 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed7271-c99f-46d0-8506-a859e5861488 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:38.136640 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86254604-84e3-48bd-bc84-540897d95f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:38.137632 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86254604-84e3-48bd-bc84-540897d95f19 None admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:38.137924 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86254604-84e3-48bd-bc84-540897d95f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:38.138206 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86254604-84e3-48bd-bc84-540897d95f19 None admin] PATH_INFO: `/v3/projects/c908bfb9e6e34f1589114650c691c8c1/users/ebf9d6d679ef4fc29f52a567ec264b4f/roles/132287c7d1f9428d9195f2b4ed60756b` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:38.140834 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86254604-84e3-48bd-bc84-540897d95f19 None admin] RBAC: Authorizing `identity:create_grant(project_id=c908bfb9e6e34f1589114650c691c8c1, user_id=ebf9d6d679ef4fc29f52a567ec264b4f, role_id=132287c7d1f9428d9195f2b4ed60756b)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:38.142394 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86254604-84e3-48bd-bc84-540897d95f19 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:38.248576 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed7271-c99f-46d0-8506-a859e5861488 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:38.255766 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 74/133] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 1 03:42:37 2022] PUT /identity/v3/projects/c908bfb9e6e34f1589114650c691c8c1/users/ebf9d6d679ef4fc29f52a567ec264b4f/roles/132287c7d1f9428d9195f2b4ed60756b => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 03:42:38.256788 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86254604-84e3-48bd-bc84-540897d95f19 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:38.299199 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e8d9a8-3ff0-44db-b6d9-7c2241ff8614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:38.301992 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8d9a8-3ff0-44db-b6d9-7c2241ff8614 None admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:38.305279 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8d9a8-3ff0-44db-b6d9-7c2241ff8614 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:38.305890 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8d9a8-3ff0-44db-b6d9-7c2241ff8614 None admin] PATH_INFO: `/v3/projects/c908bfb9e6e34f1589114650c691c8c1/users/25426a981a294fbbafc4d23f43e2ba63/roles/681755518698445fabd9a8accec13c0f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:38.310946 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e8d9a8-3ff0-44db-b6d9-7c2241ff8614 None admin] RBAC: Authorizing `identity:create_grant(project_id=c908bfb9e6e34f1589114650c691c8c1, user_id=25426a981a294fbbafc4d23f43e2ba63, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:38.314314 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e8d9a8-3ff0-44db-b6d9-7c2241ff8614 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:38.319220 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:38.320995 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:38.419510 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 60/134] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 1 03:42:38 2022] PUT /identity/v3/projects/c908bfb9e6e34f1589114650c691c8c1/users/25426a981a294fbbafc4d23f43e2ba63/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 03:42:38.421329 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8eddc-8963-47cb-a4e3-3b8d92cc000b None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:38.422137 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8eddc-8963-47cb-a4e3-3b8d92cc000b None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:38.422633 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8eddc-8963-47cb-a4e3-3b8d92cc000b None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:38.425102 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 61/135] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:42:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:42:38.431927 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a411078-1954-4f8f-864b-70f316e47757 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:38.433856 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a411078-1954-4f8f-864b-70f316e47757 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:38.434532 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a411078-1954-4f8f-864b-70f316e47757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:38.468329 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86254604-84e3-48bd-bc84-540897d95f19 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:38.472853 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-5a411078-1954-4f8f-864b-70f316e47757 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:42:38.473932 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-5a411078-1954-4f8f-864b-70f316e47757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:42:38.541398 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d3736-07ba-4d0f-81e7-58c012b72ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:38.542361 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d3736-07ba-4d0f-81e7-58c012b72ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:38.542657 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d3736-07ba-4d0f-81e7-58c012b72ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:38.542935 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d3736-07ba-4d0f-81e7-58c012b72ec0 None admin] PATH_INFO: `/v3/users/ebf9d6d679ef4fc29f52a567ec264b4f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:38.548996 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d3736-07ba-4d0f-81e7-58c012b72ec0 None admin] RBAC: Authorizing `identity:get_user(user_id=ebf9d6d679ef4fc29f52a567ec264b4f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:38.550607 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d3736-07ba-4d0f-81e7-58c012b72ec0 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:38.553493 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 75/136] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:42:38 2022] GET /identity/v3/users/ebf9d6d679ef4fc29f52a567ec264b4f => generated 275 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:38.560086 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d3736-07ba-4d0f-81e7-58c012b72ec0 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:38.661521 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 62/137] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:42:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:42:38.699782 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a411078-1954-4f8f-864b-70f316e47757 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:38.748054 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:38.751845 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d3736-07ba-4d0f-81e7-58c012b72ec0 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:38.829537 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e7e58-4892-4028-a81d-29a470e7edec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:38.830325 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e7e58-4892-4028-a81d-29a470e7edec None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:38.830607 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e7e58-4892-4028-a81d-29a470e7edec None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:38.830884 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e7e58-4892-4028-a81d-29a470e7edec None admin] PATH_INFO: `/v3/projects/7353df3204b3473281ba1740cbb4eaa5` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:38.832410 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81e7e58-4892-4028-a81d-29a470e7edec None admin] RBAC: Authorizing `identity:get_project(project_id=7353df3204b3473281ba1740cbb4eaa5)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:38.836641 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81e7e58-4892-4028-a81d-29a470e7edec None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:38.838860 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 76/138] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:42:38 2022] GET /identity/v3/projects/7353df3204b3473281ba1740cbb4eaa5 => generated 312 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:42:38.847120 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e7e58-4892-4028-a81d-29a470e7edec None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:38.896778 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a411078-1954-4f8f-864b-70f316e47757 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:38.941459 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:38.954772 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32fd33-55d4-46d4-a83a-da778f4b2e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:38.955620 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32fd33-55d4-46d4-a83a-da778f4b2e53 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:38.955895 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32fd33-55d4-46d4-a83a-da778f4b2e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:38.956173 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32fd33-55d4-46d4-a83a-da778f4b2e53 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:38.958121 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32fd33-55d4-46d4-a83a-da778f4b2e53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:38.960109 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32fd33-55d4-46d4-a83a-da778f4b2e53 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:38.962142 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 63/139] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:42:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:38.969741 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32fd33-55d4-46d4-a83a-da778f4b2e53 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:39.104272 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e7e58-4892-4028-a81d-29a470e7edec None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:39.177295 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32fd33-55d4-46d4-a83a-da778f4b2e53 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:39.184273 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47563d0d-8881-46cb-963a-16b5f5c2d3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:39.185206 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47563d0d-8881-46cb-963a-16b5f5c2d3ba None admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:39.185489 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47563d0d-8881-46cb-963a-16b5f5c2d3ba None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:39.185771 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47563d0d-8881-46cb-963a-16b5f5c2d3ba None admin] PATH_INFO: `/v3/projects/7353df3204b3473281ba1740cbb4eaa5/users/ebf9d6d679ef4fc29f52a567ec264b4f/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:39.193013 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47563d0d-8881-46cb-963a-16b5f5c2d3ba None admin] RBAC: Authorizing `identity:create_grant(project_id=7353df3204b3473281ba1740cbb4eaa5, user_id=ebf9d6d679ef4fc29f52a567ec264b4f, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:39.194542 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47563d0d-8881-46cb-963a-16b5f5c2d3ba None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:39.234931 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23f848-b07b-4f04-93ce-b1b503115d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:39.235686 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23f848-b07b-4f04-93ce-b1b503115d91 None admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:39.235972 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23f848-b07b-4f04-93ce-b1b503115d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:39.236256 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23f848-b07b-4f04-93ce-b1b503115d91 None admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:39.237207 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23f848-b07b-4f04-93ce-b1b503115d91 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:39.238814 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23f848-b07b-4f04-93ce-b1b503115d91 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:39.297812 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 77/140] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 1 03:42:38 2022] PUT /identity/v3/projects/7353df3204b3473281ba1740cbb4eaa5/users/ebf9d6d679ef4fc29f52a567ec264b4f/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 03:42:39.300326 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a3085-6a4d-44f5-aeda-49344ccad0e4 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:39.300939 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a3085-6a4d-44f5-aeda-49344ccad0e4 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:39.308074 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a3085-6a4d-44f5-aeda-49344ccad0e4 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:39.310897 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 78/141] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:42:39 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:42:39.318489 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2aa82-e094-4fdf-836d-068a8a284d00 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:39.318966 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2aa82-e094-4fdf-836d-068a8a284d00 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:39.319556 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2aa82-e094-4fdf-836d-068a8a284d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:39.356466 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-bfd2aa82-e094-4fdf-836d-068a8a284d00 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:42:39.358423 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-bfd2aa82-e094-4fdf-836d-068a8a284d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:42:39.374535 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 64/142] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Jul 1 03:42:38 2022] POST /identity/v3/users => generated 283 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 03:42:39.389128 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:39.477647 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 79/143] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:42:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:42:39.514114 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23f848-b07b-4f04-93ce-b1b503115d91 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:39.635518 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:39.734663 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23f848-b07b-4f04-93ce-b1b503115d91 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:39.801972 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ddf7f-4009-40d4-a3b9-a6cff76a0ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:39.803331 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ddf7f-4009-40d4-a3b9-a6cff76a0ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:39.803870 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ddf7f-4009-40d4-a3b9-a6cff76a0ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:39.804370 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ddf7f-4009-40d4-a3b9-a6cff76a0ea7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:39.824383 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6ddf7f-4009-40d4-a3b9-a6cff76a0ea7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:42:39.840589 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-2f6ddf7f-4009-40d4-a3b9-a6cff76a0ea7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 03:42:39.840589 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:42:39.840589 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:42:39.840589 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:42:39.840589 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:42:39.840589 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:42:39.840589 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:42:39.840589 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:42:39.840589 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:42:39.840589 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:42:39.840589 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:42:39.840589 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:42:39.840589 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:42:39.840589 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:42:39.840589 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:42:39.840589 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:42:39.841491 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:42:39.841491 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:42:39.841491 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:42:39.841491 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:42:39.841491 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:42:39.841491 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:42:39.841491 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:42:39.841491 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:42:39.841491 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:42:39.841491 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:42:39.841491 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:42:39.841491 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:42:39.841491 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:42:39.841491 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:42:39.841491 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:42:39.841491 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:42:39.842237 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:42:39.842237 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:42:39.842237 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:42:39.842237 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:42:39.842237 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:42:39.842237 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:42:39.842237 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:42:39.842237 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:42:39.842237 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:42:39.842237 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:42:39.842237 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 03:42:39.842237 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:42:39.842791 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 65/144] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:42:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:42:39.852522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2aa82-e094-4fdf-836d-068a8a284d00 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:40.048824 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2aa82-e094-4fdf-836d-068a8a284d00 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:40.113040 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15be257-b0b4-4072-88ae-c65ce0049150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:40.114169 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15be257-b0b4-4072-88ae-c65ce0049150 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:40.114668 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15be257-b0b4-4072-88ae-c65ce0049150 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:40.115229 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15be257-b0b4-4072-88ae-c65ce0049150 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:40.116673 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15be257-b0b4-4072-88ae-c65ce0049150 None admin] RBAC: Adding query filter params (name=member) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:42:40.117221 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15be257-b0b4-4072-88ae-c65ce0049150 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:40.119992 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15be257-b0b4-4072-88ae-c65ce0049150 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:40.137068 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 80/145] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 1 03:42:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:40.148391 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ddf7f-4009-40d4-a3b9-a6cff76a0ea7 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:40.348074 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ddf7f-4009-40d4-a3b9-a6cff76a0ea7 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:40.370462 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:40.425503 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b85b03-1e09-47b7-8e75-9f30a9a04e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:40.427042 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b85b03-1e09-47b7-8e75-9f30a9a04e7c None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:40.427546 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b85b03-1e09-47b7-8e75-9f30a9a04e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:40.428036 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b85b03-1e09-47b7-8e75-9f30a9a04e7c None admin] PATH_INFO: `/v3/users/ebf9d6d679ef4fc29f52a567ec264b4f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:40.430793 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b85b03-1e09-47b7-8e75-9f30a9a04e7c None admin] RBAC: Authorizing `identity:get_user(user_id=ebf9d6d679ef4fc29f52a567ec264b4f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:40.434192 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b85b03-1e09-47b7-8e75-9f30a9a04e7c None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:40.437508 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 66/146] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:42:40 2022] GET /identity/v3/users/ebf9d6d679ef4fc29f52a567ec264b4f => generated 275 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:42:40.445666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15be257-b0b4-4072-88ae-c65ce0049150 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:40.476167 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:40.616573 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15be257-b0b4-4072-88ae-c65ce0049150 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:40.665773 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d9efe-f60a-40a2-b90e-17306ffa3da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:40.666468 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d9efe-f60a-40a2-b90e-17306ffa3da6 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:40.666753 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d9efe-f60a-40a2-b90e-17306ffa3da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:40.667031 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d9efe-f60a-40a2-b90e-17306ffa3da6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:40.781275 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d9efe-f60a-40a2-b90e-17306ffa3da6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:40.784087 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d9efe-f60a-40a2-b90e-17306ffa3da6 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:40.817664 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:41.027908 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 81/147] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:42:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 03:42:41.036192 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b85b03-1e09-47b7-8e75-9f30a9a04e7c None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:41.277733 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b85b03-1e09-47b7-8e75-9f30a9a04e7c None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:41.350587 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9bdc6-97d3-4f99-8f5f-8ca3605b77c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:41.352435 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9bdc6-97d3-4f99-8f5f-8ca3605b77c4 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:41.353719 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9bdc6-97d3-4f99-8f5f-8ca3605b77c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:41.354455 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9bdc6-97d3-4f99-8f5f-8ca3605b77c4 None admin] PATH_INFO: `/v3/projects/c908bfb9e6e34f1589114650c691c8c1` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:41.357018 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc9bdc6-97d3-4f99-8f5f-8ca3605b77c4 None admin] RBAC: Authorizing `identity:get_project(project_id=c908bfb9e6e34f1589114650c691c8c1)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:41.360134 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc9bdc6-97d3-4f99-8f5f-8ca3605b77c4 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:41.364416 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 67/148] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:42:41 2022] GET /identity/v3/projects/c908bfb9e6e34f1589114650c691c8c1 => generated 298 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:41.374737 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d9efe-f60a-40a2-b90e-17306ffa3da6 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:41.608219 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d9efe-f60a-40a2-b90e-17306ffa3da6 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:41.642549 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:41.682387 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbae796-ac72-42af-977c-97ca10569ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:41.683554 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbae796-ac72-42af-977c-97ca10569ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:41.684044 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbae796-ac72-42af-977c-97ca10569ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:41.684525 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbae796-ac72-42af-977c-97ca10569ab5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:41.686052 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbae796-ac72-42af-977c-97ca10569ab5 None admin] RBAC: Adding query filter params (role.id=c0b595782ebc410db693ef7fa70522a3, scope.project.id=c908bfb9e6e34f1589114650c691c8c1, user.id=ebf9d6d679ef4fc29f52a567ec264b4f) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:42:41.686588 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbae796-ac72-42af-977c-97ca10569ab5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:41.689428 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbae796-ac72-42af-977c-97ca10569ab5 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:41.701683 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 82/149] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:42:41 2022] GET /identity/v3/role_assignments?user.id=ebf9d6d679ef4fc29f52a567ec264b4f&scope.project.id=c908bfb9e6e34f1589114650c691c8c1&role.id=c0b595782ebc410db693ef7fa70522a3 => generated 608 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:42.536587 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc85f2-1c12-4420-8995-bc93e95dd9e0 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:42.537094 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc85f2-1c12-4420-8995-bc93e95dd9e0 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:42.537174 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc85f2-1c12-4420-8995-bc93e95dd9e0 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:42.538559 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 68/150] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 03:42:42.546949 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303cf52-49b7-4a8f-826b-2d4bf8d55367 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:42.547238 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303cf52-49b7-4a8f-826b-2d4bf8d55367 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:42.547544 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303cf52-49b7-4a8f-826b-2d4bf8d55367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:42.567647 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-0303cf52-49b7-4a8f-826b-2d4bf8d55367 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:42:42.568890 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0303cf52-49b7-4a8f-826b-2d4bf8d55367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:42:42.663113 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 83/151] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:42:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:42:42.737088 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc85f2-1c12-4420-8995-bc93e95dd9e0 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:42.802897 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:42.874906 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc85f2-1c12-4420-8995-bc93e95dd9e0 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:42.919231 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b2777-e470-4df3-b932-95c9dc7b9de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:42.920177 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b2777-e470-4df3-b932-95c9dc7b9de6 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:42.920471 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b2777-e470-4df3-b932-95c9dc7b9de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:42.920752 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b2777-e470-4df3-b932-95c9dc7b9de6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:42.945030 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b2777-e470-4df3-b932-95c9dc7b9de6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:42:42.966246 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-143b2777-e470-4df3-b932-95c9dc7b9de6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 03:42:42.966246 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:42:42.966246 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:42:42.966246 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:42:42.966246 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:42:42.966246 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:42:42.966246 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:42:42.966246 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:42:42.966246 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:42:42.966246 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:42:42.966246 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:42:42.966246 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:42:42.966246 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:42:42.966246 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:42:42.966246 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:42:42.966246 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:42:42.967168 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:42:42.967168 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:42:42.967168 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:42:42.967168 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:42:42.967168 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:42:42.967168 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:42:42.967168 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:42:42.967168 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:42:42.967168 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:42:42.967168 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:42:42.967168 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:42:42.967168 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:42:42.967168 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:42:42.967168 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:42:42.967168 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:42:42.967168 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:42:42.968017 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:42:42.968017 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:42:42.968017 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:42:42.968017 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:42:42.968017 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:42:42.968017 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:42:42.968017 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:42:42.968017 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:42:42.968017 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:42:42.968017 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:42:42.968017 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 03:42:42.968017 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:42:42.968926 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 69/152] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Jul 1 03:42:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:42:42.977382 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303cf52-49b7-4a8f-826b-2d4bf8d55367 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:43.133232 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303cf52-49b7-4a8f-826b-2d4bf8d55367 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:43.143735 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:43.175125 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff3ac2-9d9b-4412-9241-06df7b487849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:43.175853 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff3ac2-9d9b-4412-9241-06df7b487849 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:43.176138 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff3ac2-9d9b-4412-9241-06df7b487849 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:43.176415 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff3ac2-9d9b-4412-9241-06df7b487849 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:43.177186 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff3ac2-9d9b-4412-9241-06df7b487849 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:42:43.177492 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff3ac2-9d9b-4412-9241-06df7b487849 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:43.179018 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff3ac2-9d9b-4412-9241-06df7b487849 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:43.190973 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 84/153] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:42:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:42:43.200270 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b2777-e470-4df3-b932-95c9dc7b9de6 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:43.345023 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b2777-e470-4df3-b932-95c9dc7b9de6 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:43.347756 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:43.387020 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ce5c4-912f-49f0-bb59-52e65ef116c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:43.387844 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ce5c4-912f-49f0-bb59-52e65ef116c9 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:43.388118 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ce5c4-912f-49f0-bb59-52e65ef116c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:43.388393 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ce5c4-912f-49f0-bb59-52e65ef116c9 None admin] PATH_INFO: `/v3/users/ebf9d6d679ef4fc29f52a567ec264b4f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:43.389676 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2ce5c4-912f-49f0-bb59-52e65ef116c9 None admin] RBAC: Authorizing `identity:get_user(user_id=ebf9d6d679ef4fc29f52a567ec264b4f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:43.391156 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2ce5c4-912f-49f0-bb59-52e65ef116c9 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:43.393194 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 70/154] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:42:43 2022] GET /identity/v3/users/ebf9d6d679ef4fc29f52a567ec264b4f => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:43.402009 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff3ac2-9d9b-4412-9241-06df7b487849 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:43.489140 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518cd5aa-29c1-40ee-98e4-d9b63a67501b None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:43.489546 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518cd5aa-29c1-40ee-98e4-d9b63a67501b None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:43.489725 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518cd5aa-29c1-40ee-98e4-d9b63a67501b None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:43.491170 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 71/155] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 03:42:43.503481 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4211736-0772-449d-9f60-9eaf972acc56 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:43.503855 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4211736-0772-449d-9f60-9eaf972acc56 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:43.504084 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4211736-0772-449d-9f60-9eaf972acc56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:43.529707 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-d4211736-0772-449d-9f60-9eaf972acc56 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:42:43.532139 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-d4211736-0772-449d-9f60-9eaf972acc56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:42:43.565187 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff3ac2-9d9b-4412-9241-06df7b487849 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:43.637314 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99ab34f-9213-4087-846c-0cae218d0b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:43.639205 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ab34f-9213-4087-846c-0cae218d0b8d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:43.639858 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ab34f-9213-4087-846c-0cae218d0b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:43.641671 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ab34f-9213-4087-846c-0cae218d0b8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:43.682549 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 72/156] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:42:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 03:42:43.685376 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82767ca-d748-45d2-bc21-c0cec950057a None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:43.686088 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82767ca-d748-45d2-bc21-c0cec950057a None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:43.686510 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82767ca-d748-45d2-bc21-c0cec950057a None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:43.690994 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 73/157] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:42:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:42:43.701852 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82444c5a-1ace-403b-88ff-71a111908332 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:43.702366 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82444c5a-1ace-403b-88ff-71a111908332 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:43.702783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82444c5a-1ace-403b-88ff-71a111908332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:43.724592 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:43.730033 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-82444c5a-1ace-403b-88ff-71a111908332 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:42:43.731527 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-82444c5a-1ace-403b-88ff-71a111908332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:42:43.841067 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99ab34f-9213-4087-846c-0cae218d0b8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:43.845236 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99ab34f-9213-4087-846c-0cae218d0b8d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:43.897596 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 74/158] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:42:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 03:42:43.898657 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82444c5a-1ace-403b-88ff-71a111908332 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:43.974137 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:44.128694 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82444c5a-1ace-403b-88ff-71a111908332 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:44.148366 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 85/159] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:42:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 747 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 03:42:44.149036 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99ab34f-9213-4087-846c-0cae218d0b8d None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:44.206055 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4aba7c-ac9d-4ada-aa63-0903445ec0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:44.207234 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4aba7c-ac9d-4ada-aa63-0903445ec0f1 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:44.207832 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4aba7c-ac9d-4ada-aa63-0903445ec0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:44.208305 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4aba7c-ac9d-4ada-aa63-0903445ec0f1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:44.222405 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4aba7c-ac9d-4ada-aa63-0903445ec0f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:42:44.231527 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-6f4aba7c-ac9d-4ada-aa63-0903445ec0f1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 03:42:44.231527 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:42:44.231527 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:42:44.231527 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:42:44.231527 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:42:44.231527 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:42:44.231527 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:42:44.231527 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:42:44.231527 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:42:44.231527 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:42:44.231527 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:42:44.231527 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:42:44.231527 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:42:44.231527 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:42:44.231527 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:42:44.231527 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:42:44.232532 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:42:44.232532 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:42:44.232532 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:42:44.232532 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:42:44.232532 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:42:44.232532 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:42:44.232532 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:42:44.232532 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:42:44.232532 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:42:44.232532 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:42:44.232532 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:42:44.232532 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:42:44.232532 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:42:44.232532 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:42:44.232532 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:42:44.232532 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:42:44.233292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:42:44.233292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:42:44.233292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:42:44.233292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:42:44.233292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:42:44.233292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:42:44.233292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:42:44.233292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:42:44.233292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:42:44.233292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:42:44.233292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 03:42:44.233292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:42:44.236233 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 75/160] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:42:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:42:44.237402 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4aba7c-ac9d-4ada-aa63-0903445ec0f1 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:44.269499 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:44.328840 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99ab34f-9213-4087-846c-0cae218d0b8d None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:44.376255 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401634c7-6c61-4d0e-894c-ad96d9b1ca89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:44.377092 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401634c7-6c61-4d0e-894c-ad96d9b1ca89 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:44.377376 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401634c7-6c61-4d0e-894c-ad96d9b1ca89 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:44.377651 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401634c7-6c61-4d0e-894c-ad96d9b1ca89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:44.397221 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401634c7-6c61-4d0e-894c-ad96d9b1ca89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:42:44.409477 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-401634c7-6c61-4d0e-894c-ad96d9b1ca89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:42:44.409477 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:42:44.409477 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:42:44.409477 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:42:44.409477 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:42:44.409477 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:42:44.409477 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:42:44.409477 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:42:44.409477 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:42:44.409477 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:42:44.409477 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:42:44.409477 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:42:44.409477 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:42:44.409477 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:42:44.409477 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:42:44.409477 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:42:44.410386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:42:44.410386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:42:44.410386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:42:44.410386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:42:44.410386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:42:44.410386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:42:44.410386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:42:44.410386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:42:44.410386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:42:44.410386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:42:44.410386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:42:44.410386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:42:44.410386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:42:44.410386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:42:44.410386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:42:44.410386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:42:44.411168 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:42:44.411168 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:42:44.411168 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:42:44.411168 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:42:44.411168 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:42:44.411168 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:42:44.411168 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:42:44.411168 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:42:44.411168 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:42:44.411168 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:42:44.411168 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:42:44.411168 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:42:44.411168 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 86/161] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 1 03:42:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:42:44.411835 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401634c7-6c61-4d0e-894c-ad96d9b1ca89 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:44.500651 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:44.542236 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4aba7c-ac9d-4ada-aa63-0903445ec0f1 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:44.632363 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adaec0a-d506-417d-9b56-ecefe1d6850b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:44.633280 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adaec0a-d506-417d-9b56-ecefe1d6850b None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:44.633564 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adaec0a-d506-417d-9b56-ecefe1d6850b None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:44.633884 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adaec0a-d506-417d-9b56-ecefe1d6850b None admin] PATH_INFO: `/v3/projects/c908bfb9e6e34f1589114650c691c8c1` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:44.635235 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adaec0a-d506-417d-9b56-ecefe1d6850b None admin] RBAC: Authorizing `identity:get_project(project_id=c908bfb9e6e34f1589114650c691c8c1)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:44.636766 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adaec0a-d506-417d-9b56-ecefe1d6850b None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:44.638542 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 76/162] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:42:44 2022] GET /identity/v3/projects/c908bfb9e6e34f1589114650c691c8c1 => generated 298 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:44.639348 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adaec0a-d506-417d-9b56-ecefe1d6850b None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:44.724133 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401634c7-6c61-4d0e-894c-ad96d9b1ca89 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:44.783856 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:44.797932 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d2542-d052-4d58-b55a-fd30bf8b0450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:44.799476 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d2542-d052-4d58-b55a-fd30bf8b0450 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:44.811747 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d2542-d052-4d58-b55a-fd30bf8b0450 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:44.811747 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d2542-d052-4d58-b55a-fd30bf8b0450 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:44.811747 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622d2542-d052-4d58-b55a-fd30bf8b0450 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:42:44.811747 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622d2542-d052-4d58-b55a-fd30bf8b0450 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:44.811747 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622d2542-d052-4d58-b55a-fd30bf8b0450 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:44.824901 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 87/163] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 1 03:42:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 413 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:44.826258 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d2542-d052-4d58-b55a-fd30bf8b0450 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:44.880522 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adaec0a-d506-417d-9b56-ecefe1d6850b None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:44.946740 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a5168b-35f9-4a96-a298-2f1e29d4f305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:44.948414 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5168b-35f9-4a96-a298-2f1e29d4f305 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:44.948868 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5168b-35f9-4a96-a298-2f1e29d4f305 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:44.949331 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5168b-35f9-4a96-a298-2f1e29d4f305 None admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:44.950605 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a5168b-35f9-4a96-a298-2f1e29d4f305 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:42:44.951126 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a5168b-35f9-4a96-a298-2f1e29d4f305 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:44.953900 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a5168b-35f9-4a96-a298-2f1e29d4f305 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:44.969766 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 77/164] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:42:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:44.971943 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91310e-d76d-4a49-be29-da27aa23d561 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:44.972417 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91310e-d76d-4a49-be29-da27aa23d561 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:44.972876 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91310e-d76d-4a49-be29-da27aa23d561 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:44.975753 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 78/165] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:42:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:42:44.978430 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de04a38-433a-4f32-b86f-17aa4467dc98 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:44.978898 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de04a38-433a-4f32-b86f-17aa4467dc98 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:44.979352 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de04a38-433a-4f32-b86f-17aa4467dc98 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:44.982169 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 79/166] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:42:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:42:44.983370 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de04a38-433a-4f32-b86f-17aa4467dc98 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:44.992993 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d2542-d052-4d58-b55a-fd30bf8b0450 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:45.027511 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:45.063899 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2acf97-a279-4cc6-8233-e5b4b6dab929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:45.065896 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2acf97-a279-4cc6-8233-e5b4b6dab929 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:45.066958 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2acf97-a279-4cc6-8233-e5b4b6dab929 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:45.067673 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2acf97-a279-4cc6-8233-e5b4b6dab929 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:45.069859 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2acf97-a279-4cc6-8233-e5b4b6dab929 None admin] RBAC: Adding query filter params (role.id=132287c7d1f9428d9195f2b4ed60756b, scope.project.id=c908bfb9e6e34f1589114650c691c8c1, user.id=ebf9d6d679ef4fc29f52a567ec264b4f) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:42:45.070665 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2acf97-a279-4cc6-8233-e5b4b6dab929 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:45.073192 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2acf97-a279-4cc6-8233-e5b4b6dab929 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:45.086139 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 88/167] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:42:44 2022] GET /identity/v3/role_assignments?user.id=ebf9d6d679ef4fc29f52a567ec264b4f&scope.project.id=c908bfb9e6e34f1589114650c691c8c1&role.id=132287c7d1f9428d9195f2b4ed60756b => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:45.088658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2acf97-a279-4cc6-8233-e5b4b6dab929 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:45.213030 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de04a38-433a-4f32-b86f-17aa4467dc98 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:45.238917 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:45.283329 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f68a2a2-c182-4b9a-bd93-f983d15a157b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:45.284782 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68a2a2-c182-4b9a-bd93-f983d15a157b None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:45.285662 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68a2a2-c182-4b9a-bd93-f983d15a157b None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:45.286433 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68a2a2-c182-4b9a-bd93-f983d15a157b None admin] PATH_INFO: `/v3/users/dcb773acde5446b7a2e7fb8e5a50fb69` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:45.288220 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f68a2a2-c182-4b9a-bd93-f983d15a157b None admin] RBAC: Authorizing `identity:get_user(user_id=dcb773acde5446b7a2e7fb8e5a50fb69)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:45.291132 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f68a2a2-c182-4b9a-bd93-f983d15a157b None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:45.294006 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 80/168] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:42:44 2022] GET /identity/v3/users/dcb773acde5446b7a2e7fb8e5a50fb69 => generated 289 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:45.295583 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0074307-6d10-4182-b354-7be8e37e8e94 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:45.296133 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0074307-6d10-4182-b354-7be8e37e8e94 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:45.296635 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0074307-6d10-4182-b354-7be8e37e8e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:45.300248 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2acf97-a279-4cc6-8233-e5b4b6dab929 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:45.317376 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-a0074307-6d10-4182-b354-7be8e37e8e94 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:42:45.319721 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-a0074307-6d10-4182-b354-7be8e37e8e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:42:45.349221 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f655ec1-66b1-4d0d-848f-3f8557a53e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:45.350367 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f655ec1-66b1-4d0d-848f-3f8557a53e2b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:45.350695 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f655ec1-66b1-4d0d-848f-3f8557a53e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:45.351030 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f655ec1-66b1-4d0d-848f-3f8557a53e2b None admin] PATH_INFO: `/v3/users/25426a981a294fbbafc4d23f43e2ba63` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:45.353465 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f655ec1-66b1-4d0d-848f-3f8557a53e2b None admin] RBAC: Authorizing `identity:get_user(user_id=25426a981a294fbbafc4d23f43e2ba63)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:45.355394 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f655ec1-66b1-4d0d-848f-3f8557a53e2b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:45.362783 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 89/169] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:42:45 2022] GET /identity/v3/users/25426a981a294fbbafc4d23f43e2ba63 => generated 247 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:45.362783 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44531c13-2a86-45b9-bfff-40bb4913aa3e None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:45.362783 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44531c13-2a86-45b9-bfff-40bb4913aa3e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:45.362783 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44531c13-2a86-45b9-bfff-40bb4913aa3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:45.389416 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-44531c13-2a86-45b9-bfff-40bb4913aa3e None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:42:45.391325 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-44531c13-2a86-45b9-bfff-40bb4913aa3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:42:45.432203 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 81/170] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:42:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:42:45.434558 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177c13c-49a5-44b2-ad2c-b251f51e2792 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:45.435048 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177c13c-49a5-44b2-ad2c-b251f51e2792 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:45.435538 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177c13c-49a5-44b2-ad2c-b251f51e2792 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:45.437756 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 82/171] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:42:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:42:45.438751 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177c13c-49a5-44b2-ad2c-b251f51e2792 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:45.476570 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:45.509270 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 90/172] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:42:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:42:45.516512 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44531c13-2a86-45b9-bfff-40bb4913aa3e None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:45.582992 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:45.600731 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177c13c-49a5-44b2-ad2c-b251f51e2792 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:45.641299 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56edd5b9-5ddc-4ea3-a799-66aad8cdcf20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:45.642449 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56edd5b9-5ddc-4ea3-a799-66aad8cdcf20 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:45.642823 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56edd5b9-5ddc-4ea3-a799-66aad8cdcf20 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:45.643207 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56edd5b9-5ddc-4ea3-a799-66aad8cdcf20 None admin] PATH_INFO: `/v3/projects/c908bfb9e6e34f1589114650c691c8c1` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:45.644703 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56edd5b9-5ddc-4ea3-a799-66aad8cdcf20 None admin] RBAC: Authorizing `identity:get_project(project_id=c908bfb9e6e34f1589114650c691c8c1)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:45.646340 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56edd5b9-5ddc-4ea3-a799-66aad8cdcf20 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:45.648145 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 83/173] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:42:45 2022] GET /identity/v3/projects/c908bfb9e6e34f1589114650c691c8c1 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:45.649985 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32eeed-d9db-4090-a596-8ce2d44ce460 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:45.650334 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32eeed-d9db-4090-a596-8ce2d44ce460 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:45.650644 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32eeed-d9db-4090-a596-8ce2d44ce460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:45.656197 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44531c13-2a86-45b9-bfff-40bb4913aa3e None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:45.669052 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-ba32eeed-d9db-4090-a596-8ce2d44ce460 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:42:45.670352 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-ba32eeed-d9db-4090-a596-8ce2d44ce460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:42:45.703383 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf06751-1cc9-418b-84f0-4411063acd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:45.704263 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf06751-1cc9-418b-84f0-4411063acd1d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:45.704659 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf06751-1cc9-418b-84f0-4411063acd1d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:45.704991 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf06751-1cc9-418b-84f0-4411063acd1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:45.768141 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 84/174] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:42:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:42:45.769229 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba32eeed-d9db-4090-a596-8ce2d44ce460 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:45.796657 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:45.810115 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf06751-1cc9-418b-84f0-4411063acd1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:45.812819 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf06751-1cc9-418b-84f0-4411063acd1d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:45.878000 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:45.924134 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba32eeed-d9db-4090-a596-8ce2d44ce460 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:45.932750 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 91/175] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:42:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 03:42:45.934271 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a026c-ec66-4046-b1dd-9487ca799bbd None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:45.934643 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a026c-ec66-4046-b1dd-9487ca799bbd None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:45.934920 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a026c-ec66-4046-b1dd-9487ca799bbd None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:45.936731 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 92/176] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:42:45.940832 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a026c-ec66-4046-b1dd-9487ca799bbd None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:45.972030 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a15a7d-1138-4e5b-9e61-cea11a082d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:45.972869 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a15a7d-1138-4e5b-9e61-cea11a082d7c None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:45.973150 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a15a7d-1138-4e5b-9e61-cea11a082d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:45.973426 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a15a7d-1138-4e5b-9e61-cea11a082d7c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:45.986533 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a15a7d-1138-4e5b-9e61-cea11a082d7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:42:45.994960 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-58a15a7d-1138-4e5b-9e61-cea11a082d7c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 03:42:45.994960 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:42:45.994960 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:42:45.994960 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:42:45.994960 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:42:45.994960 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:42:45.994960 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:42:45.994960 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:42:45.994960 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:42:45.994960 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:42:45.994960 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:42:45.994960 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:42:45.994960 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:42:45.994960 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:42:45.994960 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:42:45.994960 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:42:45.996588 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:42:45.996588 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:42:45.996588 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:42:45.996588 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:42:45.996588 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:42:45.996588 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:42:45.996588 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:42:45.996588 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:42:45.996588 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:42:45.996588 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:42:45.996588 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:42:45.996588 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:42:45.996588 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:42:45.996588 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:42:45.996588 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:42:45.996588 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:42:45.998132 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:42:45.998132 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:42:45.998132 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:42:45.998132 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:42:45.998132 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:42:45.998132 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:42:45.998132 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:42:45.998132 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:42:45.998132 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:42:45.998132 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:42:45.998132 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 03:42:45.998132 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:42:45.998132 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 85/177] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:42:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:42:45.998132 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a15a7d-1138-4e5b-9e61-cea11a082d7c None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:46.090182 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a026c-ec66-4046-b1dd-9487ca799bbd None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:46.113018 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:46.140390 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a15a7d-1138-4e5b-9e61-cea11a082d7c None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:46.141830 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f40476-b5f1-4a92-af53-3f9b8f69a9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:46.142752 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f40476-b5f1-4a92-af53-3f9b8f69a9f2 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:46.143034 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f40476-b5f1-4a92-af53-3f9b8f69a9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:46.143307 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f40476-b5f1-4a92-af53-3f9b8f69a9f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:46.155588 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f40476-b5f1-4a92-af53-3f9b8f69a9f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:42:46.163413 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-74f40476-b5f1-4a92-af53-3f9b8f69a9f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:42:46.163413 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:42:46.163413 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:42:46.163413 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:42:46.163413 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:42:46.163413 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:42:46.163413 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:42:46.163413 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:42:46.163413 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:42:46.163413 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:42:46.163413 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:42:46.163413 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:42:46.163413 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:42:46.163413 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:42:46.163413 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:42:46.163413 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:42:46.164378 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:42:46.164378 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:42:46.164378 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:42:46.164378 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:42:46.164378 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:42:46.164378 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:42:46.164378 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:42:46.164378 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:42:46.164378 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:42:46.164378 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:42:46.164378 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:42:46.164378 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:42:46.164378 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:42:46.164378 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:42:46.164378 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:42:46.164378 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:42:46.165236 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:42:46.165236 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:42:46.165236 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:42:46.165236 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:42:46.165236 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:42:46.165236 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:42:46.165236 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:42:46.165236 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:42:46.165236 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:42:46.165236 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:42:46.165236 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:42:46.165236 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:42:46.165236 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 93/178] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 1 03:42:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:42:46.166136 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f40476-b5f1-4a92-af53-3f9b8f69a9f2 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:46.186325 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:46.200132 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383557b-892d-4007-a17a-0550af7dead5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:46.201607 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383557b-892d-4007-a17a-0550af7dead5 None admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:46.202066 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383557b-892d-4007-a17a-0550af7dead5 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:46.202524 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383557b-892d-4007-a17a-0550af7dead5 None admin] PATH_INFO: `/v3/projects/c908bfb9e6e34f1589114650c691c8c1/users/dcb773acde5446b7a2e7fb8e5a50fb69/roles/29f86d307e104b0bbbcf69660a405cea` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:46.205623 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383557b-892d-4007-a17a-0550af7dead5 None admin] RBAC: Authorizing `identity:create_grant(project_id=c908bfb9e6e34f1589114650c691c8c1, user_id=dcb773acde5446b7a2e7fb8e5a50fb69, role_id=29f86d307e104b0bbbcf69660a405cea)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:46.208105 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383557b-892d-4007-a17a-0550af7dead5 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:46.278682 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f40476-b5f1-4a92-af53-3f9b8f69a9f2 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:46.282996 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 86/179] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 1 03:42:45 2022] PUT /identity/v3/projects/c908bfb9e6e34f1589114650c691c8c1/users/dcb773acde5446b7a2e7fb8e5a50fb69/roles/29f86d307e104b0bbbcf69660a405cea => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 03:42:46.297797 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383557b-892d-4007-a17a-0550af7dead5 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:46.323370 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae9545d-a69a-4d3e-aa6a-bd56ffcb293b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:46.324234 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9545d-a69a-4d3e-aa6a-bd56ffcb293b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:46.324522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9545d-a69a-4d3e-aa6a-bd56ffcb293b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:46.324799 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9545d-a69a-4d3e-aa6a-bd56ffcb293b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:46.326073 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae9545d-a69a-4d3e-aa6a-bd56ffcb293b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:46.327626 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae9545d-a69a-4d3e-aa6a-bd56ffcb293b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:46.329352 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 94/180] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:42:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:46.330603 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e57dc2-f377-467e-a573-037f02746e9f None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:46.330886 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e57dc2-f377-467e-a573-037f02746e9f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:46.331163 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e57dc2-f377-467e-a573-037f02746e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:46.356403 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-f2e57dc2-f377-467e-a573-037f02746e9f None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:42:46.358543 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f2e57dc2-f377-467e-a573-037f02746e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:42:46.452419 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 95/181] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:42:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:42:46.453812 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e57dc2-f377-467e-a573-037f02746e9f None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:46.455893 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383557b-892d-4007-a17a-0550af7dead5 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:46.469632 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:46.509897 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba3f09-361f-4c8d-ae07-1f4f3c6f7d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:46.511416 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba3f09-361f-4c8d-ae07-1f4f3c6f7d44 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:46.511763 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba3f09-361f-4c8d-ae07-1f4f3c6f7d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:46.512007 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba3f09-361f-4c8d-ae07-1f4f3c6f7d44 None admin] PATH_INFO: `/v3/projects/c908bfb9e6e34f1589114650c691c8c1` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:46.513406 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba3f09-361f-4c8d-ae07-1f4f3c6f7d44 None admin] RBAC: Authorizing `identity:get_project(project_id=c908bfb9e6e34f1589114650c691c8c1)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:46.515418 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba3f09-361f-4c8d-ae07-1f4f3c6f7d44 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:46.521276 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 87/182] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:42:46 2022] GET /identity/v3/projects/c908bfb9e6e34f1589114650c691c8c1 => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:46.521276 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba3f09-361f-4c8d-ae07-1f4f3c6f7d44 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:46.530268 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:46.593255 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e57dc2-f377-467e-a573-037f02746e9f None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:46.642106 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba3f09-361f-4c8d-ae07-1f4f3c6f7d44 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:46.643194 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526771a7-acca-43d9-8bf6-ef47940e25f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:46.643955 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526771a7-acca-43d9-8bf6-ef47940e25f9 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:46.644438 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526771a7-acca-43d9-8bf6-ef47940e25f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:46.644582 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526771a7-acca-43d9-8bf6-ef47940e25f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:46.645278 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526771a7-acca-43d9-8bf6-ef47940e25f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:42:46.645774 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526771a7-acca-43d9-8bf6-ef47940e25f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:46.647202 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526771a7-acca-43d9-8bf6-ef47940e25f9 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:46.658308 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 96/183] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 1 03:42:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:46.665997 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526771a7-acca-43d9-8bf6-ef47940e25f9 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:46.699813 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bae359-8b09-4627-accb-429d362ad8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:46.700509 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bae359-8b09-4627-accb-429d362ad8bb None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:46.700785 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bae359-8b09-4627-accb-429d362ad8bb None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:46.701063 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bae359-8b09-4627-accb-429d362ad8bb None admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:46.701844 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bae359-8b09-4627-accb-429d362ad8bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:42:46.702153 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bae359-8b09-4627-accb-429d362ad8bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:46.703657 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bae359-8b09-4627-accb-429d362ad8bb None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:46.720058 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 88/184] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:42:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:46.720058 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bae359-8b09-4627-accb-429d362ad8bb None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:46.797218 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:46.835147 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:46.837713 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526771a7-acca-43d9-8bf6-ef47940e25f9 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:46.876648 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e0663-0519-4c62-86e6-fab28ba96765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:46.877344 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e0663-0519-4c62-86e6-fab28ba96765 None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:46.878083 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e0663-0519-4c62-86e6-fab28ba96765 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:46.878083 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e0663-0519-4c62-86e6-fab28ba96765 None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:46.878700 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e0663-0519-4c62-86e6-fab28ba96765 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:46.881270 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e0663-0519-4c62-86e6-fab28ba96765 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:46.895524 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bae359-8b09-4627-accb-429d362ad8bb None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:46.944977 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2f9e2-721a-4403-ac8f-40303e248eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:46.946224 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2f9e2-721a-4403-ac8f-40303e248eb0 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:46.946630 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2f9e2-721a-4403-ac8f-40303e248eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:46.946997 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2f9e2-721a-4403-ac8f-40303e248eb0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:46.959322 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e2f9e2-721a-4403-ac8f-40303e248eb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:42:46.967949 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-03e2f9e2-721a-4403-ac8f-40303e248eb0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 03:42:46.967949 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:42:46.967949 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:42:46.967949 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:42:46.967949 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:42:46.967949 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:42:46.967949 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:42:46.967949 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:42:46.967949 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:42:46.967949 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:42:46.967949 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:42:46.967949 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:42:46.967949 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:42:46.967949 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:42:46.967949 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:42:46.967949 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:42:46.968947 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:42:46.968947 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:42:46.968947 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:42:46.968947 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:42:46.968947 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:42:46.968947 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:42:46.968947 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:42:46.968947 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:42:46.968947 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:42:46.968947 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:42:46.968947 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:42:46.968947 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:42:46.968947 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:42:46.968947 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:42:46.968947 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:42:46.968947 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:42:46.974830 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:42:46.974830 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:42:46.974830 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:42:46.974830 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:42:46.974830 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:42:46.974830 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:42:46.974830 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:42:46.974830 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:42:46.974830 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:42:46.974830 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:42:46.974830 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 03:42:46.974830 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:42:46.974830 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 89/185] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Jul 1 03:42:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:42:46.974830 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2f9e2-721a-4403-ac8f-40303e248eb0 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:46.984912 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 97/186] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Jul 1 03:42:46 2022] POST /identity/v3/users => generated 297 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 03:42:46.986151 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e0663-0519-4c62-86e6-fab28ba96765 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:47.143924 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e0663-0519-4c62-86e6-fab28ba96765 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:47.144554 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2f9e2-721a-4403-ac8f-40303e248eb0 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:47.179574 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:47.183734 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:47.188862 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b968ae-5ccf-4462-8c66-c402433d4ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:47.189562 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b968ae-5ccf-4462-8c66-c402433d4ef0 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:47.189867 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b968ae-5ccf-4462-8c66-c402433d4ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:47.191394 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b968ae-5ccf-4462-8c66-c402433d4ef0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:47.191394 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b968ae-5ccf-4462-8c66-c402433d4ef0 None admin] RBAC: Adding query filter params (role.id=681755518698445fabd9a8accec13c0f, scope.project.id=c908bfb9e6e34f1589114650c691c8c1, user.id=25426a981a294fbbafc4d23f43e2ba63) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:42:47.191820 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b968ae-5ccf-4462-8c66-c402433d4ef0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:47.194019 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b968ae-5ccf-4462-8c66-c402433d4ef0 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:47.200637 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 90/187] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:42:46 2022] GET /identity/v3/role_assignments?user.id=25426a981a294fbbafc4d23f43e2ba63&scope.project.id=c908bfb9e6e34f1589114650c691c8c1&role.id=681755518698445fabd9a8accec13c0f => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:47.201479 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee38376-7fdb-467c-aec3-a1a025a328d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:47.201661 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b968ae-5ccf-4462-8c66-c402433d4ef0 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:47.204036 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee38376-7fdb-467c-aec3-a1a025a328d9 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:47.205004 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee38376-7fdb-467c-aec3-a1a025a328d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:47.205798 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee38376-7fdb-467c-aec3-a1a025a328d9 None admin] PATH_INFO: `/v3/users/ebf9d6d679ef4fc29f52a567ec264b4f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:47.208622 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee38376-7fdb-467c-aec3-a1a025a328d9 None admin] RBAC: Authorizing `identity:get_user(user_id=ebf9d6d679ef4fc29f52a567ec264b4f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:47.213283 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee38376-7fdb-467c-aec3-a1a025a328d9 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:47.222169 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 98/188] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:42:46 2022] GET /identity/v3/users/ebf9d6d679ef4fc29f52a567ec264b4f => generated 275 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:47.224903 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee38376-7fdb-467c-aec3-a1a025a328d9 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:47.386288 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b968ae-5ccf-4462-8c66-c402433d4ef0 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:47.404284 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee38376-7fdb-467c-aec3-a1a025a328d9 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:47.454961 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdafd111-96c6-43f7-ab07-cd0fff122846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:47.455214 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf204e-ed3b-4163-90cd-e6ae9652489b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:47.455589 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf204e-ed3b-4163-90cd-e6ae9652489b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:47.455858 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf204e-ed3b-4163-90cd-e6ae9652489b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:47.456133 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf204e-ed3b-4163-90cd-e6ae9652489b None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:47.456372 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafd111-96c6-43f7-ab07-cd0fff122846 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:47.456839 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafd111-96c6-43f7-ab07-cd0fff122846 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:47.456987 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf204e-ed3b-4163-90cd-e6ae9652489b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:42:47.457221 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf204e-ed3b-4163-90cd-e6ae9652489b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:47.457360 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafd111-96c6-43f7-ab07-cd0fff122846 None admin] PATH_INFO: `/v3/users/079fc35b3a954fb383f3778c6de22460` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:47.458767 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf204e-ed3b-4163-90cd-e6ae9652489b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:47.469117 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 99/189] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:42:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:47.474701 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf204e-ed3b-4163-90cd-e6ae9652489b None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:47.487506 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdafd111-96c6-43f7-ab07-cd0fff122846 None admin] RBAC: Authorizing `identity:get_user(user_id=079fc35b3a954fb383f3778c6de22460)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:47.489604 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdafd111-96c6-43f7-ab07-cd0fff122846 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:47.493199 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 91/190] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:42:47 2022] GET /identity/v3/users/079fc35b3a954fb383f3778c6de22460 => generated 283 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:47.494649 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdafd111-96c6-43f7-ab07-cd0fff122846 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:47.596856 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:47.628639 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:47.713987 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf204e-ed3b-4163-90cd-e6ae9652489b None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:47.729586 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdafd111-96c6-43f7-ab07-cd0fff122846 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:47.785252 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a894677-b604-416b-8f42-92b5603cd925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:47.786374 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a894677-b604-416b-8f42-92b5603cd925 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:47.786858 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a894677-b604-416b-8f42-92b5603cd925 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:47.787396 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a894677-b604-416b-8f42-92b5603cd925 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:47.789746 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac357b2e-be7e-40f6-abed-f54553fa3a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:47.791203 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac357b2e-be7e-40f6-abed-f54553fa3a5f None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:47.791735 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac357b2e-be7e-40f6-abed-f54553fa3a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:47.792557 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac357b2e-be7e-40f6-abed-f54553fa3a5f None admin] PATH_INFO: `/v3/users/079fc35b3a954fb383f3778c6de22460` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:47.794600 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac357b2e-be7e-40f6-abed-f54553fa3a5f None admin] RBAC: Authorizing `identity:get_user(user_id=079fc35b3a954fb383f3778c6de22460)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:47.798356 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac357b2e-be7e-40f6-abed-f54553fa3a5f None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:47.805950 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 92/191] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:42:47 2022] GET /identity/v3/users/079fc35b3a954fb383f3778c6de22460 => generated 283 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:47.805950 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac357b2e-be7e-40f6-abed-f54553fa3a5f None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:47.888344 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a894677-b604-416b-8f42-92b5603cd925 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:47.890539 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a894677-b604-416b-8f42-92b5603cd925 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:48.032382 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:48.083823 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac357b2e-be7e-40f6-abed-f54553fa3a5f None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:48.152789 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:48.156498 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 100/192] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:42:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 687 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 03:42:48.163487 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a894677-b604-416b-8f42-92b5603cd925 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:48.197472 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ddffdc-fddf-4a6e-b856-693dabc49228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:48.197745 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ddffdc-fddf-4a6e-b856-693dabc49228 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:48.197882 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ddffdc-fddf-4a6e-b856-693dabc49228 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:48.198297 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ddffdc-fddf-4a6e-b856-693dabc49228 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:48.302430 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ddffdc-fddf-4a6e-b856-693dabc49228 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:48.303862 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ddffdc-fddf-4a6e-b856-693dabc49228 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:48.370171 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a894677-b604-416b-8f42-92b5603cd925 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:48.430072 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 93/193] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:42:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 03:42:48.435598 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ddffdc-fddf-4a6e-b856-693dabc49228 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:48.452646 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17fda8-36f8-4b8f-9a74-1fcef6f47fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:48.454247 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17fda8-36f8-4b8f-9a74-1fcef6f47fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:48.455070 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17fda8-36f8-4b8f-9a74-1fcef6f47fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:48.455937 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17fda8-36f8-4b8f-9a74-1fcef6f47fa9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:48.456100 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:48.521595 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:48.558032 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ddffdc-fddf-4a6e-b856-693dabc49228 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:48.596128 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e014c91-e0e9-46ac-850d-dcbfc03dca68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:48.597019 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e014c91-e0e9-46ac-850d-dcbfc03dca68 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:48.597298 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e014c91-e0e9-46ac-850d-dcbfc03dca68 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:48.597570 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e014c91-e0e9-46ac-850d-dcbfc03dca68 None admin] PATH_INFO: `/v3/projects/7353df3204b3473281ba1740cbb4eaa5` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:48.598979 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e014c91-e0e9-46ac-850d-dcbfc03dca68 None admin] RBAC: Authorizing `identity:get_project(project_id=7353df3204b3473281ba1740cbb4eaa5)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:48.600614 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e014c91-e0e9-46ac-850d-dcbfc03dca68 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:48.602929 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17fda8-36f8-4b8f-9a74-1fcef6f47fa9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:48.603090 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 94/194] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:42:48 2022] GET /identity/v3/projects/7353df3204b3473281ba1740cbb4eaa5 => generated 312 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:48.603823 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e014c91-e0e9-46ac-850d-dcbfc03dca68 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:48.608765 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17fda8-36f8-4b8f-9a74-1fcef6f47fa9 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:48.770425 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 101/195] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:42:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 03:42:48.776167 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17fda8-36f8-4b8f-9a74-1fcef6f47fa9 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:48.777155 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:48.794713 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e014c91-e0e9-46ac-850d-dcbfc03dca68 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:48.838177 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2cc09a-5df2-43bb-8394-5ebc80e9c412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:48.840113 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2cc09a-5df2-43bb-8394-5ebc80e9c412 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:48.840887 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2cc09a-5df2-43bb-8394-5ebc80e9c412 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:48.841372 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2cc09a-5df2-43bb-8394-5ebc80e9c412 None admin] PATH_INFO: `/v3/projects/85b9c0c1c9a84ec8989ff665fc2b2a0d` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:48.843250 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2cc09a-5df2-43bb-8394-5ebc80e9c412 None admin] RBAC: Authorizing `identity:get_project(project_id=85b9c0c1c9a84ec8989ff665fc2b2a0d)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:48.846045 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2cc09a-5df2-43bb-8394-5ebc80e9c412 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:48.848131 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 95/196] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:42:48 2022] GET /identity/v3/projects/85b9c0c1c9a84ec8989ff665fc2b2a0d => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:48.849240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2cc09a-5df2-43bb-8394-5ebc80e9c412 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:48.878996 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:48.938633 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17fda8-36f8-4b8f-9a74-1fcef6f47fa9 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:48.980096 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2cc09a-5df2-43bb-8394-5ebc80e9c412 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:48.995264 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde594ed-d185-47b1-9c52-002d37c1f351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:48.996329 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde594ed-d185-47b1-9c52-002d37c1f351 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:48.997054 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde594ed-d185-47b1-9c52-002d37c1f351 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:48.998075 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde594ed-d185-47b1-9c52-002d37c1f351 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:48.999473 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde594ed-d185-47b1-9c52-002d37c1f351 None admin] RBAC: Adding query filter params (role.id=c0b595782ebc410db693ef7fa70522a3, scope.project.id=7353df3204b3473281ba1740cbb4eaa5, user.id=ebf9d6d679ef4fc29f52a567ec264b4f) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:42:49.000025 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde594ed-d185-47b1-9c52-002d37c1f351 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:49.002384 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde594ed-d185-47b1-9c52-002d37c1f351 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:49.013095 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 102/197] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:42:48 2022] GET /identity/v3/role_assignments?user.id=ebf9d6d679ef4fc29f52a567ec264b4f&scope.project.id=7353df3204b3473281ba1740cbb4eaa5&role.id=c0b595782ebc410db693ef7fa70522a3 => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:49.015619 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73d450-b711-4ec1-98e8-e9c561ed9e6c None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:49.016437 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73d450-b711-4ec1-98e8-e9c561ed9e6c None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:49.016938 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73d450-b711-4ec1-98e8-e9c561ed9e6c None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:49.018630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 103/198] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:42:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:42:49.023386 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddfbc54-a26b-4c1d-aee4-91986bab655e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:49.023386 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfbc54-a26b-4c1d-aee4-91986bab655e None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:49.023386 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfbc54-a26b-4c1d-aee4-91986bab655e None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:49.023386 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfbc54-a26b-4c1d-aee4-91986bab655e None admin] PATH_INFO: `/v3/projects/85b9c0c1c9a84ec8989ff665fc2b2a0d` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:49.023866 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddfbc54-a26b-4c1d-aee4-91986bab655e None admin] RBAC: Authorizing `identity:get_project(project_id=85b9c0c1c9a84ec8989ff665fc2b2a0d)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:49.025022 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73d450-b711-4ec1-98e8-e9c561ed9e6c None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:49.025667 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddfbc54-a26b-4c1d-aee4-91986bab655e None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:49.027874 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 96/199] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:42:48 2022] GET /identity/v3/projects/85b9c0c1c9a84ec8989ff665fc2b2a0d => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:49.041024 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddfbc54-a26b-4c1d-aee4-91986bab655e None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:49.094271 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:49.166051 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73d450-b711-4ec1-98e8-e9c561ed9e6c None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:49.196625 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:49.221704 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289dbe36-64dd-42b0-bc80-660c60981c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:49.222655 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289dbe36-64dd-42b0-bc80-660c60981c98 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:49.223084 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289dbe36-64dd-42b0-bc80-660c60981c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:49.223536 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289dbe36-64dd-42b0-bc80-660c60981c98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:49.224544 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289dbe36-64dd-42b0-bc80-660c60981c98 None admin] RBAC: Adding query filter params (role.id=681755518698445fabd9a8accec13c0f, scope.project.id=85b9c0c1c9a84ec8989ff665fc2b2a0d, user.id=079fc35b3a954fb383f3778c6de22460) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:42:49.225033 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289dbe36-64dd-42b0-bc80-660c60981c98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:49.226680 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289dbe36-64dd-42b0-bc80-660c60981c98 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:49.233789 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 104/200] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:42:49 2022] GET /identity/v3/role_assignments?user.id=079fc35b3a954fb383f3778c6de22460&scope.project.id=85b9c0c1c9a84ec8989ff665fc2b2a0d&role.id=681755518698445fabd9a8accec13c0f => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:49.239973 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988904b-558d-40c4-bbcb-aa6a9a1bb371 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:49.243995 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988904b-558d-40c4-bbcb-aa6a9a1bb371 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:49.244544 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988904b-558d-40c4-bbcb-aa6a9a1bb371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:49.267489 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddfbc54-a26b-4c1d-aee4-91986bab655e None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:49.275800 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-2988904b-558d-40c4-bbcb-aa6a9a1bb371 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:42:49.277305 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2988904b-558d-40c4-bbcb-aa6a9a1bb371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:42:49.326085 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d859d2-a790-4892-9db2-2de0738dbc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:49.326768 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d859d2-a790-4892-9db2-2de0738dbc3b None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:49.327045 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d859d2-a790-4892-9db2-2de0738dbc3b None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:49.327314 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d859d2-a790-4892-9db2-2de0738dbc3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:49.328210 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d859d2-a790-4892-9db2-2de0738dbc3b None admin] RBAC: Adding query filter params (role.id=132287c7d1f9428d9195f2b4ed60756b, scope.project.id=85b9c0c1c9a84ec8989ff665fc2b2a0d, user.id=079fc35b3a954fb383f3778c6de22460) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:42:49.328525 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d859d2-a790-4892-9db2-2de0738dbc3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:49.330014 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d859d2-a790-4892-9db2-2de0738dbc3b None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:49.338927 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 97/201] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:42:49 2022] GET /identity/v3/role_assignments?user.id=079fc35b3a954fb383f3778c6de22460&scope.project.id=85b9c0c1c9a84ec8989ff665fc2b2a0d&role.id=132287c7d1f9428d9195f2b4ed60756b => generated 259 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:49.421147 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 105/202] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:42:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:42:49.487938 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d859d2-a790-4892-9db2-2de0738dbc3b None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:49.607744 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:49.625785 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d859d2-a790-4892-9db2-2de0738dbc3b None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:49.663403 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6619e-2a23-49c3-805e-6995110e5cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:49.664251 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6619e-2a23-49c3-805e-6995110e5cda None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:49.664533 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6619e-2a23-49c3-805e-6995110e5cda None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:49.664853 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6619e-2a23-49c3-805e-6995110e5cda None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:49.684788 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a6619e-2a23-49c3-805e-6995110e5cda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:42:49.692951 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-61a6619e-2a23-49c3-805e-6995110e5cda None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 03:42:49.692951 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:42:49.692951 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:42:49.692951 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:42:49.692951 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:42:49.692951 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:42:49.692951 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:42:49.692951 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:42:49.692951 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:42:49.692951 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:42:49.692951 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:42:49.692951 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:42:49.692951 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:42:49.692951 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:42:49.692951 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:42:49.692951 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:42:49.694227 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:42:49.694227 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:42:49.694227 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:42:49.694227 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:42:49.694227 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:42:49.694227 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:42:49.694227 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:42:49.694227 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:42:49.694227 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:42:49.694227 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:42:49.694227 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:42:49.694227 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:42:49.694227 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:42:49.694227 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:42:49.694227 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:42:49.694227 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:42:49.695001 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:42:49.695001 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:42:49.695001 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:42:49.695001 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:42:49.695001 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:42:49.695001 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:42:49.695001 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:42:49.695001 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:42:49.695001 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:42:49.695001 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:42:49.695001 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 03:42:49.695001 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:42:49.699615 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 98/203] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:42:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:42:49.703830 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988904b-558d-40c4-bbcb-aa6a9a1bb371 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:49.866126 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988904b-558d-40c4-bbcb-aa6a9a1bb371 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:49.886217 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:49.907373 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168d42a-d9fa-40c9-852b-3d2d963f2b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:49.908095 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168d42a-d9fa-40c9-852b-3d2d963f2b51 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:49.908454 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168d42a-d9fa-40c9-852b-3d2d963f2b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:49.908739 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168d42a-d9fa-40c9-852b-3d2d963f2b51 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:49.909518 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1168d42a-d9fa-40c9-852b-3d2d963f2b51 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:42:49.909833 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1168d42a-d9fa-40c9-852b-3d2d963f2b51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:49.911298 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1168d42a-d9fa-40c9-852b-3d2d963f2b51 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:49.922148 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 106/204] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 1 03:42:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:49.930198 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6619e-2a23-49c3-805e-6995110e5cda None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:50.097516 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6619e-2a23-49c3-805e-6995110e5cda None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:50.147545 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba958e-e296-4c5a-8914-f7bbe7a6adfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:50.148449 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba958e-e296-4c5a-8914-f7bbe7a6adfc None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:50.148728 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba958e-e296-4c5a-8914-f7bbe7a6adfc None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:50.149041 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba958e-e296-4c5a-8914-f7bbe7a6adfc None admin] PATH_INFO: `/v3/users/dcb773acde5446b7a2e7fb8e5a50fb69` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:50.150321 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba958e-e296-4c5a-8914-f7bbe7a6adfc None admin] RBAC: Authorizing `identity:get_user(user_id=dcb773acde5446b7a2e7fb8e5a50fb69)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:50.151808 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba958e-e296-4c5a-8914-f7bbe7a6adfc None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:50.153843 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 99/205] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:42:49 2022] GET /identity/v3/users/dcb773acde5446b7a2e7fb8e5a50fb69 => generated 289 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:50.171062 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168d42a-d9fa-40c9-852b-3d2d963f2b51 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:50.248054 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cebeb5-8bda-4354-a6a0-b9bfc9aa7af1 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:50.248054 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cebeb5-8bda-4354-a6a0-b9bfc9aa7af1 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:50.248054 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cebeb5-8bda-4354-a6a0-b9bfc9aa7af1 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:50.248054 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 100/206] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:42:50.262492 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0da3ad-5cca-4e83-abfd-66f5381dbfda None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:50.262951 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0da3ad-5cca-4e83-abfd-66f5381dbfda None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:50.263384 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0da3ad-5cca-4e83-abfd-66f5381dbfda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:50.314730 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-5b0da3ad-5cca-4e83-abfd-66f5381dbfda None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:42:50.316826 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-5b0da3ad-5cca-4e83-abfd-66f5381dbfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:42:50.358363 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:50.374235 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168d42a-d9fa-40c9-852b-3d2d963f2b51 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:50.471694 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce0ab4-e8bd-427f-a743-f502362e98fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:50.472371 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce0ab4-e8bd-427f-a743-f502362e98fa None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:50.472658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce0ab4-e8bd-427f-a743-f502362e98fa None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:50.472941 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce0ab4-e8bd-427f-a743-f502362e98fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:50.504163 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 101/207] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:42:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 03:42:50.549036 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:50.551314 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0da3ad-5cca-4e83-abfd-66f5381dbfda None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:50.611335 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce0ab4-e8bd-427f-a743-f502362e98fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:50.612808 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce0ab4-e8bd-427f-a743-f502362e98fa None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:50.788595 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0da3ad-5cca-4e83-abfd-66f5381dbfda None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:50.814470 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 107/208] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:42:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 644 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 03:42:50.823845 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce0ab4-e8bd-427f-a743-f502362e98fa None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:50.900868 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216eb468-44e6-4f85-9d1e-a57aa80f8284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:50.902134 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216eb468-44e6-4f85-9d1e-a57aa80f8284 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:50.902616 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216eb468-44e6-4f85-9d1e-a57aa80f8284 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:50.903065 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216eb468-44e6-4f85-9d1e-a57aa80f8284 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:50.956975 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216eb468-44e6-4f85-9d1e-a57aa80f8284 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:42:50.980856 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-216eb468-44e6-4f85-9d1e-a57aa80f8284 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 03:42:50.980856 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:42:50.980856 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:42:50.980856 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:42:50.980856 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:42:50.980856 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:42:50.980856 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:42:50.980856 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:42:50.980856 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:42:50.980856 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:42:50.980856 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:42:50.980856 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:42:50.980856 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:42:50.980856 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:42:50.980856 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:42:50.980856 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:42:50.981791 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:42:50.981791 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:42:50.981791 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:42:50.981791 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:42:50.981791 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:42:50.981791 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:42:50.981791 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:42:50.981791 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:42:50.981791 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:42:50.981791 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:42:50.981791 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:42:50.981791 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:42:50.981791 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:42:50.981791 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:42:50.981791 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:42:50.981791 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:42:50.982569 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:42:50.982569 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:42:50.982569 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:42:50.982569 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:42:50.982569 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:42:50.982569 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:42:50.982569 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:42:50.982569 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:42:50.982569 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:42:50.982569 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:42:50.982569 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 03:42:50.982569 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:42:50.992080 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 102/209] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:42:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 441 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 03:42:50.998099 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216eb468-44e6-4f85-9d1e-a57aa80f8284 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:51.027849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:51.043162 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:51.050020 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce0ab4-e8bd-427f-a743-f502362e98fa None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:51.156358 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ee7a7-89f8-4972-9daf-7efd3cae9f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:51.157172 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ee7a7-89f8-4972-9daf-7efd3cae9f80 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:51.157462 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ee7a7-89f8-4972-9daf-7efd3cae9f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:51.157746 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ee7a7-89f8-4972-9daf-7efd3cae9f80 None admin] PATH_INFO: `/v3/projects/c908bfb9e6e34f1589114650c691c8c1` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:51.159094 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ee7a7-89f8-4972-9daf-7efd3cae9f80 None admin] RBAC: Authorizing `identity:get_project(project_id=c908bfb9e6e34f1589114650c691c8c1)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:51.160625 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ee7a7-89f8-4972-9daf-7efd3cae9f80 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:51.162616 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 108/210] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:42:50 2022] GET /identity/v3/projects/c908bfb9e6e34f1589114650c691c8c1 => generated 298 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:51.189677 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ee7a7-89f8-4972-9daf-7efd3cae9f80 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:51.240154 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216eb468-44e6-4f85-9d1e-a57aa80f8284 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:51.307696 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b8f38e-f16d-41a0-b99a-77c2713f3c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:51.308867 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8f38e-f16d-41a0-b99a-77c2713f3c35 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:51.309450 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8f38e-f16d-41a0-b99a-77c2713f3c35 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:51.309949 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8f38e-f16d-41a0-b99a-77c2713f3c35 None admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:51.311382 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b8f38e-f16d-41a0-b99a-77c2713f3c35 None admin] RBAC: Adding query filter params (name=member) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:42:51.312009 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b8f38e-f16d-41a0-b99a-77c2713f3c35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:51.314652 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b8f38e-f16d-41a0-b99a-77c2713f3c35 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:51.332341 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 103/211] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 1 03:42:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:51.334965 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca81fe-5714-4339-9c14-cffb5e0ad41a None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:51.335497 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca81fe-5714-4339-9c14-cffb5e0ad41a None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:51.336061 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca81fe-5714-4339-9c14-cffb5e0ad41a None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:51.346473 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 104/212] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:42:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:42:51.348166 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca81fe-5714-4339-9c14-cffb5e0ad41a None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:51.348904 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ee7a7-89f8-4972-9daf-7efd3cae9f80 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:51.388236 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce4e84-d52c-406f-b756-45d92b2f8f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:51.388912 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce4e84-d52c-406f-b756-45d92b2f8f84 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:51.389197 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce4e84-d52c-406f-b756-45d92b2f8f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:51.389482 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce4e84-d52c-406f-b756-45d92b2f8f84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:51.390332 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce4e84-d52c-406f-b756-45d92b2f8f84 None admin] RBAC: Adding query filter params (role.id=29f86d307e104b0bbbcf69660a405cea, scope.project.id=c908bfb9e6e34f1589114650c691c8c1, user.id=dcb773acde5446b7a2e7fb8e5a50fb69) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:42:51.390651 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce4e84-d52c-406f-b756-45d92b2f8f84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:51.392191 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce4e84-d52c-406f-b756-45d92b2f8f84 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:51.399849 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 109/213] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:42:51 2022] GET /identity/v3/role_assignments?user.id=dcb773acde5446b7a2e7fb8e5a50fb69&scope.project.id=c908bfb9e6e34f1589114650c691c8c1&role.id=29f86d307e104b0bbbcf69660a405cea => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:51.401251 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffac6de-8230-436d-a5c4-5db467917e2f None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:51.401545 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffac6de-8230-436d-a5c4-5db467917e2f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:51.401823 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffac6de-8230-436d-a5c4-5db467917e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:51.419990 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-7ffac6de-8230-436d-a5c4-5db467917e2f None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:42:51.421131 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-7ffac6de-8230-436d-a5c4-5db467917e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:42:51.424393 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:51.486601 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:51.501072 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 110/214] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:42:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:42:51.582821 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca81fe-5714-4339-9c14-cffb5e0ad41a None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:51.608711 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffac6de-8230-436d-a5c4-5db467917e2f None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:51.651753 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149d31b-db11-48cf-9912-252b3a2996de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:51.653263 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149d31b-db11-48cf-9912-252b3a2996de None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:51.653748 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149d31b-db11-48cf-9912-252b3a2996de None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:51.654238 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149d31b-db11-48cf-9912-252b3a2996de None admin] PATH_INFO: `/v3/users/9e9a221b71894f489e54a17b0b643fda` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:51.681429 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149d31b-db11-48cf-9912-252b3a2996de None admin] RBAC: Authorizing `identity:get_user(user_id=9e9a221b71894f489e54a17b0b643fda)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:51.684125 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149d31b-db11-48cf-9912-252b3a2996de None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:51.687643 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 105/215] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:42:51 2022] GET /identity/v3/users/9e9a221b71894f489e54a17b0b643fda => generated 297 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:51.697110 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149d31b-db11-48cf-9912-252b3a2996de None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:51.857977 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffac6de-8230-436d-a5c4-5db467917e2f None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:51.918317 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149d31b-db11-48cf-9912-252b3a2996de None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:51.929227 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7b11e3-f30a-4a52-824b-7fe8393d68f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:51.931639 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b11e3-f30a-4a52-824b-7fe8393d68f3 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:51.932399 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b11e3-f30a-4a52-824b-7fe8393d68f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:51.933103 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b11e3-f30a-4a52-824b-7fe8393d68f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:51.942470 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7b11e3-f30a-4a52-824b-7fe8393d68f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:51.947069 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7b11e3-f30a-4a52-824b-7fe8393d68f3 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:51.951932 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 111/216] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:42:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:42:51.959696 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7b11e3-f30a-4a52-824b-7fe8393d68f3 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:51.979057 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:51.982638 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:52.000666 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c803fd-bc98-4212-acad-384cc19554fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:52.002195 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c803fd-bc98-4212-acad-384cc19554fa None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:52.002911 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c803fd-bc98-4212-acad-384cc19554fa None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:52.003646 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c803fd-bc98-4212-acad-384cc19554fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:52.149541 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c803fd-bc98-4212-acad-384cc19554fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:52.149995 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7b11e3-f30a-4a52-824b-7fe8393d68f3 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:52.153293 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c803fd-bc98-4212-acad-384cc19554fa None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:52.215884 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a9da1-aece-428d-8404-f153e0befa9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:52.216806 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a9da1-aece-428d-8404-f153e0befa9c None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:52.217173 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a9da1-aece-428d-8404-f153e0befa9c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:52.217633 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a9da1-aece-428d-8404-f153e0befa9c None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:52.218882 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68a9da1-aece-428d-8404-f153e0befa9c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:52.221664 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68a9da1-aece-428d-8404-f153e0befa9c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:52.311216 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 106/217] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:42:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 03:42:52.313669 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed89195-bf9d-4ed2-b065-02237680659b None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:52.314157 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed89195-bf9d-4ed2-b065-02237680659b None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:52.314644 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed89195-bf9d-4ed2-b065-02237680659b None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:52.319521 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 107/218] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:42:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:42:52.319521 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed89195-bf9d-4ed2-b065-02237680659b None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:52.352512 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 112/219] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Jul 1 03:42:51 2022] POST /identity/v3/users => generated 297 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 03:42:52.354112 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50f768-60aa-40cf-82d5-16ae030a925d None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:52.354392 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50f768-60aa-40cf-82d5-16ae030a925d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:52.354670 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50f768-60aa-40cf-82d5-16ae030a925d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:52.357444 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:52.401702 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-7a50f768-60aa-40cf-82d5-16ae030a925d None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:42:52.403840 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-7a50f768-60aa-40cf-82d5-16ae030a925d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:42:52.477731 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed89195-bf9d-4ed2-b065-02237680659b None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:52.520216 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:52.537237 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 113/220] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:42:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:42:52.539655 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1540fc-c82d-4fb5-8c02-63428ec5caed None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:52.540436 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1540fc-c82d-4fb5-8c02-63428ec5caed None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:52.540928 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1540fc-c82d-4fb5-8c02-63428ec5caed None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:52.543638 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 114/221] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:42:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:42:52.552385 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f5c07-193b-4412-b813-4c363b30be84 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:52.552994 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f5c07-193b-4412-b813-4c363b30be84 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:52.553896 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f5c07-193b-4412-b813-4c363b30be84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:52.559762 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383d13f-461f-4e13-8b02-6101f337ce63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:52.561163 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383d13f-461f-4e13-8b02-6101f337ce63 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:52.561622 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383d13f-461f-4e13-8b02-6101f337ce63 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:52.562071 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383d13f-461f-4e13-8b02-6101f337ce63 None admin] PATH_INFO: `/v3/projects/85b9c0c1c9a84ec8989ff665fc2b2a0d` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:52.564224 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a383d13f-461f-4e13-8b02-6101f337ce63 None admin] RBAC: Authorizing `identity:get_project(project_id=85b9c0c1c9a84ec8989ff665fc2b2a0d)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:52.566476 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a383d13f-461f-4e13-8b02-6101f337ce63 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:52.569013 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 108/222] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:42:52 2022] GET /identity/v3/projects/85b9c0c1c9a84ec8989ff665fc2b2a0d => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:52.569892 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383d13f-461f-4e13-8b02-6101f337ce63 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:52.588206 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-f59f5c07-193b-4412-b813-4c363b30be84 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:42:52.589428 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f59f5c07-193b-4412-b813-4c363b30be84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:42:52.730498 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 115/223] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:42:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:42:52.731944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f5c07-193b-4412-b813-4c363b30be84 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:52.747921 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:52.767732 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383d13f-461f-4e13-8b02-6101f337ce63 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:52.837202 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f836e-9dcb-4c72-b6f0-384767331bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:52.838582 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f836e-9dcb-4c72-b6f0-384767331bba None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:52.839072 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f836e-9dcb-4c72-b6f0-384767331bba None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:52.839602 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f836e-9dcb-4c72-b6f0-384767331bba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:52.859821 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f836e-9dcb-4c72-b6f0-384767331bba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:42:52.877370 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-945f836e-9dcb-4c72-b6f0-384767331bba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 03:42:52.877370 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:42:52.877370 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:42:52.877370 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:42:52.877370 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:42:52.877370 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:42:52.877370 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:42:52.877370 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:42:52.877370 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:42:52.877370 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:42:52.877370 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:42:52.877370 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:42:52.877370 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:42:52.877370 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:42:52.877370 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:42:52.877370 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:42:52.879375 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:42:52.879375 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:42:52.879375 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:42:52.879375 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:42:52.879375 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:42:52.879375 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:42:52.879375 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:42:52.879375 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:42:52.879375 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:42:52.879375 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:42:52.879375 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:42:52.879375 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:42:52.879375 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:42:52.879375 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:42:52.879375 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:42:52.879375 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:42:52.881261 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:42:52.881261 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:42:52.881261 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:42:52.881261 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:42:52.881261 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:42:52.881261 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:42:52.881261 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:42:52.881261 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:42:52.881261 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:42:52.881261 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:42:52.881261 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 03:42:52.881261 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:42:52.883018 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 109/224] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Jul 1 03:42:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:42:52.887606 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f836e-9dcb-4c72-b6f0-384767331bba None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:52.920890 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f5c07-193b-4412-b813-4c363b30be84 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:52.984152 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:53.008200 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44969f-b1d1-468f-827c-8aba13b7c679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:53.009310 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44969f-b1d1-468f-827c-8aba13b7c679 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:53.010019 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44969f-b1d1-468f-827c-8aba13b7c679 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:53.010511 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44969f-b1d1-468f-827c-8aba13b7c679 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:53.013580 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44969f-b1d1-468f-827c-8aba13b7c679 None admin] RBAC: Adding query filter params (role.id=c0b595782ebc410db693ef7fa70522a3, scope.project.id=85b9c0c1c9a84ec8989ff665fc2b2a0d, user.id=9e9a221b71894f489e54a17b0b643fda) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:42:53.014481 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44969f-b1d1-468f-827c-8aba13b7c679 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:53.018416 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44969f-b1d1-468f-827c-8aba13b7c679 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:53.031549 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 116/225] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:42:52 2022] GET /identity/v3/role_assignments?user.id=9e9a221b71894f489e54a17b0b643fda&scope.project.id=85b9c0c1c9a84ec8989ff665fc2b2a0d&role.id=c0b595782ebc410db693ef7fa70522a3 => generated 259 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:53.034386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44969f-b1d1-468f-827c-8aba13b7c679 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:53.093717 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f836e-9dcb-4c72-b6f0-384767331bba None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:53.174099 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c30720-92c1-4f67-b3a3-97661f0036bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:53.175517 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c30720-92c1-4f67-b3a3-97661f0036bf None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:53.176014 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c30720-92c1-4f67-b3a3-97661f0036bf None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:53.176505 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c30720-92c1-4f67-b3a3-97661f0036bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:53.222294 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c30720-92c1-4f67-b3a3-97661f0036bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:42:53.250436 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-15c30720-92c1-4f67-b3a3-97661f0036bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:42:53.250436 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:42:53.250436 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:42:53.250436 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:42:53.250436 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:42:53.250436 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:42:53.250436 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:42:53.250436 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:42:53.250436 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:42:53.250436 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:42:53.250436 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:42:53.250436 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:42:53.250436 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:42:53.250436 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:42:53.250436 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:42:53.250436 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:42:53.253750 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:42:53.253750 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:42:53.253750 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:42:53.253750 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:42:53.253750 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:42:53.253750 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:42:53.253750 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:42:53.253750 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:42:53.253750 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:42:53.253750 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:42:53.253750 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:42:53.253750 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:42:53.253750 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:42:53.253750 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:42:53.253750 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:42:53.253750 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:42:53.256874 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:42:53.256874 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:42:53.256874 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:42:53.256874 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:42:53.256874 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:42:53.256874 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:42:53.256874 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:42:53.256874 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:42:53.256874 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:42:53.256874 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:42:53.256874 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:42:53.256874 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:42:53.256874 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 110/226] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 1 03:42:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:42:53.267705 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c30720-92c1-4f67-b3a3-97661f0036bf None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:53.319685 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:53.333516 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44969f-b1d1-468f-827c-8aba13b7c679 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:53.454638 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01ea27-c058-4898-9686-26f03c8f74ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:53.456503 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01ea27-c058-4898-9686-26f03c8f74ea None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:53.456927 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01ea27-c058-4898-9686-26f03c8f74ea None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:53.457335 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01ea27-c058-4898-9686-26f03c8f74ea None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:53.458533 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01ea27-c058-4898-9686-26f03c8f74ea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:42:53.459003 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01ea27-c058-4898-9686-26f03c8f74ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:53.463655 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01ea27-c058-4898-9686-26f03c8f74ea None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:53.485884 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 117/227] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:42:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 454 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:53.494772 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01ea27-c058-4898-9686-26f03c8f74ea None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:53.536267 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c30720-92c1-4f67-b3a3-97661f0036bf None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:53.611007 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:53.626803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d912ea-d736-4d6e-a9b8-b2d3adac108e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:53.627517 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d912ea-d736-4d6e-a9b8-b2d3adac108e None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:53.627801 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d912ea-d736-4d6e-a9b8-b2d3adac108e None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:53.628330 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d912ea-d736-4d6e-a9b8-b2d3adac108e None admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:53.628870 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d912ea-d736-4d6e-a9b8-b2d3adac108e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:42:53.629179 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d912ea-d736-4d6e-a9b8-b2d3adac108e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:53.630757 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d912ea-d736-4d6e-a9b8-b2d3adac108e None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:53.641611 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 111/228] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:42:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:53.647191 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d912ea-d736-4d6e-a9b8-b2d3adac108e None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:53.750445 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01ea27-c058-4898-9686-26f03c8f74ea None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:53.780827 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:53.858387 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d912ea-d736-4d6e-a9b8-b2d3adac108e None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:53.870115 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3702fb-9844-49f5-b89f-23c32be7eee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:53.871069 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3702fb-9844-49f5-b89f-23c32be7eee7 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:53.872190 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3702fb-9844-49f5-b89f-23c32be7eee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:53.872479 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3702fb-9844-49f5-b89f-23c32be7eee7 None admin] PATH_INFO: `/v3/users/079fc35b3a954fb383f3778c6de22460` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:53.876771 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3702fb-9844-49f5-b89f-23c32be7eee7 None admin] RBAC: Authorizing `identity:get_user(user_id=079fc35b3a954fb383f3778c6de22460)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:53.878885 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3702fb-9844-49f5-b89f-23c32be7eee7 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:53.881304 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 118/229] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:42:53 2022] GET /identity/v3/users/079fc35b3a954fb383f3778c6de22460 => generated 283 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:53.888532 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3702fb-9844-49f5-b89f-23c32be7eee7 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:53.953179 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a0eec-ec5d-4724-ba04-ac3fd6e0285a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:53.954096 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a0eec-ec5d-4724-ba04-ac3fd6e0285a None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:53.954373 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a0eec-ec5d-4724-ba04-ac3fd6e0285a None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:53.954647 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a0eec-ec5d-4724-ba04-ac3fd6e0285a None admin] PATH_INFO: `/v3/users/079fc35b3a954fb383f3778c6de22460` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:53.960413 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a0eec-ec5d-4724-ba04-ac3fd6e0285a None admin] RBAC: Authorizing `identity:get_user(user_id=079fc35b3a954fb383f3778c6de22460)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:53.962587 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a0eec-ec5d-4724-ba04-ac3fd6e0285a None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:53.965375 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 112/230] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:42:53 2022] GET /identity/v3/users/079fc35b3a954fb383f3778c6de22460 => generated 283 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:53.971510 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a0eec-ec5d-4724-ba04-ac3fd6e0285a None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:54.087217 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3702fb-9844-49f5-b89f-23c32be7eee7 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:54.132018 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:54.160616 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a0eec-ec5d-4724-ba04-ac3fd6e0285a None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:54.184163 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf4a3f-7cf4-48a1-af2e-e5c0f40640e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:54.186127 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf4a3f-7cf4-48a1-af2e-e5c0f40640e9 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:54.188411 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf4a3f-7cf4-48a1-af2e-e5c0f40640e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:54.189300 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf4a3f-7cf4-48a1-af2e-e5c0f40640e9 None admin] PATH_INFO: `/v3/projects/85b9c0c1c9a84ec8989ff665fc2b2a0d` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:54.193258 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf4a3f-7cf4-48a1-af2e-e5c0f40640e9 None admin] RBAC: Authorizing `identity:get_project(project_id=85b9c0c1c9a84ec8989ff665fc2b2a0d)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:54.199360 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf4a3f-7cf4-48a1-af2e-e5c0f40640e9 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:54.205742 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 119/231] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:42:53 2022] GET /identity/v3/projects/85b9c0c1c9a84ec8989ff665fc2b2a0d => generated 302 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:42:54.211358 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf4a3f-7cf4-48a1-af2e-e5c0f40640e9 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:54.236304 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf599bb-0b96-419d-8d68-36b8a4846671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:54.238311 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf599bb-0b96-419d-8d68-36b8a4846671 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:54.239167 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf599bb-0b96-419d-8d68-36b8a4846671 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:54.242265 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf599bb-0b96-419d-8d68-36b8a4846671 None admin] PATH_INFO: `/v3/projects/85b9c0c1c9a84ec8989ff665fc2b2a0d` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:54.245671 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf599bb-0b96-419d-8d68-36b8a4846671 None admin] RBAC: Authorizing `identity:get_project(project_id=85b9c0c1c9a84ec8989ff665fc2b2a0d)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:54.250811 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf599bb-0b96-419d-8d68-36b8a4846671 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:54.259787 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 113/232] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:42:53 2022] GET /identity/v3/projects/85b9c0c1c9a84ec8989ff665fc2b2a0d => generated 302 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:42:54.267224 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf599bb-0b96-419d-8d68-36b8a4846671 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:54.315832 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:54.566522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf4a3f-7cf4-48a1-af2e-e5c0f40640e9 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:54.590574 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf599bb-0b96-419d-8d68-36b8a4846671 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:54.628428 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00767aa7-921b-419b-9f31-ed3c320c42f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:54.629727 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00767aa7-921b-419b-9f31-ed3c320c42f3 None admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:54.630209 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00767aa7-921b-419b-9f31-ed3c320c42f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:54.630828 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00767aa7-921b-419b-9f31-ed3c320c42f3 None admin] PATH_INFO: `/v3/projects/85b9c0c1c9a84ec8989ff665fc2b2a0d/users/079fc35b3a954fb383f3778c6de22460/roles/132287c7d1f9428d9195f2b4ed60756b` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:54.634044 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00767aa7-921b-419b-9f31-ed3c320c42f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=85b9c0c1c9a84ec8989ff665fc2b2a0d, user_id=079fc35b3a954fb383f3778c6de22460, role_id=132287c7d1f9428d9195f2b4ed60756b)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:54.635953 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00767aa7-921b-419b-9f31-ed3c320c42f3 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:54.660474 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7805b-5d34-4175-b67c-0eab1237a0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:54.661837 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7805b-5d34-4175-b67c-0eab1237a0d5 None admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:54.662318 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7805b-5d34-4175-b67c-0eab1237a0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:54.662787 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7805b-5d34-4175-b67c-0eab1237a0d5 None admin] PATH_INFO: `/v3/projects/85b9c0c1c9a84ec8989ff665fc2b2a0d/users/079fc35b3a954fb383f3778c6de22460/roles/681755518698445fabd9a8accec13c0f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:54.666094 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe7805b-5d34-4175-b67c-0eab1237a0d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=85b9c0c1c9a84ec8989ff665fc2b2a0d, user_id=079fc35b3a954fb383f3778c6de22460, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:54.667932 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe7805b-5d34-4175-b67c-0eab1237a0d5 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:54.758906 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 120/233] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 1 03:42:54 2022] PUT /identity/v3/projects/85b9c0c1c9a84ec8989ff665fc2b2a0d/users/079fc35b3a954fb383f3778c6de22460/roles/132287c7d1f9428d9195f2b4ed60756b => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 03:42:54.796398 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 114/234] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 1 03:42:54 2022] PUT /identity/v3/projects/85b9c0c1c9a84ec8989ff665fc2b2a0d/users/079fc35b3a954fb383f3778c6de22460/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 03:42:55.506609 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf7fd3-d0ed-4038-a2d1-c98f20846f64 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:55.507742 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf7fd3-d0ed-4038-a2d1-c98f20846f64 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:55.508589 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf7fd3-d0ed-4038-a2d1-c98f20846f64 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:55.512033 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 121/235] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:42:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:42:55.520450 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64250b-3592-4f45-b4e2-5208345ad7ef None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:55.520949 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64250b-3592-4f45-b4e2-5208345ad7ef None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:55.521439 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64250b-3592-4f45-b4e2-5208345ad7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:55.561382 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-3d64250b-3592-4f45-b4e2-5208345ad7ef None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:42:55.563411 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-3d64250b-3592-4f45-b4e2-5208345ad7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:42:55.656244 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2a84c-e21e-4a7a-9695-6cb3b0014dc4 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:55.657024 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2a84c-e21e-4a7a-9695-6cb3b0014dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:55.657383 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2a84c-e21e-4a7a-9695-6cb3b0014dc4 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:55.665272 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:55.668414 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 122/236] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:42:55 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:42:55.670966 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 115/237] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:42:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 03:42:55.678103 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd320966-5bcf-4f60-85cc-391e863cd6bc None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:55.678583 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd320966-5bcf-4f60-85cc-391e863cd6bc None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:55.679051 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd320966-5bcf-4f60-85cc-391e863cd6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:55.696513 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64250b-3592-4f45-b4e2-5208345ad7ef None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:55.729489 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-dd320966-5bcf-4f60-85cc-391e863cd6bc None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:42:55.731656 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-dd320966-5bcf-4f60-85cc-391e863cd6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:42:55.815253 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64250b-3592-4f45-b4e2-5208345ad7ef None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:55.854793 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8226e9-50fc-43eb-9c74-c065c9a185f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:55.855929 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8226e9-50fc-43eb-9c74-c065c9a185f6 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:55.856361 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8226e9-50fc-43eb-9c74-c065c9a185f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:55.856854 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8226e9-50fc-43eb-9c74-c065c9a185f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:55.858288 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8226e9-50fc-43eb-9c74-c065c9a185f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:55.859960 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8226e9-50fc-43eb-9c74-c065c9a185f6 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:55.861857 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 116/238] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:42:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:42:55.867691 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8226e9-50fc-43eb-9c74-c065c9a185f6 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:55.892165 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:55.948010 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:55.981675 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8226e9-50fc-43eb-9c74-c065c9a185f6 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:55.997924 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 123/239] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:42:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:42:56.020365 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa431286-fe7a-46d0-a08e-8d0942f66b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:56.021058 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa431286-fe7a-46d0-a08e-8d0942f66b93 None admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:56.021340 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa431286-fe7a-46d0-a08e-8d0942f66b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:56.021618 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa431286-fe7a-46d0-a08e-8d0942f66b93 None admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:56.022371 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa431286-fe7a-46d0-a08e-8d0942f66b93 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:56.023966 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa431286-fe7a-46d0-a08e-8d0942f66b93 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:56.052049 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd320966-5bcf-4f60-85cc-391e863cd6bc None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:56.126071 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 117/240] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Jul 1 03:42:55 2022] POST /identity/v3/users => generated 293 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 03:42:56.242511 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55a85f-01a4-4b8b-9209-3528c485819b None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:56.242758 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55a85f-01a4-4b8b-9209-3528c485819b None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:56.243070 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55a85f-01a4-4b8b-9209-3528c485819b None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:56.245091 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 118/241] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:42:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:42:56.253922 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd320966-5bcf-4f60-85cc-391e863cd6bc None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:56.258974 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee85d6-196b-40b7-839e-8ef25dedcbdc None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:56.259340 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee85d6-196b-40b7-839e-8ef25dedcbdc None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:56.259621 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee85d6-196b-40b7-839e-8ef25dedcbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:56.304664 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-afee85d6-196b-40b7-839e-8ef25dedcbdc None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:42:56.305774 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ce8a2-77c8-40a3-bbfd-f9df6ccba98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:56.305962 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-afee85d6-196b-40b7-839e-8ef25dedcbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:42:56.306701 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ce8a2-77c8-40a3-bbfd-f9df6ccba98c None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:56.306973 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ce8a2-77c8-40a3-bbfd-f9df6ccba98c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:56.307243 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ce8a2-77c8-40a3-bbfd-f9df6ccba98c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:56.320788 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ce8a2-77c8-40a3-bbfd-f9df6ccba98c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:42:56.329276 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-c65ce8a2-77c8-40a3-bbfd-f9df6ccba98c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 03:42:56.329276 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:42:56.329276 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:42:56.329276 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:42:56.329276 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:42:56.329276 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:42:56.329276 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:42:56.329276 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:42:56.329276 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:42:56.329276 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:42:56.329276 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:42:56.329276 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:42:56.329276 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:42:56.329276 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:42:56.329276 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:42:56.329276 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:42:56.331359 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:42:56.331359 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:42:56.331359 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:42:56.331359 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:42:56.331359 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:42:56.331359 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:42:56.331359 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:42:56.331359 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:42:56.331359 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:42:56.331359 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:42:56.331359 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:42:56.331359 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:42:56.331359 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:42:56.331359 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:42:56.331359 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:42:56.331359 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:42:56.333451 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:42:56.333451 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:42:56.333451 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:42:56.333451 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:42:56.333451 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:42:56.333451 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:42:56.333451 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:42:56.333451 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:42:56.333451 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:42:56.333451 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:42:56.333451 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 03:42:56.333451 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:42:56.333451 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 124/242] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:42:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:42:56.341476 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ce8a2-77c8-40a3-bbfd-f9df6ccba98c None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:56.429430 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:56.437044 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 119/243] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:42:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:42:56.480582 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee85d6-196b-40b7-839e-8ef25dedcbdc None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:56.564025 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ce8a2-77c8-40a3-bbfd-f9df6ccba98c None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:56.605055 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:56.639357 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6e52c-6faa-44c5-901f-62b9bcc84dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:56.641326 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6e52c-6faa-44c5-901f-62b9bcc84dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:56.642080 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6e52c-6faa-44c5-901f-62b9bcc84dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:56.642857 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6e52c-6faa-44c5-901f-62b9bcc84dc4 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:56.645389 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c6e52c-6faa-44c5-901f-62b9bcc84dc4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:42:56.645389 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c6e52c-6faa-44c5-901f-62b9bcc84dc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:56.647533 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c6e52c-6faa-44c5-901f-62b9bcc84dc4 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:56.670486 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 125/244] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 1 03:42:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:56.679709 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6e52c-6faa-44c5-901f-62b9bcc84dc4 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:56.702214 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee85d6-196b-40b7-839e-8ef25dedcbdc None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:56.761368 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f907bad1-9acb-4169-b789-6e6e1239bc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:56.762182 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907bad1-9acb-4169-b789-6e6e1239bc6e None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:56.762463 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907bad1-9acb-4169-b789-6e6e1239bc6e None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:56.762739 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907bad1-9acb-4169-b789-6e6e1239bc6e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:56.787382 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f907bad1-9acb-4169-b789-6e6e1239bc6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:42:56.795937 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-f907bad1-9acb-4169-b789-6e6e1239bc6e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 03:42:56.795937 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:42:56.795937 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:42:56.795937 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:42:56.795937 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:42:56.795937 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:42:56.795937 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:42:56.795937 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:42:56.795937 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:42:56.795937 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:42:56.795937 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:42:56.795937 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:42:56.795937 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:42:56.795937 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:42:56.795937 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:42:56.795937 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:42:56.798066 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:42:56.798066 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:42:56.798066 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:42:56.798066 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:42:56.798066 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:42:56.798066 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:42:56.798066 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:42:56.798066 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:42:56.798066 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:42:56.798066 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:42:56.798066 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:42:56.798066 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:42:56.798066 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:42:56.798066 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:42:56.798066 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:42:56.798066 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:42:56.799980 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:42:56.799980 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:42:56.799980 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:42:56.799980 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:42:56.799980 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:42:56.799980 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:42:56.799980 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:42:56.799980 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:42:56.799980 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:42:56.799980 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:42:56.799980 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 03:42:56.799980 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:42:56.799980 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 120/245] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:42:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:42:56.810967 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f907bad1-9acb-4169-b789-6e6e1239bc6e None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:56.929346 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6e52c-6faa-44c5-901f-62b9bcc84dc4 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:56.933409 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:56.993282 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e565c-b407-4350-8f51-d12c6dddf899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:56.994194 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e565c-b407-4350-8f51-d12c6dddf899 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:56.994481 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e565c-b407-4350-8f51-d12c6dddf899 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:56.994761 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e565c-b407-4350-8f51-d12c6dddf899 None admin] PATH_INFO: `/v3/users/173b14b3d3994855a6da5d7248a5f356` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:57.028979 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548e565c-b407-4350-8f51-d12c6dddf899 None admin] RBAC: Authorizing `identity:get_user(user_id=173b14b3d3994855a6da5d7248a5f356)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:57.030536 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548e565c-b407-4350-8f51-d12c6dddf899 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:57.032388 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 126/246] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:42:56 2022] GET /identity/v3/users/173b14b3d3994855a6da5d7248a5f356 => generated 297 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:57.038171 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e565c-b407-4350-8f51-d12c6dddf899 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:57.055274 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f907bad1-9acb-4169-b789-6e6e1239bc6e None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:57.086549 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:57.154129 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf5f1af-d42f-46d8-b3e8-bbc38153df12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:57.157490 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5f1af-d42f-46d8-b3e8-bbc38153df12 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:57.160576 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5f1af-d42f-46d8-b3e8-bbc38153df12 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:57.162665 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5f1af-d42f-46d8-b3e8-bbc38153df12 None admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:57.164504 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf5f1af-d42f-46d8-b3e8-bbc38153df12 None admin] RBAC: Adding query filter params (name=member) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:42:57.170501 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf5f1af-d42f-46d8-b3e8-bbc38153df12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:57.173450 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf5f1af-d42f-46d8-b3e8-bbc38153df12 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:57.223575 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 121/247] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 1 03:42:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:57.228923 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf5f1af-d42f-46d8-b3e8-bbc38153df12 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:57.288924 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e565c-b407-4350-8f51-d12c6dddf899 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:57.408780 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c0643-aabd-4b76-bfe4-753a6cc2df59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:57.409461 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c0643-aabd-4b76-bfe4-753a6cc2df59 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:57.409742 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c0643-aabd-4b76-bfe4-753a6cc2df59 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:57.410010 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c0643-aabd-4b76-bfe4-753a6cc2df59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:57.496146 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:57.543238 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf5f1af-d42f-46d8-b3e8-bbc38153df12 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:57.618320 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4c0643-aabd-4b76-bfe4-753a6cc2df59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:57.621473 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4c0643-aabd-4b76-bfe4-753a6cc2df59 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:57.652240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c1829-83b4-48b3-b47a-186f7534d9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:57.653160 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c1829-83b4-48b3-b47a-186f7534d9ea None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:57.653444 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c1829-83b4-48b3-b47a-186f7534d9ea None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:57.653721 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c1829-83b4-48b3-b47a-186f7534d9ea None admin] PATH_INFO: `/v3/users/9e9a221b71894f489e54a17b0b643fda` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:57.655071 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c1829-83b4-48b3-b47a-186f7534d9ea None admin] RBAC: Authorizing `identity:get_user(user_id=9e9a221b71894f489e54a17b0b643fda)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:57.656586 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c1829-83b4-48b3-b47a-186f7534d9ea None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:57.658291 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 122/248] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:42:57 2022] GET /identity/v3/users/9e9a221b71894f489e54a17b0b643fda => generated 297 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:42:57.675304 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c1829-83b4-48b3-b47a-186f7534d9ea None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:57.810067 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:57.920637 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 127/249] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:42:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 883 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 03:42:57.927010 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c0643-aabd-4b76-bfe4-753a6cc2df59 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:57.995082 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c1829-83b4-48b3-b47a-186f7534d9ea None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:58.097030 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c7c4f0-73f4-4ab5-9d72-70346b3e612d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:58.097900 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7c4f0-73f4-4ab5-9d72-70346b3e612d None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:58.098196 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7c4f0-73f4-4ab5-9d72-70346b3e612d None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:58.098475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7c4f0-73f4-4ab5-9d72-70346b3e612d None admin] PATH_INFO: `/v3/projects/85b9c0c1c9a84ec8989ff665fc2b2a0d` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:58.104290 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c7c4f0-73f4-4ab5-9d72-70346b3e612d None admin] RBAC: Authorizing `identity:get_project(project_id=85b9c0c1c9a84ec8989ff665fc2b2a0d)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:58.105805 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c7c4f0-73f4-4ab5-9d72-70346b3e612d None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:58.107979 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 123/250] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:42:57 2022] GET /identity/v3/projects/85b9c0c1c9a84ec8989ff665fc2b2a0d => generated 302 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:58.124494 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:58.125051 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c7c4f0-73f4-4ab5-9d72-70346b3e612d None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:58.237481 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c0643-aabd-4b76-bfe4-753a6cc2df59 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:58.313122 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ee88d-9c8e-47df-bf19-e77dc0d97ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:58.314035 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ee88d-9c8e-47df-bf19-e77dc0d97ffa None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:58.314312 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ee88d-9c8e-47df-bf19-e77dc0d97ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:58.314597 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ee88d-9c8e-47df-bf19-e77dc0d97ffa None admin] PATH_INFO: `/v3/projects/85b9c0c1c9a84ec8989ff665fc2b2a0d` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:58.317157 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4ee88d-9c8e-47df-bf19-e77dc0d97ffa None admin] RBAC: Authorizing `identity:get_project(project_id=85b9c0c1c9a84ec8989ff665fc2b2a0d)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:58.318709 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4ee88d-9c8e-47df-bf19-e77dc0d97ffa None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:58.322383 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 128/251] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:42:57 2022] GET /identity/v3/projects/85b9c0c1c9a84ec8989ff665fc2b2a0d => generated 302 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:42:58.323843 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84b203-431c-4fe1-ab26-ab3f5058cdfa None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:58.324140 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84b203-431c-4fe1-ab26-ab3f5058cdfa None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:58.324394 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84b203-431c-4fe1-ab26-ab3f5058cdfa None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:58.325774 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 129/252] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:42:58.332512 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab84b203-431c-4fe1-ab26-ab3f5058cdfa None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:58.357528 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c7c4f0-73f4-4ab5-9d72-70346b3e612d None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:58.381284 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:58.428803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b6102-4855-49af-935e-495e9187c55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:58.430257 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b6102-4855-49af-935e-495e9187c55e None admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:58.430543 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b6102-4855-49af-935e-495e9187c55e None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:58.430823 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b6102-4855-49af-935e-495e9187c55e None admin] PATH_INFO: `/v3/projects/85b9c0c1c9a84ec8989ff665fc2b2a0d/users/9e9a221b71894f489e54a17b0b643fda/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:58.435135 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b6102-4855-49af-935e-495e9187c55e None admin] RBAC: Authorizing `identity:create_grant(project_id=85b9c0c1c9a84ec8989ff665fc2b2a0d, user_id=9e9a221b71894f489e54a17b0b643fda, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:58.436641 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b6102-4855-49af-935e-495e9187c55e None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:58.504676 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab84b203-431c-4fe1-ab26-ab3f5058cdfa None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:58.537433 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:58.546267 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 124/253] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 1 03:42:58 2022] PUT /identity/v3/projects/85b9c0c1c9a84ec8989ff665fc2b2a0d/users/9e9a221b71894f489e54a17b0b643fda/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 03:42:58.550830 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1d099-2a3c-4ad8-a268-f0894bcb01c5 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:58.550830 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1d099-2a3c-4ad8-a268-f0894bcb01c5 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:58.550830 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1d099-2a3c-4ad8-a268-f0894bcb01c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:58.572823 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275f2eb6-9e57-443f-8ab3-5158da1b899a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:58.584160 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f2eb6-9e57-443f-8ab3-5158da1b899a None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:58.584160 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f2eb6-9e57-443f-8ab3-5158da1b899a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:58.584160 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f2eb6-9e57-443f-8ab3-5158da1b899a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:58.584160 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275f2eb6-9e57-443f-8ab3-5158da1b899a None admin] RBAC: Adding query filter params (role.id=29f86d307e104b0bbbcf69660a405cea, scope.project.id=85b9c0c1c9a84ec8989ff665fc2b2a0d, user.id=173b14b3d3994855a6da5d7248a5f356) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:42:58.584160 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275f2eb6-9e57-443f-8ab3-5158da1b899a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:58.584160 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275f2eb6-9e57-443f-8ab3-5158da1b899a None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:58.586545 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-72e1d099-2a3c-4ad8-a268-f0894bcb01c5 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:42:58.588147 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-72e1d099-2a3c-4ad8-a268-f0894bcb01c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:42:58.594642 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 130/254] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:42:58 2022] GET /identity/v3/role_assignments?user.id=173b14b3d3994855a6da5d7248a5f356&scope.project.id=85b9c0c1c9a84ec8989ff665fc2b2a0d&role.id=29f86d307e104b0bbbcf69660a405cea => generated 259 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:42:58.706180 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 125/255] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:42:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:42:58.735368 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013ebaf-3078-4d08-9884-fdb1fc9876d4 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:58.735686 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013ebaf-3078-4d08-9884-fdb1fc9876d4 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:58.736037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013ebaf-3078-4d08-9884-fdb1fc9876d4 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:58.737774 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 131/256] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:42:58.744282 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f52b5-3abc-49bc-9b28-8a996e4ecc1a None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:58.744553 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f52b5-3abc-49bc-9b28-8a996e4ecc1a None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:58.744861 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f52b5-3abc-49bc-9b28-8a996e4ecc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:58.766733 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-9b3f52b5-3abc-49bc-9b28-8a996e4ecc1a None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:42:58.768005 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-9b3f52b5-3abc-49bc-9b28-8a996e4ecc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:42:58.786514 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013ebaf-3078-4d08-9884-fdb1fc9876d4 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:58.892634 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 126/257] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:42:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 03:42:58.923072 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f52b5-3abc-49bc-9b28-8a996e4ecc1a None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:58.983180 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:59.026092 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013ebaf-3078-4d08-9884-fdb1fc9876d4 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:59.093975 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d9fb9-80a6-467e-ac59-60147072effa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:59.094816 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d9fb9-80a6-467e-ac59-60147072effa None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:59.095099 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d9fb9-80a6-467e-ac59-60147072effa None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:59.095369 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d9fb9-80a6-467e-ac59-60147072effa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:59.116547 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d9fb9-80a6-467e-ac59-60147072effa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:42:59.133370 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f52b5-3abc-49bc-9b28-8a996e4ecc1a None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:59.135024 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-2a4d9fb9-80a6-467e-ac59-60147072effa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 03:42:59.135024 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:42:59.135024 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:42:59.135024 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:42:59.135024 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:42:59.135024 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:42:59.135024 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:42:59.135024 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:42:59.135024 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:42:59.135024 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:42:59.135024 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:42:59.135024 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:42:59.135024 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:42:59.135024 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:42:59.135024 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:42:59.135024 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:42:59.136728 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:42:59.136728 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:42:59.136728 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:42:59.136728 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:42:59.136728 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:42:59.136728 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:42:59.136728 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:42:59.136728 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:42:59.136728 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:42:59.136728 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:42:59.136728 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:42:59.136728 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:42:59.136728 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:42:59.136728 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:42:59.136728 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:42:59.136728 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:42:59.138275 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:42:59.138275 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:42:59.138275 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:42:59.138275 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:42:59.138275 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:42:59.138275 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:42:59.138275 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:42:59.138275 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:42:59.138275 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:42:59.138275 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:42:59.138275 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 03:42:59.138275 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:42:59.138275 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 132/258] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Jul 1 03:42:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:42:59.149123 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d9fb9-80a6-467e-ac59-60147072effa None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:59.199150 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84735d90-a126-4de2-bc75-844527700277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:59.200613 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84735d90-a126-4de2-bc75-844527700277 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:59.201101 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84735d90-a126-4de2-bc75-844527700277 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:59.201573 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84735d90-a126-4de2-bc75-844527700277 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:59.222426 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84735d90-a126-4de2-bc75-844527700277 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:42:59.238596 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-84735d90-a126-4de2-bc75-844527700277 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:42:59.238596 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:42:59.238596 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:42:59.238596 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:42:59.238596 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:42:59.238596 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:42:59.238596 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:42:59.238596 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:42:59.238596 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:42:59.238596 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:42:59.238596 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:42:59.238596 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:42:59.238596 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:42:59.238596 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:42:59.238596 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:42:59.238596 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:42:59.240460 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:42:59.240460 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:42:59.240460 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:42:59.240460 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:42:59.240460 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:42:59.240460 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:42:59.240460 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:42:59.240460 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:42:59.240460 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:42:59.240460 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:42:59.240460 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:42:59.240460 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:42:59.240460 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:42:59.240460 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:42:59.240460 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:42:59.240460 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:42:59.241492 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:42:59.241492 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:42:59.241492 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:42:59.241492 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:42:59.241492 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:42:59.241492 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:42:59.241492 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:42:59.241492 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:42:59.241492 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:42:59.241492 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:42:59.241492 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:42:59.241492 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:42:59.241492 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 127/259] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 1 03:42:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 03:42:59.253031 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84735d90-a126-4de2-bc75-844527700277 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:59.270909 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:59.421387 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d9fb9-80a6-467e-ac59-60147072effa None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:59.499860 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f095c38-5554-41a4-8e43-7b0203083d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:59.500476 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f095c38-5554-41a4-8e43-7b0203083d06 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:59.500756 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f095c38-5554-41a4-8e43-7b0203083d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:59.501038 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f095c38-5554-41a4-8e43-7b0203083d06 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:59.501816 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f095c38-5554-41a4-8e43-7b0203083d06 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:42:59.502127 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f095c38-5554-41a4-8e43-7b0203083d06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:59.503665 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f095c38-5554-41a4-8e43-7b0203083d06 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:59.519228 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 133/260] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:42:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:59.532579 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f095c38-5554-41a4-8e43-7b0203083d06 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:59.543987 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:59.573057 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84735d90-a126-4de2-bc75-844527700277 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:59.693901 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e664631-2c98-4ab9-b63c-c773c3a55022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:59.696144 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e664631-2c98-4ab9-b63c-c773c3a55022 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:59.696879 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e664631-2c98-4ab9-b63c-c773c3a55022 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:59.697565 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e664631-2c98-4ab9-b63c-c773c3a55022 None admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:59.699072 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e664631-2c98-4ab9-b63c-c773c3a55022 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:42:59.708243 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e664631-2c98-4ab9-b63c-c773c3a55022 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:59.711841 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e664631-2c98-4ab9-b63c-c773c3a55022 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:59.738493 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f095c38-5554-41a4-8e43-7b0203083d06 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:42:59.739058 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 128/261] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:42:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 487 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:42:59.744941 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e664631-2c98-4ab9-b63c-c773c3a55022 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:42:59.752311 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:42:59.797331 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35615798-9d6e-47f5-9504-a4548c54250d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:42:59.798302 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35615798-9d6e-47f5-9504-a4548c54250d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:42:59.799306 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35615798-9d6e-47f5-9504-a4548c54250d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:42:59.799998 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35615798-9d6e-47f5-9504-a4548c54250d None admin] PATH_INFO: `/v3/users/079fc35b3a954fb383f3778c6de22460` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:42:59.807482 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35615798-9d6e-47f5-9504-a4548c54250d None admin] RBAC: Authorizing `identity:get_user(user_id=079fc35b3a954fb383f3778c6de22460)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:42:59.807482 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35615798-9d6e-47f5-9504-a4548c54250d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:42:59.807482 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 134/262] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:42:59 2022] GET /identity/v3/users/079fc35b3a954fb383f3778c6de22460 => generated 283 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:42:59.815634 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35615798-9d6e-47f5-9504-a4548c54250d None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:00.028631 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35615798-9d6e-47f5-9504-a4548c54250d None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:00.099178 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e664631-2c98-4ab9-b63c-c773c3a55022 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:00.103678 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa683f-fd28-4f7f-a234-321d7c3dca9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:00.104799 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa683f-fd28-4f7f-a234-321d7c3dca9c None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:00.105259 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa683f-fd28-4f7f-a234-321d7c3dca9c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:00.105712 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa683f-fd28-4f7f-a234-321d7c3dca9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:00.196595 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed575fb-4fce-4116-b762-df5d5d05b5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:00.197539 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed575fb-4fce-4116-b762-df5d5d05b5d8 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:00.197828 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed575fb-4fce-4116-b762-df5d5d05b5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:00.198111 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed575fb-4fce-4116-b762-df5d5d05b5d8 None admin] PATH_INFO: `/v3/users/079fc35b3a954fb383f3778c6de22460` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:00.200325 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed575fb-4fce-4116-b762-df5d5d05b5d8 None admin] RBAC: Authorizing `identity:get_user(user_id=079fc35b3a954fb383f3778c6de22460)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:00.201853 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed575fb-4fce-4116-b762-df5d5d05b5d8 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:00.203667 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 129/263] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:42:59 2022] GET /identity/v3/users/079fc35b3a954fb383f3778c6de22460 => generated 283 bytes in 460 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:43:00.205020 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b4a5f-b1a3-4fed-8278-f17e47ecd13c None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:00.205307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b4a5f-b1a3-4fed-8278-f17e47ecd13c None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:00.205585 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b4a5f-b1a3-4fed-8278-f17e47ecd13c None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:00.206981 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 130/264] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:43:00.215319 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:00.216521 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b4a5f-b1a3-4fed-8278-f17e47ecd13c None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:00.254059 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfa683f-fd28-4f7f-a234-321d7c3dca9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:00.257540 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfa683f-fd28-4f7f-a234-321d7c3dca9c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:00.282846 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:00.407078 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 135/265] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:42:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 01 03:43:00.413387 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b924fee-9a2d-448e-b5df-68407aa244fa None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:00.413764 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b924fee-9a2d-448e-b5df-68407aa244fa None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:00.414635 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b924fee-9a2d-448e-b5df-68407aa244fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:00.440090 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-1b924fee-9a2d-448e-b5df-68407aa244fa None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:43:00.441347 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1b924fee-9a2d-448e-b5df-68407aa244fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:43:00.486180 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b4a5f-b1a3-4fed-8278-f17e47ecd13c None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:00.544183 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6338b7-e7e6-4e85-827e-31aa8bb60343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:00.544965 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6338b7-e7e6-4e85-827e-31aa8bb60343 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:00.545253 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6338b7-e7e6-4e85-827e-31aa8bb60343 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:00.545540 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6338b7-e7e6-4e85-827e-31aa8bb60343 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:00.559485 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 136/266] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:43:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:43:00.559485 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab979819-afbb-4f1b-8cc5-d1e5a32b2e12 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:00.559485 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab979819-afbb-4f1b-8cc5-d1e5a32b2e12 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:00.559485 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab979819-afbb-4f1b-8cc5-d1e5a32b2e12 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:00.563639 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 137/267] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:43:00 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:43:00.564770 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab979819-afbb-4f1b-8cc5-d1e5a32b2e12 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:00.590118 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:00.655984 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6338b7-e7e6-4e85-827e-31aa8bb60343 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:00.657925 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6338b7-e7e6-4e85-827e-31aa8bb60343 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:00.693132 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:00.757178 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab979819-afbb-4f1b-8cc5-d1e5a32b2e12 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:00.820640 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14592272-a32d-4ec5-992d-178ceaba8fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:00.822208 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14592272-a32d-4ec5-992d-178ceaba8fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:00.822649 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14592272-a32d-4ec5-992d-178ceaba8fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:00.823193 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14592272-a32d-4ec5-992d-178ceaba8fe6 None admin] PATH_INFO: `/v3/projects/85b9c0c1c9a84ec8989ff665fc2b2a0d` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:00.824992 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14592272-a32d-4ec5-992d-178ceaba8fe6 None admin] RBAC: Authorizing `identity:get_project(project_id=85b9c0c1c9a84ec8989ff665fc2b2a0d)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:00.827391 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14592272-a32d-4ec5-992d-178ceaba8fe6 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:00.831406 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 138/268] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:43:00 2022] GET /identity/v3/projects/85b9c0c1c9a84ec8989ff665fc2b2a0d => generated 302 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:00.833979 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164fed7-a725-419f-9783-42b2bdbd63ec None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:00.834577 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164fed7-a725-419f-9783-42b2bdbd63ec None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:00.835144 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164fed7-a725-419f-9783-42b2bdbd63ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:00.854861 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 131/269] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:43:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 03:43:00.856539 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6338b7-e7e6-4e85-827e-31aa8bb60343 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:00.862819 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-9164fed7-a725-419f-9783-42b2bdbd63ec None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:43:00.865004 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9164fed7-a725-419f-9783-42b2bdbd63ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:43:01.010285 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 139/270] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:43:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:43:01.011506 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9164fed7-a725-419f-9783-42b2bdbd63ec None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:01.026884 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:01.049323 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6338b7-e7e6-4e85-827e-31aa8bb60343 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:01.095951 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:01.116377 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8bb0b5-6a9d-4caa-b55d-4a978bce4f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:01.119049 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8bb0b5-6a9d-4caa-b55d-4a978bce4f19 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:01.119742 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8bb0b5-6a9d-4caa-b55d-4a978bce4f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:01.120426 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8bb0b5-6a9d-4caa-b55d-4a978bce4f19 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:01.122878 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8bb0b5-6a9d-4caa-b55d-4a978bce4f19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:01.125846 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8bb0b5-6a9d-4caa-b55d-4a978bce4f19 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:01.130034 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 132/271] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:43:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:01.132059 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8bb0b5-6a9d-4caa-b55d-4a978bce4f19 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:01.200875 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9164fed7-a725-419f-9783-42b2bdbd63ec None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:01.270858 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de8505-4901-4f99-b313-9010eb4d59ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:01.272484 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de8505-4901-4f99-b313-9010eb4d59ac None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:01.273952 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de8505-4901-4f99-b313-9010eb4d59ac None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:01.274720 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de8505-4901-4f99-b313-9010eb4d59ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:01.277464 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49de8505-4901-4f99-b313-9010eb4d59ac None admin] RBAC: Adding query filter params (role.id=132287c7d1f9428d9195f2b4ed60756b, scope.project.id=85b9c0c1c9a84ec8989ff665fc2b2a0d, user.id=079fc35b3a954fb383f3778c6de22460) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:01.278315 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49de8505-4901-4f99-b313-9010eb4d59ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:01.281755 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49de8505-4901-4f99-b313-9010eb4d59ac None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:01.296555 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 140/272] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:43:01 2022] GET /identity/v3/role_assignments?user.id=079fc35b3a954fb383f3778c6de22460&scope.project.id=85b9c0c1c9a84ec8989ff665fc2b2a0d&role.id=132287c7d1f9428d9195f2b4ed60756b => generated 608 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:01.298656 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de8505-4901-4f99-b313-9010eb4d59ac None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:01.323808 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8bb0b5-6a9d-4caa-b55d-4a978bce4f19 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:01.412926 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fbbf35-5665-484d-8dcc-782ea8674688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:01.414741 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fbbf35-5665-484d-8dcc-782ea8674688 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:01.415893 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fbbf35-5665-484d-8dcc-782ea8674688 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:01.416754 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fbbf35-5665-484d-8dcc-782ea8674688 None admin] PATH_INFO: `/v3/projects/85b9c0c1c9a84ec8989ff665fc2b2a0d` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:01.425243 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:01.425787 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fbbf35-5665-484d-8dcc-782ea8674688 None admin] RBAC: Authorizing `identity:get_project(project_id=85b9c0c1c9a84ec8989ff665fc2b2a0d)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:01.430251 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fbbf35-5665-484d-8dcc-782ea8674688 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:01.433858 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 133/273] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:43:01 2022] GET /identity/v3/projects/85b9c0c1c9a84ec8989ff665fc2b2a0d => generated 302 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:01.439722 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fbbf35-5665-484d-8dcc-782ea8674688 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:01.462438 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de8505-4901-4f99-b313-9010eb4d59ac None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:01.508221 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682086e7-995b-4380-98c5-3bbd23feedc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:01.508221 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682086e7-995b-4380-98c5-3bbd23feedc2 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:01.508221 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682086e7-995b-4380-98c5-3bbd23feedc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:01.508221 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682086e7-995b-4380-98c5-3bbd23feedc2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:01.518571 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682086e7-995b-4380-98c5-3bbd23feedc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:43:01.526839 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-682086e7-995b-4380-98c5-3bbd23feedc2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 03:43:01.526839 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:01.526839 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:01.526839 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:01.526839 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:01.526839 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:01.526839 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:01.526839 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:01.526839 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:01.526839 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:01.526839 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:01.526839 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:01.526839 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:43:01.526839 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:43:01.526839 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:43:01.526839 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:43:01.528591 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:43:01.528591 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:43:01.528591 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:43:01.528591 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:43:01.528591 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:01.528591 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:01.528591 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:01.528591 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:01.528591 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:01.528591 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:01.528591 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:01.528591 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:01.528591 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:01.528591 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:01.528591 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:01.528591 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:01.530260 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:01.530260 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:01.530260 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:01.530260 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:01.530260 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:43:01.530260 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:43:01.530260 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:43:01.530260 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:43:01.530260 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:43:01.530260 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:43:01.530260 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 03:43:01.530260 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:01.530260 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 141/274] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:43:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:01.530260 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682086e7-995b-4380-98c5-3bbd23feedc2 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:01.626807 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:01.655162 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682086e7-995b-4380-98c5-3bbd23feedc2 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:01.691875 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:01.699213 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31a1f2-73ae-4d81-b3d3-668acaadc6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:01.705141 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31a1f2-73ae-4d81-b3d3-668acaadc6c8 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:01.705141 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31a1f2-73ae-4d81-b3d3-668acaadc6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:01.705141 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31a1f2-73ae-4d81-b3d3-668acaadc6c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:01.705141 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c31a1f2-73ae-4d81-b3d3-668acaadc6c8 None admin] RBAC: Adding query filter params (role.id=681755518698445fabd9a8accec13c0f, scope.project.id=85b9c0c1c9a84ec8989ff665fc2b2a0d, user.id=079fc35b3a954fb383f3778c6de22460) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:01.705141 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c31a1f2-73ae-4d81-b3d3-668acaadc6c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:01.705502 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fbbf35-5665-484d-8dcc-782ea8674688 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:01.705571 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c31a1f2-73ae-4d81-b3d3-668acaadc6c8 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:01.710668 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 142/275] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:43:01 2022] GET /identity/v3/role_assignments?user.id=079fc35b3a954fb383f3778c6de22460&scope.project.id=85b9c0c1c9a84ec8989ff665fc2b2a0d&role.id=681755518698445fabd9a8accec13c0f => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:01.711553 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31a1f2-73ae-4d81-b3d3-668acaadc6c8 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:01.750989 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed0762-52a2-44dc-862c-32b84e0296d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:01.752104 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed0762-52a2-44dc-862c-32b84e0296d7 None admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:01.752612 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed0762-52a2-44dc-862c-32b84e0296d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:01.753142 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed0762-52a2-44dc-862c-32b84e0296d7 None admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:01.754177 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ed0762-52a2-44dc-862c-32b84e0296d7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:01.755928 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ed0762-52a2-44dc-862c-32b84e0296d7 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:01.848952 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 134/276] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Jul 1 03:43:01 2022] POST /identity/v3/users => generated 293 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 03:43:01.851014 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa61ca-1c09-4924-a491-ae3a3b81d7d3 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:01.852164 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa61ca-1c09-4924-a491-ae3a3b81d7d3 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:01.853004 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa61ca-1c09-4924-a491-ae3a3b81d7d3 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:01.855157 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 135/277] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:43:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:43:01.871153 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70730518-413f-4c2b-a02e-d11a73c69648 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:01.871955 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70730518-413f-4c2b-a02e-d11a73c69648 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:01.872733 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70730518-413f-4c2b-a02e-d11a73c69648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:01.898825 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-70730518-413f-4c2b-a02e-d11a73c69648 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:43:01.900755 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-70730518-413f-4c2b-a02e-d11a73c69648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:43:01.906873 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31a1f2-73ae-4d81-b3d3-668acaadc6c8 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:01.984658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef502f4-2561-4240-b1ad-78c8c099374a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:01.985860 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef502f4-2561-4240-b1ad-78c8c099374a None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:01.986346 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef502f4-2561-4240-b1ad-78c8c099374a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:01.986819 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef502f4-2561-4240-b1ad-78c8c099374a None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:01.988325 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef502f4-2561-4240-b1ad-78c8c099374a None admin] RBAC: Adding query filter params (name=member) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:01.988884 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef502f4-2561-4240-b1ad-78c8c099374a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:01.991665 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef502f4-2561-4240-b1ad-78c8c099374a None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:02.002813 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 136/278] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:43:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:43:02.005438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ec3bc-8b3b-40e4-87e4-75e50af557fd None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:02.006074 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ec3bc-8b3b-40e4-87e4-75e50af557fd None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:02.006564 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ec3bc-8b3b-40e4-87e4-75e50af557fd None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:02.008802 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 137/279] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:43:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:43:02.014033 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 143/280] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 1 03:43:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:02.020379 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6348a6b-f9e4-4379-a32b-12aab3cfe78c None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:02.021021 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6348a6b-f9e4-4379-a32b-12aab3cfe78c None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:02.021508 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef502f4-2561-4240-b1ad-78c8c099374a None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:02.021617 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6348a6b-f9e4-4379-a32b-12aab3cfe78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:02.042720 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-e6348a6b-f9e4-4379-a32b-12aab3cfe78c None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:43:02.044399 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-e6348a6b-f9e4-4379-a32b-12aab3cfe78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:43:02.114350 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:02.132292 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:02.165957 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 138/281] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:43:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:43:02.168479 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6348a6b-f9e4-4379-a32b-12aab3cfe78c None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:02.195636 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef502f4-2561-4240-b1ad-78c8c099374a None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:02.258729 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413674d-2a43-4828-8a3d-2be9a60b5fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:02.260677 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413674d-2a43-4828-8a3d-2be9a60b5fdf None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:02.261168 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413674d-2a43-4828-8a3d-2be9a60b5fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:02.262242 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413674d-2a43-4828-8a3d-2be9a60b5fdf None admin] PATH_INFO: `/v3/users/6400f6d73b884f6aab2394817c405bea` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:02.288262 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413674d-2a43-4828-8a3d-2be9a60b5fdf None admin] RBAC: Authorizing `identity:get_user(user_id=6400f6d73b884f6aab2394817c405bea)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:02.290705 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413674d-2a43-4828-8a3d-2be9a60b5fdf None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:02.292558 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 144/282] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:43:02 2022] GET /identity/v3/users/6400f6d73b884f6aab2394817c405bea => generated 293 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:02.293619 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413674d-2a43-4828-8a3d-2be9a60b5fdf None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:02.366256 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6348a6b-f9e4-4379-a32b-12aab3cfe78c None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:02.434324 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa587cb-c2bb-40af-9612-5529453bcfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:02.436111 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa587cb-c2bb-40af-9612-5529453bcfdb None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:02.436838 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa587cb-c2bb-40af-9612-5529453bcfdb None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:02.437542 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa587cb-c2bb-40af-9612-5529453bcfdb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:02.458637 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa587cb-c2bb-40af-9612-5529453bcfdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:43:02.475423 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-afa587cb-c2bb-40af-9612-5529453bcfdb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 03:43:02.475423 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:02.475423 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:02.475423 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:02.475423 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:02.475423 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:02.475423 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:02.475423 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:02.475423 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:02.475423 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:02.475423 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:02.475423 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:02.475423 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:43:02.475423 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:43:02.475423 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:43:02.475423 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:43:02.477783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:43:02.477783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:43:02.477783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:43:02.477783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:43:02.477783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:02.477783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:02.477783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:02.477783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:02.477783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:02.477783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:02.477783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:02.477783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:02.477783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:02.477783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:02.477783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:02.477783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:02.479336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:02.479336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:02.479336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:02.479336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:02.479336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:43:02.479336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:43:02.479336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:43:02.479336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:43:02.479336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:43:02.479336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:43:02.479336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 03:43:02.479336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:02.479336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 139/283] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:43:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:02.482519 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa587cb-c2bb-40af-9612-5529453bcfdb None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:02.494858 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413674d-2a43-4828-8a3d-2be9a60b5fdf None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:02.528366 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:02.545748 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:02.566585 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b0065-457f-4dc7-b355-1feb448f669e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:02.568481 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b0065-457f-4dc7-b355-1feb448f669e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:02.569186 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b0065-457f-4dc7-b355-1feb448f669e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:02.570476 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b0065-457f-4dc7-b355-1feb448f669e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:02.590890 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b0065-457f-4dc7-b355-1feb448f669e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:43:02.609909 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-0c7b0065-457f-4dc7-b355-1feb448f669e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 03:43:02.609909 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:02.609909 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:02.609909 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:02.609909 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:02.609909 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:02.609909 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:02.609909 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:02.609909 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:02.609909 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:02.609909 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:02.609909 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:02.609909 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:43:02.609909 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:43:02.609909 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:43:02.609909 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:43:02.611664 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:43:02.611664 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:43:02.611664 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:43:02.611664 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:43:02.611664 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:02.611664 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:02.611664 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:02.611664 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:02.611664 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:02.611664 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:02.611664 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:02.611664 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:02.611664 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:02.611664 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:02.611664 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:02.611664 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:02.612476 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:02.612476 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:02.612476 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:02.612476 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:02.612476 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:43:02.612476 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:43:02.612476 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:43:02.612476 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:43:02.612476 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:43:02.612476 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:43:02.612476 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 03:43:02.612476 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:02.617351 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 145/284] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:43:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:02.619045 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b0065-457f-4dc7-b355-1feb448f669e None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:02.670257 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa587cb-c2bb-40af-9612-5529453bcfdb None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:02.727315 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8892c-a063-4664-ba7a-ae671b9be29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:02.728505 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8892c-a063-4664-ba7a-ae671b9be29a None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:02.729039 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8892c-a063-4664-ba7a-ae671b9be29a None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:02.729595 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8892c-a063-4664-ba7a-ae671b9be29a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:02.731150 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8892c-a063-4664-ba7a-ae671b9be29a None admin] RBAC: Adding query filter params (role.id=c0b595782ebc410db693ef7fa70522a3, user.id=6400f6d73b884f6aab2394817c405bea, scope.system=all) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:02.731766 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8892c-a063-4664-ba7a-ae671b9be29a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:02.734599 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8892c-a063-4664-ba7a-ae671b9be29a None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:02.744589 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 140/285] 10.222.0.46 () {56 vars in 1308 bytes} [Fri Jul 1 03:43:02 2022] GET /identity/v3/role_assignments?user.id=6400f6d73b884f6aab2394817c405bea&scope.system=all&role.id=c0b595782ebc410db693ef7fa70522a3 => generated 226 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:02.751316 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8892c-a063-4664-ba7a-ae671b9be29a None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:02.827512 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b0065-457f-4dc7-b355-1feb448f669e None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:02.894507 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e50ee-509c-428f-99d5-b5a532499a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:02.896797 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e50ee-509c-428f-99d5-b5a532499a7b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:02.897576 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e50ee-509c-428f-99d5-b5a532499a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:02.898788 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e50ee-509c-428f-99d5-b5a532499a7b None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:02.900402 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e50ee-509c-428f-99d5-b5a532499a7b None admin] RBAC: Adding query filter params (name=member) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:02.901190 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e50ee-509c-428f-99d5-b5a532499a7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:02.904989 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e50ee-509c-428f-99d5-b5a532499a7b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:02.923018 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 146/286] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 1 03:43:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:02.932625 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e50ee-509c-428f-99d5-b5a532499a7b None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:03.024933 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:03.041690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8892c-a063-4664-ba7a-ae671b9be29a None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:03.067867 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:03.129139 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a54864-5d23-4d2c-afe1-e299ad357623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:03.129462 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a54864-5d23-4d2c-afe1-e299ad357623 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:03.129745 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a54864-5d23-4d2c-afe1-e299ad357623 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:03.130025 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a54864-5d23-4d2c-afe1-e299ad357623 None admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:03.130817 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a54864-5d23-4d2c-afe1-e299ad357623 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:03.131237 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a54864-5d23-4d2c-afe1-e299ad357623 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:03.134080 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a54864-5d23-4d2c-afe1-e299ad357623 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:03.156676 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 141/287] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 1 03:43:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:03.166407 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a54864-5d23-4d2c-afe1-e299ad357623 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:03.244645 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e50ee-509c-428f-99d5-b5a532499a7b None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:03.292606 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a54864-5d23-4d2c-afe1-e299ad357623 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:03.331958 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17906020-ee11-490b-a527-1fa19ae179df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:03.332575 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17906020-ee11-490b-a527-1fa19ae179df None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:03.332862 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17906020-ee11-490b-a527-1fa19ae179df None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:03.333137 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17906020-ee11-490b-a527-1fa19ae179df None admin] PATH_INFO: `/v3/users/173b14b3d3994855a6da5d7248a5f356` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:03.334394 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17906020-ee11-490b-a527-1fa19ae179df None admin] RBAC: Authorizing `identity:get_user(user_id=173b14b3d3994855a6da5d7248a5f356)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:03.336538 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17906020-ee11-490b-a527-1fa19ae179df None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:03.345299 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 142/288] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:43:03 2022] GET /identity/v3/users/173b14b3d3994855a6da5d7248a5f356 => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:43:03.345299 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17906020-ee11-490b-a527-1fa19ae179df None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:03.362818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f91f4f-4f00-4e5c-9f58-37596d0ade04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:03.363808 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f91f4f-4f00-4e5c-9f58-37596d0ade04 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:03.364091 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f91f4f-4f00-4e5c-9f58-37596d0ade04 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:03.364366 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f91f4f-4f00-4e5c-9f58-37596d0ade04 None admin] PATH_INFO: `/v3/users/9e9a221b71894f489e54a17b0b643fda` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:03.365804 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f91f4f-4f00-4e5c-9f58-37596d0ade04 None admin] RBAC: Authorizing `identity:get_user(user_id=9e9a221b71894f489e54a17b0b643fda)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:03.367436 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f91f4f-4f00-4e5c-9f58-37596d0ade04 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:03.369744 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 147/289] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:43:02 2022] GET /identity/v3/users/9e9a221b71894f489e54a17b0b643fda => generated 297 bytes in 438 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:03.377632 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f91f4f-4f00-4e5c-9f58-37596d0ade04 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:03.386559 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:03.504852 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17906020-ee11-490b-a527-1fa19ae179df None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:03.610173 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77960130-6352-4808-8ebb-d242d31650cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:03.612176 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77960130-6352-4808-8ebb-d242d31650cb None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:03.612937 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77960130-6352-4808-8ebb-d242d31650cb None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:03.613716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77960130-6352-4808-8ebb-d242d31650cb None admin] PATH_INFO: `/v3/projects/85b9c0c1c9a84ec8989ff665fc2b2a0d` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:03.619480 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77960130-6352-4808-8ebb-d242d31650cb None admin] RBAC: Authorizing `identity:get_project(project_id=85b9c0c1c9a84ec8989ff665fc2b2a0d)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:03.622549 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77960130-6352-4808-8ebb-d242d31650cb None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:03.628642 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 143/290] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:43:03 2022] GET /identity/v3/projects/85b9c0c1c9a84ec8989ff665fc2b2a0d => generated 302 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:03.637773 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77960130-6352-4808-8ebb-d242d31650cb None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:03.644698 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f91f4f-4f00-4e5c-9f58-37596d0ade04 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:03.648008 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:03.701271 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e0c74-d1b7-47dc-9319-a80b14306980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:03.701943 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e0c74-d1b7-47dc-9319-a80b14306980 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:03.702228 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e0c74-d1b7-47dc-9319-a80b14306980 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:03.702506 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e0c74-d1b7-47dc-9319-a80b14306980 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:03.808880 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88e0c74-d1b7-47dc-9319-a80b14306980 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:03.810380 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88e0c74-d1b7-47dc-9319-a80b14306980 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:03.864489 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:03.878519 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77960130-6352-4808-8ebb-d242d31650cb None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:03.922551 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 148/291] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:43:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 03:43:03.934498 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e0c74-d1b7-47dc-9319-a80b14306980 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:03.944037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:03.973563 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2defc4bf-2f3b-48f7-ac80-983a72e63573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:03.974481 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2defc4bf-2f3b-48f7-ac80-983a72e63573 None admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:03.974752 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2defc4bf-2f3b-48f7-ac80-983a72e63573 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:03.975030 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2defc4bf-2f3b-48f7-ac80-983a72e63573 None admin] PATH_INFO: `/v3/projects/85b9c0c1c9a84ec8989ff665fc2b2a0d/users/173b14b3d3994855a6da5d7248a5f356/roles/29f86d307e104b0bbbcf69660a405cea` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:03.984459 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2defc4bf-2f3b-48f7-ac80-983a72e63573 None admin] RBAC: Authorizing `identity:create_grant(project_id=85b9c0c1c9a84ec8989ff665fc2b2a0d, user_id=173b14b3d3994855a6da5d7248a5f356, role_id=29f86d307e104b0bbbcf69660a405cea)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:03.985942 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2defc4bf-2f3b-48f7-ac80-983a72e63573 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:04.058477 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e0c74-d1b7-47dc-9319-a80b14306980 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:04.096074 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad657f-cc13-44e3-8238-0e26abc42aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:04.096993 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad657f-cc13-44e3-8238-0e26abc42aab None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:04.097280 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad657f-cc13-44e3-8238-0e26abc42aab None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:04.097556 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad657f-cc13-44e3-8238-0e26abc42aab None admin] PATH_INFO: `/v3/projects/85b9c0c1c9a84ec8989ff665fc2b2a0d` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:04.098576 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 144/292] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 1 03:43:03 2022] PUT /identity/v3/projects/85b9c0c1c9a84ec8989ff665fc2b2a0d/users/173b14b3d3994855a6da5d7248a5f356/roles/29f86d307e104b0bbbcf69660a405cea => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 03:43:04.099213 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad657f-cc13-44e3-8238-0e26abc42aab None admin] RBAC: Authorizing `identity:get_project(project_id=85b9c0c1c9a84ec8989ff665fc2b2a0d)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:04.100769 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad657f-cc13-44e3-8238-0e26abc42aab None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:04.103222 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 149/293] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:43:03 2022] GET /identity/v3/projects/85b9c0c1c9a84ec8989ff665fc2b2a0d => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:43:04.125740 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2defc4bf-2f3b-48f7-ac80-983a72e63573 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:04.347244 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2defc4bf-2f3b-48f7-ac80-983a72e63573 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:04.414552 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17486a71-3016-4e54-8cb6-c8115d35946d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:04.415929 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17486a71-3016-4e54-8cb6-c8115d35946d None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:04.416414 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17486a71-3016-4e54-8cb6-c8115d35946d None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:04.416900 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17486a71-3016-4e54-8cb6-c8115d35946d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:04.418433 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17486a71-3016-4e54-8cb6-c8115d35946d None admin] RBAC: Adding query filter params (role.id=c0b595782ebc410db693ef7fa70522a3, scope.project.id=85b9c0c1c9a84ec8989ff665fc2b2a0d, user.id=9e9a221b71894f489e54a17b0b643fda) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:04.418979 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17486a71-3016-4e54-8cb6-c8115d35946d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:04.421718 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17486a71-3016-4e54-8cb6-c8115d35946d None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:04.439755 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 145/294] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:43:04 2022] GET /identity/v3/role_assignments?user.id=9e9a221b71894f489e54a17b0b643fda&scope.project.id=85b9c0c1c9a84ec8989ff665fc2b2a0d&role.id=c0b595782ebc410db693ef7fa70522a3 => generated 608 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:04.799616 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96120ad-75b4-4522-b24d-601caf289e0e None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:04.800276 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96120ad-75b4-4522-b24d-601caf289e0e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:04.800276 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96120ad-75b4-4522-b24d-601caf289e0e None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:04.801896 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 150/295] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:43:04.817687 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8eee08-4e73-461c-9fa8-4a6279e1b9c6 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:04.818071 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8eee08-4e73-461c-9fa8-4a6279e1b9c6 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:04.818303 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8eee08-4e73-461c-9fa8-4a6279e1b9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:04.840504 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-db8eee08-4e73-461c-9fa8-4a6279e1b9c6 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:43:04.841749 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-db8eee08-4e73-461c-9fa8-4a6279e1b9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:43:04.859201 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:04.935989 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 146/296] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:43:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:43:04.982237 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96120ad-75b4-4522-b24d-601caf289e0e None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:05.144144 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:05.210879 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96120ad-75b4-4522-b24d-601caf289e0e None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:05.275601 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42c8bb-03c9-4fea-a6d2-5792b432c7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:05.277020 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42c8bb-03c9-4fea-a6d2-5792b432c7fe None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:05.277535 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42c8bb-03c9-4fea-a6d2-5792b432c7fe None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:05.278040 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42c8bb-03c9-4fea-a6d2-5792b432c7fe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:05.298339 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab42c8bb-03c9-4fea-a6d2-5792b432c7fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:43:05.314967 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-ab42c8bb-03c9-4fea-a6d2-5792b432c7fe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 03:43:05.314967 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:05.314967 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:05.314967 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:05.314967 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:05.314967 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:05.314967 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:05.314967 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:05.314967 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:05.314967 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:05.314967 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:05.314967 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:05.314967 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:43:05.314967 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:43:05.314967 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:43:05.314967 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:43:05.316743 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:43:05.316743 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:43:05.316743 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:43:05.316743 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:43:05.316743 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:05.316743 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:05.316743 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:05.316743 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:05.316743 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:05.316743 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:05.316743 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:05.316743 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:05.316743 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:05.316743 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:05.316743 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:05.316743 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:05.318261 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:05.318261 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:05.318261 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:05.318261 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:05.318261 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:43:05.318261 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:43:05.318261 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:43:05.318261 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:43:05.318261 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:43:05.318261 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:43:05.318261 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 03:43:05.318261 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:05.318261 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 151/297] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:43:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:05.327290 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8eee08-4e73-461c-9fa8-4a6279e1b9c6 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:05.528122 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8eee08-4e73-461c-9fa8-4a6279e1b9c6 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:05.581142 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837c83a-b366-4ef2-9c69-edacde9302a0 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:05.581425 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837c83a-b366-4ef2-9c69-edacde9302a0 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:05.581729 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837c83a-b366-4ef2-9c69-edacde9302a0 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:05.584549 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 152/298] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:43:05.589216 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c005ed-836f-488b-b38d-e8c35fffcfa1 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:05.589423 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b712b-4390-457a-9251-6d51e8b67fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:05.589577 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c005ed-836f-488b-b38d-e8c35fffcfa1 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:05.589918 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c005ed-836f-488b-b38d-e8c35fffcfa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:05.590420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b712b-4390-457a-9251-6d51e8b67fe2 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:05.590913 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b712b-4390-457a-9251-6d51e8b67fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:05.591409 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b712b-4390-457a-9251-6d51e8b67fe2 None admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:05.593144 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b712b-4390-457a-9251-6d51e8b67fe2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:05.593808 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b712b-4390-457a-9251-6d51e8b67fe2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:05.596803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b712b-4390-457a-9251-6d51e8b67fe2 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:05.608524 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-17c005ed-836f-488b-b38d-e8c35fffcfa1 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:43:05.610029 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-17c005ed-836f-488b-b38d-e8c35fffcfa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:43:05.618840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 147/299] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 1 03:43:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:05.620749 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b712b-4390-457a-9251-6d51e8b67fe2 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:05.643338 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:05.767518 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 153/300] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:43:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 03:43:05.791889 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a104a39-d6b5-4ecf-816e-272fe035cd3e None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:05.792667 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a104a39-d6b5-4ecf-816e-272fe035cd3e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:05.793551 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a104a39-d6b5-4ecf-816e-272fe035cd3e None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:05.797046 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 154/301] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:43:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 03:43:05.805932 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4cd2a-e543-4b76-84a5-e1024b3f7334 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:05.806895 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4cd2a-e543-4b76-84a5-e1024b3f7334 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:05.806895 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4cd2a-e543-4b76-84a5-e1024b3f7334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:05.822167 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b712b-4390-457a-9251-6d51e8b67fe2 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:05.831925 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-76a4cd2a-e543-4b76-84a5-e1024b3f7334 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:43:05.833800 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-76a4cd2a-e543-4b76-84a5-e1024b3f7334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:43:05.880691 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16efa56c-8641-490a-a352-b85927e996b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:05.882005 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16efa56c-8641-490a-a352-b85927e996b3 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:05.882455 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16efa56c-8641-490a-a352-b85927e996b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:05.882925 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16efa56c-8641-490a-a352-b85927e996b3 None admin] PATH_INFO: `/v3/users/f81e47198e434454a8af568c516992fa` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:05.901373 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16efa56c-8641-490a-a352-b85927e996b3 None admin] RBAC: Authorizing `identity:get_user(user_id=f81e47198e434454a8af568c516992fa)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:05.904066 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16efa56c-8641-490a-a352-b85927e996b3 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:05.906148 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 148/302] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:43:05 2022] GET /identity/v3/users/f81e47198e434454a8af568c516992fa => generated 293 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:43:05.906861 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16efa56c-8641-490a-a352-b85927e996b3 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:05.946235 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:05.964604 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 155/303] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:43:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 03:43:05.966501 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4cd2a-e543-4b76-84a5-e1024b3f7334 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:06.030657 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:06.071927 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16efa56c-8641-490a-a352-b85927e996b3 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:06.116291 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa5cf7-ca12-4f43-8088-f616c7249f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:06.117962 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa5cf7-ca12-4f43-8088-f616c7249f4c None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:06.118708 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa5cf7-ca12-4f43-8088-f616c7249f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:06.119165 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa5cf7-ca12-4f43-8088-f616c7249f4c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:06.121659 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4cd2a-e543-4b76-84a5-e1024b3f7334 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:06.133841 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa5cf7-ca12-4f43-8088-f616c7249f4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:43:06.144612 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-2aaa5cf7-ca12-4f43-8088-f616c7249f4c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 03:43:06.144612 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:06.144612 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:06.144612 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:06.144612 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:06.144612 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:06.144612 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:06.144612 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:06.144612 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:06.144612 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:06.144612 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:06.144612 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:06.144612 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:43:06.144612 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:43:06.144612 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:43:06.144612 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:43:06.145640 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:43:06.145640 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:43:06.145640 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:43:06.145640 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:43:06.145640 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:06.145640 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:06.145640 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:06.145640 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:06.145640 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:06.145640 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:06.145640 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:06.145640 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:06.145640 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:06.145640 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:06.145640 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:06.145640 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:06.146402 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:06.146402 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:06.146402 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:06.146402 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:06.146402 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:43:06.146402 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:43:06.146402 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:43:06.146402 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:43:06.146402 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:43:06.146402 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:43:06.146402 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 03:43:06.146402 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:06.150380 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 149/304] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:43:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:06.151742 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa5cf7-ca12-4f43-8088-f616c7249f4c None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:06.194917 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d627141-c24a-47f6-8010-502e6d147e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:06.196577 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d627141-c24a-47f6-8010-502e6d147e9d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:06.196577 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d627141-c24a-47f6-8010-502e6d147e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:06.196896 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d627141-c24a-47f6-8010-502e6d147e9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:06.198261 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d627141-c24a-47f6-8010-502e6d147e9d None admin] RBAC: Adding query filter params (role.id=29f86d307e104b0bbbcf69660a405cea, user.id=f81e47198e434454a8af568c516992fa, scope.system=all) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:06.198800 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d627141-c24a-47f6-8010-502e6d147e9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:06.201947 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d627141-c24a-47f6-8010-502e6d147e9d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:06.219494 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 156/305] 10.222.0.46 () {56 vars in 1308 bytes} [Fri Jul 1 03:43:05 2022] GET /identity/v3/role_assignments?user.id=f81e47198e434454a8af568c516992fa&scope.system=all&role.id=29f86d307e104b0bbbcf69660a405cea => generated 226 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:06.219494 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d627141-c24a-47f6-8010-502e6d147e9d None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:06.294896 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa5cf7-ca12-4f43-8088-f616c7249f4c None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:06.318607 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:06.369358 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:06.376550 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c9643-a914-43a4-975e-2c6ced8752c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:06.377561 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c9643-a914-43a4-975e-2c6ced8752c8 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:06.378029 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c9643-a914-43a4-975e-2c6ced8752c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:06.378241 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c9643-a914-43a4-975e-2c6ced8752c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:06.379720 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c9643-a914-43a4-975e-2c6ced8752c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:06.381296 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c9643-a914-43a4-975e-2c6ced8752c8 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:06.383886 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 150/306] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:43:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:06.390088 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c9643-a914-43a4-975e-2c6ced8752c8 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:06.404248 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d627141-c24a-47f6-8010-502e6d147e9d None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:06.476920 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03880ff-eb7e-413c-833a-ebe75cb4ddce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:06.477617 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03880ff-eb7e-413c-833a-ebe75cb4ddce None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:06.477898 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03880ff-eb7e-413c-833a-ebe75cb4ddce None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:06.478179 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03880ff-eb7e-413c-833a-ebe75cb4ddce None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:06.478991 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03880ff-eb7e-413c-833a-ebe75cb4ddce None admin] RBAC: Adding query filter params (name=member) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:06.479304 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03880ff-eb7e-413c-833a-ebe75cb4ddce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:06.481045 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03880ff-eb7e-413c-833a-ebe75cb4ddce None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:06.510547 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 157/307] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 1 03:43:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:06.520425 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03880ff-eb7e-413c-833a-ebe75cb4ddce None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:06.576383 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c9643-a914-43a4-975e-2c6ced8752c8 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:06.655260 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d3797-b4da-4e56-87d5-afa18871c666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:06.657037 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d3797-b4da-4e56-87d5-afa18871c666 None admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:06.658248 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d3797-b4da-4e56-87d5-afa18871c666 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:06.659019 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d3797-b4da-4e56-87d5-afa18871c666 None admin] PATH_INFO: `/v3/groups` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:06.660977 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76d3797-b4da-4e56-87d5-afa18871c666 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:06.664084 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76d3797-b4da-4e56-87d5-afa18871c666 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:06.733011 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03880ff-eb7e-413c-833a-ebe75cb4ddce None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:06.760230 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 151/308] 10.222.0.46 () {60 vars in 1134 bytes} [Fri Jul 1 03:43:06 2022] POST /identity/v3/groups => generated 229 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 03:43:06.774476 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:06.807479 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37de04d-bfe4-4dc0-8c10-2d53e2e3785d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:06.809011 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37de04d-bfe4-4dc0-8c10-2d53e2e3785d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:06.809415 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37de04d-bfe4-4dc0-8c10-2d53e2e3785d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:06.809832 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37de04d-bfe4-4dc0-8c10-2d53e2e3785d None admin] PATH_INFO: `/v3/users/6400f6d73b884f6aab2394817c405bea` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:06.812214 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37de04d-bfe4-4dc0-8c10-2d53e2e3785d None admin] RBAC: Authorizing `identity:get_user(user_id=6400f6d73b884f6aab2394817c405bea)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:06.814819 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37de04d-bfe4-4dc0-8c10-2d53e2e3785d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:06.818260 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 158/309] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:43:06 2022] GET /identity/v3/users/6400f6d73b884f6aab2394817c405bea => generated 293 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:06.828580 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d3797-b4da-4e56-87d5-afa18871c666 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:06.953571 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:07.036370 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d3797-b4da-4e56-87d5-afa18871c666 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:07.066377 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6272b-4ede-4728-bf8f-4eccb993464f None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:07.066377 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6272b-4ede-4728-bf8f-4eccb993464f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:07.066377 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6272b-4ede-4728-bf8f-4eccb993464f None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:07.066377 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 159/310] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:43:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 03:43:07.067668 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c1e17-99b6-425e-8f1a-d5f630df103f None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:07.067959 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c1e17-99b6-425e-8f1a-d5f630df103f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:07.068245 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c1e17-99b6-425e-8f1a-d5f630df103f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:07.097877 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e4d43-1359-4cc1-be9a-d7bf93267c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:07.099475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e4d43-1359-4cc1-be9a-d7bf93267c59 None admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:07.101436 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e4d43-1359-4cc1-be9a-d7bf93267c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:07.101436 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e4d43-1359-4cc1-be9a-d7bf93267c59 None admin] PATH_INFO: `/v3/system/users/6400f6d73b884f6aab2394817c405bea/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:07.104597 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e4d43-1359-4cc1-be9a-d7bf93267c59 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6400f6d73b884f6aab2394817c405bea, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:07.106979 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e4d43-1359-4cc1-be9a-d7bf93267c59 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:07.110913 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-c67c1e17-99b6-425e-8f1a-d5f630df103f None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:43:07.114631 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c67c1e17-99b6-425e-8f1a-d5f630df103f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:43:07.204231 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 160/311] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:43:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:43:07.210245 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 152/312] 10.222.0.46 () {58 vars in 1334 bytes} [Fri Jul 1 03:43:06 2022] PUT /identity/v3/system/users/6400f6d73b884f6aab2394817c405bea/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 03:43:07.228538 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c1e17-99b6-425e-8f1a-d5f630df103f None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:07.345047 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c1e17-99b6-425e-8f1a-d5f630df103f None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:07.364899 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:07.386762 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e9793-3f4a-4ad8-8797-68e85ef2c731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:07.387642 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e9793-3f4a-4ad8-8797-68e85ef2c731 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:07.387926 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e9793-3f4a-4ad8-8797-68e85ef2c731 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:07.388200 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e9793-3f4a-4ad8-8797-68e85ef2c731 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:07.401594 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e9793-3f4a-4ad8-8797-68e85ef2c731 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:43:07.409676 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-d59e9793-3f4a-4ad8-8797-68e85ef2c731 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 03:43:07.409676 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:07.409676 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:07.409676 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:07.409676 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:07.409676 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:07.409676 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:07.409676 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:07.409676 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:07.409676 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:07.409676 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:07.409676 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:07.409676 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:43:07.409676 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:43:07.409676 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:43:07.409676 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:43:07.410605 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:43:07.410605 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:43:07.410605 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:43:07.410605 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:43:07.410605 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:07.410605 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:07.410605 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:07.410605 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:07.410605 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:07.410605 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:07.410605 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:07.410605 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:07.410605 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:07.410605 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:07.410605 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:07.410605 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:07.411397 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:07.411397 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:07.411397 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:07.411397 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:07.411397 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:43:07.411397 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:43:07.411397 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:43:07.411397 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:43:07.411397 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:43:07.411397 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:43:07.411397 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 03:43:07.411397 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:07.412014 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 161/313] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:43:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:07.418110 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e4d43-1359-4cc1-be9a-d7bf93267c59 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:07.534342 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e4d43-1359-4cc1-be9a-d7bf93267c59 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:07.572925 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ea05f-5005-4763-969d-32490b6ffa78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:07.573804 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ea05f-5005-4763-969d-32490b6ffa78 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:07.574099 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ea05f-5005-4763-969d-32490b6ffa78 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:07.574380 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ea05f-5005-4763-969d-32490b6ffa78 None admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:07.575179 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ea05f-5005-4763-969d-32490b6ffa78 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:07.575520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ea05f-5005-4763-969d-32490b6ffa78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:07.577420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ea05f-5005-4763-969d-32490b6ffa78 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:07.579032 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:07.589975 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 153/314] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 1 03:43:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:07.596032 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e9793-3f4a-4ad8-8797-68e85ef2c731 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:07.705856 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e9793-3f4a-4ad8-8797-68e85ef2c731 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:07.744300 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82f0b6-12fa-4823-b711-73074572f1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:07.745548 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82f0b6-12fa-4823-b711-73074572f1d6 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:07.746081 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82f0b6-12fa-4823-b711-73074572f1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:07.746548 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82f0b6-12fa-4823-b711-73074572f1d6 None admin] PATH_INFO: `/v3/users/173b14b3d3994855a6da5d7248a5f356` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:07.748103 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82f0b6-12fa-4823-b711-73074572f1d6 None admin] RBAC: Authorizing `identity:get_user(user_id=173b14b3d3994855a6da5d7248a5f356)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:07.749824 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82f0b6-12fa-4823-b711-73074572f1d6 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:07.755587 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 162/315] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:43:07 2022] GET /identity/v3/users/173b14b3d3994855a6da5d7248a5f356 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:07.758426 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ea05f-5005-4763-969d-32490b6ffa78 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:07.911165 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ea05f-5005-4763-969d-32490b6ffa78 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:07.957891 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc07f6-c5e2-4001-a5eb-24e9bfa57e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:07.958562 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc07f6-c5e2-4001-a5eb-24e9bfa57e73 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:07.958847 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc07f6-c5e2-4001-a5eb-24e9bfa57e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:07.959126 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc07f6-c5e2-4001-a5eb-24e9bfa57e73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:08.022033 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:08.041701 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc07f6-c5e2-4001-a5eb-24e9bfa57e73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:08.043210 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc07f6-c5e2-4001-a5eb-24e9bfa57e73 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:08.169913 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 154/316] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:43:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 03:43:08.179432 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82f0b6-12fa-4823-b711-73074572f1d6 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:08.266831 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:08.368164 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82f0b6-12fa-4823-b711-73074572f1d6 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:08.434491 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc9c5a-0fdb-434d-a08d-99cdd9bcd09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:08.436563 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc9c5a-0fdb-434d-a08d-99cdd9bcd09a None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:08.437380 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc9c5a-0fdb-434d-a08d-99cdd9bcd09a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:08.438168 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc9c5a-0fdb-434d-a08d-99cdd9bcd09a None admin] PATH_INFO: `/v3/projects/85b9c0c1c9a84ec8989ff665fc2b2a0d` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:08.440708 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc9c5a-0fdb-434d-a08d-99cdd9bcd09a None admin] RBAC: Authorizing `identity:get_project(project_id=85b9c0c1c9a84ec8989ff665fc2b2a0d)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:08.443714 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc9c5a-0fdb-434d-a08d-99cdd9bcd09a None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:08.451584 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 163/317] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:43:08 2022] GET /identity/v3/projects/85b9c0c1c9a84ec8989ff665fc2b2a0d => generated 302 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:08.457848 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc07f6-c5e2-4001-a5eb-24e9bfa57e73 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:08.545547 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248eb47a-084a-4032-9b9e-2dbdf2aa63fb None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:08.546537 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248eb47a-084a-4032-9b9e-2dbdf2aa63fb None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:08.547278 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248eb47a-084a-4032-9b9e-2dbdf2aa63fb None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:08.550651 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 164/318] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:43:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:43:08.557902 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:08.558078 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd4274-9e40-4320-b947-d6fc3a0e1f76 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:08.558078 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd4274-9e40-4320-b947-d6fc3a0e1f76 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:08.558078 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd4274-9e40-4320-b947-d6fc3a0e1f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:08.573842 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc07f6-c5e2-4001-a5eb-24e9bfa57e73 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:08.579079 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-f2fd4274-9e40-4320-b947-d6fc3a0e1f76 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:43:08.580618 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f2fd4274-9e40-4320-b947-d6fc3a0e1f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:43:08.611893 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e0d0c1-f66a-4ee1-b6d4-9b4bbf852fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:08.612570 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0d0c1-f66a-4ee1-b6d4-9b4bbf852fd5 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:08.612859 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0d0c1-f66a-4ee1-b6d4-9b4bbf852fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:08.613136 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0d0c1-f66a-4ee1-b6d4-9b4bbf852fd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:08.613992 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e0d0c1-f66a-4ee1-b6d4-9b4bbf852fd5 None admin] RBAC: Adding query filter params (role.id=29f86d307e104b0bbbcf69660a405cea, scope.project.id=85b9c0c1c9a84ec8989ff665fc2b2a0d, user.id=173b14b3d3994855a6da5d7248a5f356) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:08.614316 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e0d0c1-f66a-4ee1-b6d4-9b4bbf852fd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:08.615829 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e0d0c1-f66a-4ee1-b6d4-9b4bbf852fd5 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:08.623313 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 155/319] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:43:08 2022] GET /identity/v3/role_assignments?user.id=173b14b3d3994855a6da5d7248a5f356&scope.project.id=85b9c0c1c9a84ec8989ff665fc2b2a0d&role.id=29f86d307e104b0bbbcf69660a405cea => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:08.689584 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 165/320] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:43:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:43:08.715392 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e0d0c1-f66a-4ee1-b6d4-9b4bbf852fd5 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:08.834330 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e0d0c1-f66a-4ee1-b6d4-9b4bbf852fd5 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:08.875496 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5178efe-ceed-4205-8026-142141328c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:08.876333 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5178efe-ceed-4205-8026-142141328c85 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:08.876618 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5178efe-ceed-4205-8026-142141328c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:08.876896 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5178efe-ceed-4205-8026-142141328c85 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:08.891389 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5178efe-ceed-4205-8026-142141328c85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:43:08.899716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-c5178efe-ceed-4205-8026-142141328c85 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 03:43:08.899716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:08.899716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:08.899716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:08.899716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:08.899716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:08.899716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:08.899716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:08.899716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:08.899716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:08.899716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:08.899716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:08.899716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:43:08.899716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:43:08.899716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:43:08.899716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:43:08.901751 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:43:08.901751 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:43:08.901751 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:43:08.901751 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:43:08.901751 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:08.901751 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:08.901751 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:08.901751 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:08.901751 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:08.901751 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:08.901751 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:08.901751 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:08.901751 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:08.901751 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:08.901751 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:08.901751 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:08.903420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:08.903420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:08.903420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:08.903420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:08.903420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:43:08.903420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:43:08.903420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:43:08.903420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:43:08.903420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:43:08.903420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:43:08.903420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 03:43:08.903420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:08.903420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 156/321] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:43:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:08.909078 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd4274-9e40-4320-b947-d6fc3a0e1f76 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:08.984221 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:09.087916 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd4274-9e40-4320-b947-d6fc3a0e1f76 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:09.134652 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d20f9e8-89b9-4a6c-b8de-0f98f376bb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:09.135329 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20f9e8-89b9-4a6c-b8de-0f98f376bb3f None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:09.135641 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20f9e8-89b9-4a6c-b8de-0f98f376bb3f None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:09.135921 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20f9e8-89b9-4a6c-b8de-0f98f376bb3f None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:09.136678 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d20f9e8-89b9-4a6c-b8de-0f98f376bb3f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:09.136984 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d20f9e8-89b9-4a6c-b8de-0f98f376bb3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:09.143431 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d20f9e8-89b9-4a6c-b8de-0f98f376bb3f None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:09.158265 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 166/322] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 1 03:43:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:09.165246 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5178efe-ceed-4205-8026-142141328c85 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:09.186009 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:09.356311 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5178efe-ceed-4205-8026-142141328c85 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:09.412038 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e444126-4b9a-4aac-8d9a-1e4a79353b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:09.413111 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e444126-4b9a-4aac-8d9a-1e4a79353b81 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:09.413517 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e444126-4b9a-4aac-8d9a-1e4a79353b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:09.413925 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e444126-4b9a-4aac-8d9a-1e4a79353b81 None admin] PATH_INFO: `/v3/users/f81e47198e434454a8af568c516992fa` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:09.415667 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e444126-4b9a-4aac-8d9a-1e4a79353b81 None admin] RBAC: Authorizing `identity:get_user(user_id=f81e47198e434454a8af568c516992fa)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:09.417291 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e444126-4b9a-4aac-8d9a-1e4a79353b81 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:09.423535 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 157/323] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:43:09 2022] GET /identity/v3/users/f81e47198e434454a8af568c516992fa => generated 293 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:43:09.425375 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d20f9e8-89b9-4a6c-b8de-0f98f376bb3f None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:09.532603 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1bfac-9bf2-4672-b022-aec91b16cde3 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:09.533008 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1bfac-9bf2-4672-b022-aec91b16cde3 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:09.533189 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1bfac-9bf2-4672-b022-aec91b16cde3 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:09.534858 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 158/324] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 03:43:09.540717 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2da9d-1baf-49fb-a63c-55b37c587f91 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:09.541086 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2da9d-1baf-49fb-a63c-55b37c587f91 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:09.541354 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2da9d-1baf-49fb-a63c-55b37c587f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:09.558032 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d20f9e8-89b9-4a6c-b8de-0f98f376bb3f None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:09.559674 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-d5d2da9d-1baf-49fb-a63c-55b37c587f91 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:43:09.560894 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-d5d2da9d-1baf-49fb-a63c-55b37c587f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:43:09.568947 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:09.604823 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb266cf-8e0b-4815-b63d-abbdfec9e888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:09.607692 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb266cf-8e0b-4815-b63d-abbdfec9e888 None admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:09.607692 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb266cf-8e0b-4815-b63d-abbdfec9e888 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:09.608042 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb266cf-8e0b-4815-b63d-abbdfec9e888 None admin] PATH_INFO: `/v3/system/users/f81e47198e434454a8af568c516992fa/roles/29f86d307e104b0bbbcf69660a405cea` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:09.609744 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb266cf-8e0b-4815-b63d-abbdfec9e888 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f81e47198e434454a8af568c516992fa, role_id=29f86d307e104b0bbbcf69660a405cea)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:09.611295 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb266cf-8e0b-4815-b63d-abbdfec9e888 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:09.642863 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 159/325] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:43:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 03:43:09.666264 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2da9d-1baf-49fb-a63c-55b37c587f91 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:09.673664 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 167/326] 10.222.0.46 () {58 vars in 1334 bytes} [Fri Jul 1 03:43:09 2022] PUT /identity/v3/system/users/f81e47198e434454a8af568c516992fa/roles/29f86d307e104b0bbbcf69660a405cea => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 03:43:09.675160 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:09.811968 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2da9d-1baf-49fb-a63c-55b37c587f91 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:09.862717 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458cbf93-eda5-47be-900d-4a6d251a82e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:09.863933 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458cbf93-eda5-47be-900d-4a6d251a82e0 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:09.864368 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458cbf93-eda5-47be-900d-4a6d251a82e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:09.864838 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458cbf93-eda5-47be-900d-4a6d251a82e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:09.867124 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458cbf93-eda5-47be-900d-4a6d251a82e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:09.869082 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458cbf93-eda5-47be-900d-4a6d251a82e0 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:09.871652 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 160/327] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:43:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:43:09.878472 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb266cf-8e0b-4815-b63d-abbdfec9e888 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:09.999791 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb266cf-8e0b-4815-b63d-abbdfec9e888 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:10.040883 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8f0bf-1822-40b9-8bc4-49c735abeaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:10.041740 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8f0bf-1822-40b9-8bc4-49c735abeaab None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:10.042165 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8f0bf-1822-40b9-8bc4-49c735abeaab None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:10.042570 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8f0bf-1822-40b9-8bc4-49c735abeaab None admin] PATH_INFO: `/v3/groups` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:10.043407 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f8f0bf-1822-40b9-8bc4-49c735abeaab None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:10.045064 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f8f0bf-1822-40b9-8bc4-49c735abeaab None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:10.143969 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 168/328] 10.222.0.46 () {60 vars in 1134 bytes} [Fri Jul 1 03:43:09 2022] POST /identity/v3/groups => generated 226 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 03:43:10.352293 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf5ff2-7a3b-405b-b9e0-98d967f74a75 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:10.352774 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf5ff2-7a3b-405b-b9e0-98d967f74a75 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:10.353248 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf5ff2-7a3b-405b-b9e0-98d967f74a75 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:10.355855 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 161/329] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:43:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:43:10.363532 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c077b4-e6ab-436b-93af-cdd33cd1b5c7 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:10.363863 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c077b4-e6ab-436b-93af-cdd33cd1b5c7 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:10.364316 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c077b4-e6ab-436b-93af-cdd33cd1b5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:10.383897 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-13c077b4-e6ab-436b-93af-cdd33cd1b5c7 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:43:10.385104 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-13c077b4-e6ab-436b-93af-cdd33cd1b5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:43:10.426380 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:10.509787 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 169/330] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:43:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:43:10.551885 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf5ff2-7a3b-405b-b9e0-98d967f74a75 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:10.688976 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:10.734305 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf5ff2-7a3b-405b-b9e0-98d967f74a75 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:10.801812 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb672e6a-2450-49c5-8ffb-24d9aa76f069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:10.803186 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb672e6a-2450-49c5-8ffb-24d9aa76f069 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:10.803760 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb672e6a-2450-49c5-8ffb-24d9aa76f069 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:10.804229 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb672e6a-2450-49c5-8ffb-24d9aa76f069 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:10.825973 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb672e6a-2450-49c5-8ffb-24d9aa76f069 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:43:10.834093 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-cb672e6a-2450-49c5-8ffb-24d9aa76f069 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 03:43:10.834093 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:10.834093 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:10.834093 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:10.834093 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:10.834093 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:10.834093 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:10.834093 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:10.834093 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:10.834093 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:10.834093 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:10.834093 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:10.834093 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:43:10.834093 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:43:10.834093 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:43:10.834093 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:43:10.835618 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:43:10.835618 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:43:10.835618 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:43:10.835618 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:43:10.835618 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:10.835618 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:10.835618 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:10.835618 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:10.835618 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:10.835618 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:10.835618 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:10.835618 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:10.835618 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:10.835618 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:10.835618 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:10.835618 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:10.836428 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:10.836428 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:10.836428 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:10.836428 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:10.836428 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:43:10.836428 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:43:10.836428 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:43:10.836428 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:43:10.836428 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:43:10.836428 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:43:10.836428 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 03:43:10.836428 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:10.839163 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 162/331] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:43:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:10.847379 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c077b4-e6ab-436b-93af-cdd33cd1b5c7 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:11.079186 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c077b4-e6ab-436b-93af-cdd33cd1b5c7 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:11.148061 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527a19c-d161-4f15-a710-df74394324da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:11.149226 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527a19c-d161-4f15-a710-df74394324da None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:11.149728 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527a19c-d161-4f15-a710-df74394324da None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:11.150226 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527a19c-d161-4f15-a710-df74394324da None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:11.151729 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a527a19c-d161-4f15-a710-df74394324da None admin] RBAC: Adding query filter params (name=member) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:11.152262 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a527a19c-d161-4f15-a710-df74394324da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:11.155009 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a527a19c-d161-4f15-a710-df74394324da None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:11.170962 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 170/332] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 1 03:43:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:11.180495 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb672e6a-2450-49c5-8ffb-24d9aa76f069 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:11.371697 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb672e6a-2450-49c5-8ffb-24d9aa76f069 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:11.415589 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d10df-95b6-46b5-ada1-e29267babcc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:11.416510 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d10df-95b6-46b5-ada1-e29267babcc5 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:11.416794 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d10df-95b6-46b5-ada1-e29267babcc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:11.417070 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d10df-95b6-46b5-ada1-e29267babcc5 None admin] PATH_INFO: `/v3/users/6400f6d73b884f6aab2394817c405bea` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:11.418387 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d10df-95b6-46b5-ada1-e29267babcc5 None admin] RBAC: Authorizing `identity:get_user(user_id=6400f6d73b884f6aab2394817c405bea)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:11.419885 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d10df-95b6-46b5-ada1-e29267babcc5 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:11.421923 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 163/333] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:43:11 2022] GET /identity/v3/users/6400f6d73b884f6aab2394817c405bea => generated 293 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:11.431875 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527a19c-d161-4f15-a710-df74394324da None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:11.496751 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:11.675500 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527a19c-d161-4f15-a710-df74394324da None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:11.760918 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d6c00-8df2-4774-b26c-aba97375fb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:11.761986 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d6c00-8df2-4774-b26c-aba97375fb82 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:11.762456 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d6c00-8df2-4774-b26c-aba97375fb82 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:11.762943 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d6c00-8df2-4774-b26c-aba97375fb82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:11.764592 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d6c00-8df2-4774-b26c-aba97375fb82 None admin] RBAC: Adding query filter params (role.id=c0b595782ebc410db693ef7fa70522a3, user.id=6400f6d73b884f6aab2394817c405bea, scope.system=all) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:11.765160 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d6c00-8df2-4774-b26c-aba97375fb82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:11.768107 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d6c00-8df2-4774-b26c-aba97375fb82 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:11.798445 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 171/334] 10.222.0.46 () {56 vars in 1308 bytes} [Fri Jul 1 03:43:11 2022] GET /identity/v3/role_assignments?user.id=6400f6d73b884f6aab2394817c405bea&scope.system=all&role.id=c0b595782ebc410db693ef7fa70522a3 => generated 510 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:12.310486 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2246ee1-4889-4c57-ae39-d9c4034c670e None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:12.310991 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2246ee1-4889-4c57-ae39-d9c4034c670e None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:12.311097 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2246ee1-4889-4c57-ae39-d9c4034c670e None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:12.312822 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 164/335] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:43:12.318669 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82902133-917b-4ef8-a856-1ab387750d16 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:12.318960 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82902133-917b-4ef8-a856-1ab387750d16 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:12.319827 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82902133-917b-4ef8-a856-1ab387750d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:12.341104 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-82902133-917b-4ef8-a856-1ab387750d16 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:43:12.342326 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-82902133-917b-4ef8-a856-1ab387750d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:43:12.425650 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 172/336] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:43:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 03:43:12.470087 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2246ee1-4889-4c57-ae39-d9c4034c670e None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:12.474989 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:12.730803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2246ee1-4889-4c57-ae39-d9c4034c670e None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:12.815291 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267168b-cd7f-4629-8f8f-269efeff33a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:12.816778 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267168b-cd7f-4629-8f8f-269efeff33a6 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:12.817285 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267168b-cd7f-4629-8f8f-269efeff33a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:12.817691 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267168b-cd7f-4629-8f8f-269efeff33a6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:12.846893 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0267168b-cd7f-4629-8f8f-269efeff33a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:43:12.860331 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-0267168b-cd7f-4629-8f8f-269efeff33a6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 03:43:12.860331 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:12.860331 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:12.860331 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:12.860331 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:12.860331 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:12.860331 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:12.860331 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:12.860331 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:12.860331 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:12.860331 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:12.860331 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:12.860331 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:43:12.860331 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:43:12.860331 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:43:12.860331 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:43:12.861289 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:43:12.861289 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:43:12.861289 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:43:12.861289 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:43:12.861289 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:12.861289 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:12.861289 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:12.861289 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:12.861289 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:12.861289 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:12.861289 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:12.861289 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:12.861289 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:12.861289 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:12.861289 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:12.861289 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:12.862074 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:12.862074 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:12.862074 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:12.862074 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:12.862074 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:43:12.862074 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:43:12.862074 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:43:12.862074 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:43:12.862074 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:43:12.862074 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:43:12.862074 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 03:43:12.862074 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:12.863241 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 165/337] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:43:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 03:43:12.869233 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82902133-917b-4ef8-a856-1ab387750d16 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:12.899811 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:13.018801 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82902133-917b-4ef8-a856-1ab387750d16 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:13.069866 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a07c7-5e96-49aa-a3b2-45c8b119a0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:13.070952 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a07c7-5e96-49aa-a3b2-45c8b119a0d9 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:13.071489 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a07c7-5e96-49aa-a3b2-45c8b119a0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:13.071970 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a07c7-5e96-49aa-a3b2-45c8b119a0d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:13.072984 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a07c7-5e96-49aa-a3b2-45c8b119a0d9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:13.073504 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a07c7-5e96-49aa-a3b2-45c8b119a0d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:13.075297 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a07c7-5e96-49aa-a3b2-45c8b119a0d9 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:13.090168 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 173/338] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 1 03:43:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:13.096245 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267168b-cd7f-4629-8f8f-269efeff33a6 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:13.262603 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:13.351198 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267168b-cd7f-4629-8f8f-269efeff33a6 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:13.393504 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732b860-d029-4e1e-813a-2a7229caa0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:13.394413 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732b860-d029-4e1e-813a-2a7229caa0d3 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:13.394700 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732b860-d029-4e1e-813a-2a7229caa0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:13.394978 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732b860-d029-4e1e-813a-2a7229caa0d3 None admin] PATH_INFO: `/v3/users/f81e47198e434454a8af568c516992fa` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:13.396357 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732b860-d029-4e1e-813a-2a7229caa0d3 None admin] RBAC: Authorizing `identity:get_user(user_id=f81e47198e434454a8af568c516992fa)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:13.398406 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732b860-d029-4e1e-813a-2a7229caa0d3 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:13.400490 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 166/339] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:43:13 2022] GET /identity/v3/users/f81e47198e434454a8af568c516992fa => generated 293 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:13.407114 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a07c7-5e96-49aa-a3b2-45c8b119a0d9 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:13.410965 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ec423-3bc3-4cec-87ae-ad820a21a7d5 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:13.411254 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ec423-3bc3-4cec-87ae-ad820a21a7d5 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:13.411567 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ec423-3bc3-4cec-87ae-ad820a21a7d5 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:13.413539 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 167/340] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:43:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 03:43:13.425351 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b68afd-9f7b-4513-8dbd-28107fd4e433 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:13.425565 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b68afd-9f7b-4513-8dbd-28107fd4e433 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:13.425765 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b68afd-9f7b-4513-8dbd-28107fd4e433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:13.466636 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-b8b68afd-9f7b-4513-8dbd-28107fd4e433 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:43:13.468913 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-b8b68afd-9f7b-4513-8dbd-28107fd4e433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:43:13.648122 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:13.703348 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 168/341] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:43:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 03:43:13.741685 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a07c7-5e96-49aa-a3b2-45c8b119a0d9 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:13.750329 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b68afd-9f7b-4513-8dbd-28107fd4e433 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:13.856174 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2ac5b-3dad-42fc-8530-1d04bdad3127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:13.857354 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2ac5b-3dad-42fc-8530-1d04bdad3127 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:13.857863 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2ac5b-3dad-42fc-8530-1d04bdad3127 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:13.858376 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2ac5b-3dad-42fc-8530-1d04bdad3127 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:13.860115 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f2ac5b-3dad-42fc-8530-1d04bdad3127 None admin] RBAC: Adding query filter params (role.id=29f86d307e104b0bbbcf69660a405cea, user.id=f81e47198e434454a8af568c516992fa, scope.system=all) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:13.860694 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f2ac5b-3dad-42fc-8530-1d04bdad3127 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:13.864312 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f2ac5b-3dad-42fc-8530-1d04bdad3127 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:13.894028 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 174/342] 10.222.0.46 () {56 vars in 1308 bytes} [Fri Jul 1 03:43:13 2022] GET /identity/v3/role_assignments?user.id=f81e47198e434454a8af568c516992fa&scope.system=all&role.id=29f86d307e104b0bbbcf69660a405cea => generated 510 bytes in 488 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:13.919574 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:14.014485 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b68afd-9f7b-4513-8dbd-28107fd4e433 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:14.079306 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e723b-5a84-488c-84c4-785091e5458d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:14.080160 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e723b-5a84-488c-84c4-785091e5458d None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:14.080448 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e723b-5a84-488c-84c4-785091e5458d None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:14.080728 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e723b-5a84-488c-84c4-785091e5458d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:14.098165 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e723b-5a84-488c-84c4-785091e5458d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:43:14.111547 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-6c8e723b-5a84-488c-84c4-785091e5458d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 03:43:14.111547 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:14.111547 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:14.111547 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:14.111547 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:14.111547 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:14.111547 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:14.111547 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:14.111547 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:14.111547 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:14.111547 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:14.111547 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:14.111547 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:43:14.111547 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:43:14.111547 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:43:14.111547 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:43:14.112520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:43:14.112520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:43:14.112520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:43:14.112520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:43:14.112520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:14.112520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:14.112520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:14.112520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:14.112520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:14.112520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:14.112520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:14.112520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:14.112520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:14.112520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:14.112520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:14.112520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:14.113783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:14.113783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:14.113783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:14.113783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:14.113783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:43:14.113783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:43:14.113783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:43:14.113783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:43:14.113783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:43:14.113783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:43:14.113783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 03:43:14.113783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:14.113783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 169/343] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:43:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:14.119504 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2ac5b-3dad-42fc-8530-1d04bdad3127 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:14.359741 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2ac5b-3dad-42fc-8530-1d04bdad3127 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:14.416526 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:14.431412 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426af131-8274-423f-acd0-3bc1e16b5374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:14.432138 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426af131-8274-423f-acd0-3bc1e16b5374 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:14.436718 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426af131-8274-423f-acd0-3bc1e16b5374 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:14.436718 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426af131-8274-423f-acd0-3bc1e16b5374 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:14.436718 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426af131-8274-423f-acd0-3bc1e16b5374 None admin] RBAC: Adding query filter params (name=member) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:14.436718 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426af131-8274-423f-acd0-3bc1e16b5374 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:14.436718 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426af131-8274-423f-acd0-3bc1e16b5374 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:14.448593 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 175/344] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 1 03:43:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:14.453995 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e723b-5a84-488c-84c4-785091e5458d None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:14.590945 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e723b-5a84-488c-84c4-785091e5458d None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:14.616919 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:14.637395 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc7807-9ad0-48bc-bfb8-7b289f661791 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:14.637818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc7807-9ad0-48bc-bfb8-7b289f661791 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:14.637989 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc7807-9ad0-48bc-bfb8-7b289f661791 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:14.639415 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5480e2-518a-4c32-960e-ce01c9db657b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:14.639591 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 176/345] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:43:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:43:14.640148 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5480e2-518a-4c32-960e-ce01c9db657b None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:14.640406 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5480e2-518a-4c32-960e-ce01c9db657b None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:14.640693 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5480e2-518a-4c32-960e-ce01c9db657b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:14.665430 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910d34a-1e39-4f07-8fb6-1bcfcd1ba745 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:14.665753 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910d34a-1e39-4f07-8fb6-1bcfcd1ba745 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:14.666014 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910d34a-1e39-4f07-8fb6-1bcfcd1ba745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:14.691598 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-d910d34a-1e39-4f07-8fb6-1bcfcd1ba745 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:43:14.692893 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d910d34a-1e39-4f07-8fb6-1bcfcd1ba745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:43:14.766621 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5480e2-518a-4c32-960e-ce01c9db657b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:14.768162 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5480e2-518a-4c32-960e-ce01c9db657b None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:14.882095 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 177/346] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:43:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:43:14.893683 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 170/347] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:43:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 03:43:14.900281 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910d34a-1e39-4f07-8fb6-1bcfcd1ba745 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:14.938480 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5480e2-518a-4c32-960e-ce01c9db657b None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:14.985492 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:15.121860 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910d34a-1e39-4f07-8fb6-1bcfcd1ba745 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:15.145948 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5480e2-518a-4c32-960e-ce01c9db657b None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:15.166695 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:15.196296 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de31ba2-9fee-4cff-ba92-5e40f9e31266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:15.198722 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de31ba2-9fee-4cff-ba92-5e40f9e31266 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:15.198722 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de31ba2-9fee-4cff-ba92-5e40f9e31266 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:15.198722 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de31ba2-9fee-4cff-ba92-5e40f9e31266 None admin] PATH_INFO: `/v3/projects/c908bfb9e6e34f1589114650c691c8c1` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:15.202246 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de31ba2-9fee-4cff-ba92-5e40f9e31266 None admin] RBAC: Authorizing `identity:get_project(project_id=c908bfb9e6e34f1589114650c691c8c1)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:15.207319 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de31ba2-9fee-4cff-ba92-5e40f9e31266 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:15.211894 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 178/348] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:43:14 2022] GET /identity/v3/projects/c908bfb9e6e34f1589114650c691c8c1 => generated 298 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:15.214688 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b02a13-0687-4a8c-a251-27d1cc150b97 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:15.215315 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b02a13-0687-4a8c-a251-27d1cc150b97 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:15.215924 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b02a13-0687-4a8c-a251-27d1cc150b97 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:15.218537 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 179/349] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:43:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:43:15.221310 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef78c1-e577-4c5a-8813-6fb650984e99 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:15.221732 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef78c1-e577-4c5a-8813-6fb650984e99 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:15.222283 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef78c1-e577-4c5a-8813-6fb650984e99 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:15.226763 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 180/350] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:43:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:43:15.228342 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef78c1-e577-4c5a-8813-6fb650984e99 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:15.230173 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24596790-92b1-4aed-96f4-04a7c38c236d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:15.232600 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24596790-92b1-4aed-96f4-04a7c38c236d None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:15.233479 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24596790-92b1-4aed-96f4-04a7c38c236d None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:15.234287 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24596790-92b1-4aed-96f4-04a7c38c236d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:15.255628 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24596790-92b1-4aed-96f4-04a7c38c236d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:43:15.271608 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-24596790-92b1-4aed-96f4-04a7c38c236d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 03:43:15.271608 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:15.271608 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:15.271608 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:15.271608 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:15.271608 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:15.271608 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:15.271608 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:15.271608 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:15.271608 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:15.271608 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:15.271608 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:15.271608 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:43:15.271608 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:43:15.271608 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:43:15.271608 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:43:15.273145 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:43:15.273145 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:43:15.273145 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:43:15.273145 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:43:15.273145 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:15.273145 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:15.273145 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:15.273145 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:15.273145 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:15.273145 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:15.273145 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:15.273145 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:15.273145 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:15.273145 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:15.273145 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:15.273145 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:15.273944 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:15.273944 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:15.273944 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:15.273944 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:15.273944 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:43:15.273944 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:43:15.273944 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:43:15.273944 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:43:15.273944 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:43:15.273944 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:43:15.273944 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 03:43:15.273944 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:15.274710 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 171/351] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:43:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 03:43:15.279018 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2545844-3633-4de9-b0cc-1992eb173bf9 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:15.279633 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2545844-3633-4de9-b0cc-1992eb173bf9 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:15.280114 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2545844-3633-4de9-b0cc-1992eb173bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:15.302579 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-d2545844-3633-4de9-b0cc-1992eb173bf9 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:43:15.304201 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-d2545844-3633-4de9-b0cc-1992eb173bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:43:15.413669 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 172/352] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:43:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:43:15.415590 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd5df9-d97d-4ebc-bf46-7c7296432f5e None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:15.415937 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd5df9-d97d-4ebc-bf46-7c7296432f5e None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:15.416364 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd5df9-d97d-4ebc-bf46-7c7296432f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:15.448699 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef78c1-e577-4c5a-8813-6fb650984e99 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:15.452201 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-10cd5df9-d97d-4ebc-bf46-7c7296432f5e None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:43:15.455151 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-10cd5df9-d97d-4ebc-bf46-7c7296432f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:43:15.461420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:15.501465 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c1ec3-a036-4c5f-84d6-8214a5e263cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:15.502359 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c1ec3-a036-4c5f-84d6-8214a5e263cb None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:15.502638 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c1ec3-a036-4c5f-84d6-8214a5e263cb None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:15.503651 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c1ec3-a036-4c5f-84d6-8214a5e263cb None admin] PATH_INFO: `/v3/groups/e23549ddf078436694d5d2fecff54008` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:15.517425 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8c1ec3-a036-4c5f-84d6-8214a5e263cb None admin] RBAC: Authorizing `identity:get_group(group_id=e23549ddf078436694d5d2fecff54008)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:15.519241 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8c1ec3-a036-4c5f-84d6-8214a5e263cb None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:15.520832 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 181/353] 10.222.0.46 () {56 vars in 1180 bytes} [Fri Jul 1 03:43:15 2022] GET /identity/v3/groups/e23549ddf078436694d5d2fecff54008 => generated 226 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:15.521663 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c1ec3-a036-4c5f-84d6-8214a5e263cb None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:15.609601 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:15.614165 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 173/354] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:43:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:43:15.615058 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd5df9-d97d-4ebc-bf46-7c7296432f5e None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:15.730796 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c1ec3-a036-4c5f-84d6-8214a5e263cb None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:15.767661 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd5df9-d97d-4ebc-bf46-7c7296432f5e None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:15.809193 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712ebfc-0e4f-47ec-aaa0-309ee0c13edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:15.810243 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712ebfc-0e4f-47ec-aaa0-309ee0c13edc None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:15.810738 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712ebfc-0e4f-47ec-aaa0-309ee0c13edc None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:15.811235 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712ebfc-0e4f-47ec-aaa0-309ee0c13edc None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:15.812637 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712ebfc-0e4f-47ec-aaa0-309ee0c13edc None admin] RBAC: Adding query filter params (name=member) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:15.813193 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712ebfc-0e4f-47ec-aaa0-309ee0c13edc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:15.815383 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712ebfc-0e4f-47ec-aaa0-309ee0c13edc None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:15.820067 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07feb74c-4385-4240-bcef-e52b06778c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:15.821394 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07feb74c-4385-4240-bcef-e52b06778c89 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:15.821890 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07feb74c-4385-4240-bcef-e52b06778c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:15.822375 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07feb74c-4385-4240-bcef-e52b06778c89 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:15.832251 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:15.833463 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 182/355] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 1 03:43:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:15.835067 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712ebfc-0e4f-47ec-aaa0-309ee0c13edc None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:15.838044 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07feb74c-4385-4240-bcef-e52b06778c89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:43:15.847092 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-07feb74c-4385-4240-bcef-e52b06778c89 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 03:43:15.847092 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:15.847092 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:15.847092 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:15.847092 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:15.847092 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:15.847092 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:15.847092 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:15.847092 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:15.847092 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:15.847092 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:15.847092 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:15.847092 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:43:15.847092 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:43:15.847092 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:43:15.847092 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:43:15.852458 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:43:15.852458 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:43:15.852458 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:43:15.852458 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:43:15.852458 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:15.852458 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:15.852458 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:15.852458 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:15.852458 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:15.852458 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:15.852458 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:15.852458 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:15.852458 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:15.852458 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:15.852458 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:15.852458 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:15.853360 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:15.853360 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:15.853360 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:15.853360 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:15.853360 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:43:15.853360 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:43:15.853360 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:43:15.853360 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:43:15.853360 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:43:15.853360 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:43:15.853360 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 03:43:15.853360 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:15.853360 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 174/356] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Jul 1 03:43:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:15.853360 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07feb74c-4385-4240-bcef-e52b06778c89 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:15.997012 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712ebfc-0e4f-47ec-aaa0-309ee0c13edc None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:16.008936 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07feb74c-4385-4240-bcef-e52b06778c89 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:16.015169 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:16.039983 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9e795-8090-423d-8c7c-c8ada5bf4e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:16.040958 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9e795-8090-423d-8c7c-c8ada5bf4e69 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:16.041394 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9e795-8090-423d-8c7c-c8ada5bf4e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:16.041820 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9e795-8090-423d-8c7c-c8ada5bf4e69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:16.042829 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9e795-8090-423d-8c7c-c8ada5bf4e69 None admin] RBAC: Adding query filter params (group.id=e23549ddf078436694d5d2fecff54008, role.id=c0b595782ebc410db693ef7fa70522a3, scope.project.id=c908bfb9e6e34f1589114650c691c8c1) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:16.043321 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9e795-8090-423d-8c7c-c8ada5bf4e69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:16.045002 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9e795-8090-423d-8c7c-c8ada5bf4e69 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:16.052513 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 183/357] 10.222.0.46 () {56 vars in 1376 bytes} [Fri Jul 1 03:43:15 2022] GET /identity/v3/role_assignments?group.id=e23549ddf078436694d5d2fecff54008&scope.project.id=c908bfb9e6e34f1589114650c691c8c1&role.id=c0b595782ebc410db693ef7fa70522a3 => generated 260 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:16.055265 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d608dd-e9a4-41a1-a5c4-00530993402e None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:16.055723 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d608dd-e9a4-41a1-a5c4-00530993402e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:16.056099 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d608dd-e9a4-41a1-a5c4-00530993402e None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:16.058243 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 184/358] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:43:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:43:16.059071 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d608dd-e9a4-41a1-a5c4-00530993402e None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:16.080932 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062a6b8-060e-4ff7-805a-7fb54c7dfcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:16.082718 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062a6b8-060e-4ff7-805a-7fb54c7dfcff None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:16.084699 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062a6b8-060e-4ff7-805a-7fb54c7dfcff None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:16.084699 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062a6b8-060e-4ff7-805a-7fb54c7dfcff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:16.106660 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3062a6b8-060e-4ff7-805a-7fb54c7dfcff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:43:16.124518 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-3062a6b8-060e-4ff7-805a-7fb54c7dfcff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 03:43:16.124518 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:16.124518 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:16.124518 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:16.124518 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:16.124518 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:16.124518 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:16.124518 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:16.124518 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:16.124518 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:16.124518 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:16.124518 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:16.124518 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:43:16.124518 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:43:16.124518 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:43:16.124518 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:43:16.125508 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:43:16.125508 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:43:16.125508 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:43:16.125508 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:43:16.125508 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:16.125508 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:16.125508 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:16.125508 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:16.125508 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:16.125508 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:16.125508 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:16.125508 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:16.125508 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:16.125508 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:16.125508 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:16.125508 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:16.126336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:16.126336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:16.126336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:16.126336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:16.126336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:43:16.126336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:43:16.126336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:43:16.126336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:43:16.126336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:43:16.126336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:43:16.126336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 03:43:16.126336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:16.126954 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 175/359] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Jul 1 03:43:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:16.129737 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062a6b8-060e-4ff7-805a-7fb54c7dfcff None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:16.253695 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:16.253934 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d608dd-e9a4-41a1-a5c4-00530993402e None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:16.321226 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd59af51-3e3a-4825-a046-f7e0905747f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:16.322367 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59af51-3e3a-4825-a046-f7e0905747f1 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:16.322824 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59af51-3e3a-4825-a046-f7e0905747f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:16.323562 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59af51-3e3a-4825-a046-f7e0905747f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:16.330255 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062a6b8-060e-4ff7-805a-7fb54c7dfcff None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:16.395127 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:16.416137 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9a093-0b4b-4611-8793-02e5d56bb750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:16.417694 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9a093-0b4b-4611-8793-02e5d56bb750 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:16.418396 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9a093-0b4b-4611-8793-02e5d56bb750 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:16.419123 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9a093-0b4b-4611-8793-02e5d56bb750 None admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:16.420875 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a9a093-0b4b-4611-8793-02e5d56bb750 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:16.421709 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a9a093-0b4b-4611-8793-02e5d56bb750 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:16.424658 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a9a093-0b4b-4611-8793-02e5d56bb750 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:16.435734 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd59af51-3e3a-4825-a046-f7e0905747f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:16.437188 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 176/360] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:43:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:16.438752 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b019a1c-653b-45ba-89a3-37e6ef9173ea None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:16.439180 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b019a1c-653b-45ba-89a3-37e6ef9173ea None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:16.439511 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd59af51-3e3a-4825-a046-f7e0905747f1 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:16.439792 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b019a1c-653b-45ba-89a3-37e6ef9173ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:16.465943 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-2b019a1c-653b-45ba-89a3-37e6ef9173ea None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:43:16.468976 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-2b019a1c-653b-45ba-89a3-37e6ef9173ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:43:16.610224 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 177/361] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:43:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:43:16.611144 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b019a1c-653b-45ba-89a3-37e6ef9173ea None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:16.659864 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 185/362] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:43:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 03:43:16.661777 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd59af51-3e3a-4825-a046-f7e0905747f1 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:16.693012 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:16.776714 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b019a1c-653b-45ba-89a3-37e6ef9173ea None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:16.821068 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:16.848875 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd6099-5c9d-47ab-a296-3b71562382a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:16.849684 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd6099-5c9d-47ab-a296-3b71562382a4 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:16.849835 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd6099-5c9d-47ab-a296-3b71562382a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:16.850638 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd6099-5c9d-47ab-a296-3b71562382a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:16.851415 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd6099-5c9d-47ab-a296-3b71562382a4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:16.851778 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd6099-5c9d-47ab-a296-3b71562382a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:16.853194 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd6099-5c9d-47ab-a296-3b71562382a4 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:16.866851 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 178/363] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:43:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:16.867529 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd6099-5c9d-47ab-a296-3b71562382a4 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:16.882632 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd59af51-3e3a-4825-a046-f7e0905747f1 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:16.963363 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27acfa0a-936f-4768-a2d1-ca82302cb664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:16.964186 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acfa0a-936f-4768-a2d1-ca82302cb664 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:16.964473 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acfa0a-936f-4768-a2d1-ca82302cb664 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:16.964754 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acfa0a-936f-4768-a2d1-ca82302cb664 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:17.051685 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd6099-5c9d-47ab-a296-3b71562382a4 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:17.076012 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:17.110338 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27acfa0a-936f-4768-a2d1-ca82302cb664 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:17.112778 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e636a-7120-44f9-9b31-113f3205dc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:17.114261 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e636a-7120-44f9-9b31-113f3205dc50 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:17.114740 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e636a-7120-44f9-9b31-113f3205dc50 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:17.117602 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e636a-7120-44f9-9b31-113f3205dc50 None admin] PATH_INFO: `/v3/projects/85b9c0c1c9a84ec8989ff665fc2b2a0d` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:17.117797 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27acfa0a-936f-4768-a2d1-ca82302cb664 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:17.118034 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5e636a-7120-44f9-9b31-113f3205dc50 None admin] RBAC: Authorizing `identity:get_project(project_id=85b9c0c1c9a84ec8989ff665fc2b2a0d)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:17.121424 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5e636a-7120-44f9-9b31-113f3205dc50 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:17.126677 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 179/364] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:43:16 2022] GET /identity/v3/projects/85b9c0c1c9a84ec8989ff665fc2b2a0d => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:17.128417 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e636a-7120-44f9-9b31-113f3205dc50 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:17.277609 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:17.293021 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 186/365] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:43:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 03:43:17.294012 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27acfa0a-936f-4768-a2d1-ca82302cb664 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:17.348498 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e636a-7120-44f9-9b31-113f3205dc50 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:17.398633 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e6620-46f9-4836-bb2f-0c879002a9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:17.399996 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e6620-46f9-4836-bb2f-0c879002a9d5 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:17.400475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e6620-46f9-4836-bb2f-0c879002a9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:17.400957 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e6620-46f9-4836-bb2f-0c879002a9d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:17.422345 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e6620-46f9-4836-bb2f-0c879002a9d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:43:17.438113 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-957e6620-46f9-4836-bb2f-0c879002a9d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:43:17.438113 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:17.438113 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:17.438113 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:17.438113 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:17.438113 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:17.438113 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:17.438113 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:17.438113 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:17.438113 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:17.438113 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:17.438113 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:17.438113 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:43:17.438113 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:43:17.438113 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:43:17.438113 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:43:17.439963 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:43:17.439963 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:43:17.439963 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:43:17.439963 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:43:17.439963 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:17.439963 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:17.439963 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:17.439963 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:17.439963 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:17.439963 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:17.439963 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:17.439963 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:17.439963 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:17.439963 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:17.439963 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:17.439963 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:17.441505 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:17.441505 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:17.441505 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:17.441505 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:17.441505 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:43:17.441505 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:43:17.441505 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:43:17.441505 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:43:17.441505 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:43:17.441505 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:43:17.441505 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:43:17.441505 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:17.441505 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 180/366] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 1 03:43:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:17.441505 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e6620-46f9-4836-bb2f-0c879002a9d5 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:17.494457 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27acfa0a-936f-4768-a2d1-ca82302cb664 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:17.549007 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:17.570468 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230bcda-7acb-429c-8973-edb7b8d329e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:17.571686 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230bcda-7acb-429c-8973-edb7b8d329e7 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:17.572201 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230bcda-7acb-429c-8973-edb7b8d329e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:17.572660 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230bcda-7acb-429c-8973-edb7b8d329e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:17.654309 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e6620-46f9-4836-bb2f-0c879002a9d5 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:17.677423 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:17.713498 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b230bcda-7acb-429c-8973-edb7b8d329e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:17.716582 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b230bcda-7acb-429c-8973-edb7b8d329e7 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:17.723055 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b7c24-5d1a-4cab-b7c2-917cb61bbeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:17.724558 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b7c24-5d1a-4cab-b7c2-917cb61bbeaf None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:17.725620 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b7c24-5d1a-4cab-b7c2-917cb61bbeaf None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:17.726102 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b7c24-5d1a-4cab-b7c2-917cb61bbeaf None admin] PATH_INFO: `/v3/groups/e23549ddf078436694d5d2fecff54008` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:17.727615 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01b7c24-5d1a-4cab-b7c2-917cb61bbeaf None admin] RBAC: Authorizing `identity:get_group(group_id=e23549ddf078436694d5d2fecff54008)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:17.729166 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01b7c24-5d1a-4cab-b7c2-917cb61bbeaf None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:17.730968 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 181/367] 10.222.0.46 () {56 vars in 1180 bytes} [Fri Jul 1 03:43:17 2022] GET /identity/v3/groups/e23549ddf078436694d5d2fecff54008 => generated 226 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:17.731847 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b7c24-5d1a-4cab-b7c2-917cb61bbeaf None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:17.913931 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 187/368] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:43:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 03:43:17.916228 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230bcda-7acb-429c-8973-edb7b8d329e7 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:17.928998 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b7c24-5d1a-4cab-b7c2-917cb61bbeaf None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:17.949268 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:17.993715 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c7e80-243d-4b73-9b2a-0318c99222af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:17.995232 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c7e80-243d-4b73-9b2a-0318c99222af None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:17.995774 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c7e80-243d-4b73-9b2a-0318c99222af None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:17.996262 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c7e80-243d-4b73-9b2a-0318c99222af None admin] PATH_INFO: `/v3/projects/c908bfb9e6e34f1589114650c691c8c1` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:17.998426 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0c7e80-243d-4b73-9b2a-0318c99222af None admin] RBAC: Authorizing `identity:get_project(project_id=c908bfb9e6e34f1589114650c691c8c1)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:18.001151 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0c7e80-243d-4b73-9b2a-0318c99222af None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:18.008826 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 182/369] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:43:17 2022] GET /identity/v3/projects/c908bfb9e6e34f1589114650c691c8c1 => generated 298 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:18.008826 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c7e80-243d-4b73-9b2a-0318c99222af None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:18.065047 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:18.107007 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230bcda-7acb-429c-8973-edb7b8d329e7 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:18.158263 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c7e80-243d-4b73-9b2a-0318c99222af None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:18.171325 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3431b4-e24e-422d-821a-525249176eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:18.172441 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3431b4-e24e-422d-821a-525249176eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:18.172915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3431b4-e24e-422d-821a-525249176eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:18.173429 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3431b4-e24e-422d-821a-525249176eb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:18.174825 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3431b4-e24e-422d-821a-525249176eb1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:18.175619 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3431b4-e24e-422d-821a-525249176eb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:18.178279 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3431b4-e24e-422d-821a-525249176eb1 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:18.200415 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 188/370] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:43:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:18.200415 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3431b4-e24e-422d-821a-525249176eb1 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:18.210509 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb284ea-7a57-4104-a4f3-34aac0045c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:18.211359 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb284ea-7a57-4104-a4f3-34aac0045c18 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:18.211803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb284ea-7a57-4104-a4f3-34aac0045c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:18.212211 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb284ea-7a57-4104-a4f3-34aac0045c18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:18.213590 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb284ea-7a57-4104-a4f3-34aac0045c18 None admin] RBAC: Adding query filter params (group.id=e23549ddf078436694d5d2fecff54008, role.id=c0b595782ebc410db693ef7fa70522a3, scope.project.id=85b9c0c1c9a84ec8989ff665fc2b2a0d) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:18.214051 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb284ea-7a57-4104-a4f3-34aac0045c18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:18.215781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb284ea-7a57-4104-a4f3-34aac0045c18 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:18.223275 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 183/371] 10.222.0.46 () {56 vars in 1376 bytes} [Fri Jul 1 03:43:18 2022] GET /identity/v3/role_assignments?group.id=e23549ddf078436694d5d2fecff54008&scope.project.id=85b9c0c1c9a84ec8989ff665fc2b2a0d&role.id=c0b595782ebc410db693ef7fa70522a3 => generated 260 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:18.224428 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb284ea-7a57-4104-a4f3-34aac0045c18 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:18.330480 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:18.430355 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3431b4-e24e-422d-821a-525249176eb1 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:18.454862 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb284ea-7a57-4104-a4f3-34aac0045c18 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:18.512976 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66f7a54-f3a8-4ccd-b323-2e20adf5cb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:18.519846 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f7a54-f3a8-4ccd-b323-2e20adf5cb2f None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:18.520569 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f7a54-f3a8-4ccd-b323-2e20adf5cb2f None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:18.521285 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f7a54-f3a8-4ccd-b323-2e20adf5cb2f None admin] PATH_INFO: `/v3/projects/85b9c0c1c9a84ec8989ff665fc2b2a0d` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:18.523848 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66f7a54-f3a8-4ccd-b323-2e20adf5cb2f None admin] RBAC: Authorizing `identity:get_project(project_id=85b9c0c1c9a84ec8989ff665fc2b2a0d)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:18.525174 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19a4da-dc46-43a6-81ac-984f01638575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:18.526716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19a4da-dc46-43a6-81ac-984f01638575 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:18.527222 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19a4da-dc46-43a6-81ac-984f01638575 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:18.527476 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66f7a54-f3a8-4ccd-b323-2e20adf5cb2f None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:18.527764 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19a4da-dc46-43a6-81ac-984f01638575 None admin] PATH_INFO: `/v3/groups/e23549ddf078436694d5d2fecff54008` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:18.529991 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a19a4da-dc46-43a6-81ac-984f01638575 None admin] RBAC: Authorizing `identity:get_group(group_id=e23549ddf078436694d5d2fecff54008)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:18.531783 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 189/372] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:43:18 2022] GET /identity/v3/projects/85b9c0c1c9a84ec8989ff665fc2b2a0d => generated 302 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:18.533424 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a19a4da-dc46-43a6-81ac-984f01638575 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:18.533916 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66f7a54-f3a8-4ccd-b323-2e20adf5cb2f None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:18.537958 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 184/373] 10.222.0.46 () {56 vars in 1180 bytes} [Fri Jul 1 03:43:18 2022] GET /identity/v3/groups/e23549ddf078436694d5d2fecff54008 => generated 226 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:18.549069 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19a4da-dc46-43a6-81ac-984f01638575 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:18.555358 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:18.741071 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19a4da-dc46-43a6-81ac-984f01638575 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:18.741440 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66f7a54-f3a8-4ccd-b323-2e20adf5cb2f None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:18.766558 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:18.801696 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311d8e0-5b9e-4170-b3e1-501253073dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:18.803250 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311d8e0-5b9e-4170-b3e1-501253073dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:18.804063 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311d8e0-5b9e-4170-b3e1-501253073dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:18.804821 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311d8e0-5b9e-4170-b3e1-501253073dc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:18.813200 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64c812-1d83-4f95-9eb5-f46d890e444d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:18.814035 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64c812-1d83-4f95-9eb5-f46d890e444d None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:18.814520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64c812-1d83-4f95-9eb5-f46d890e444d None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:18.814997 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64c812-1d83-4f95-9eb5-f46d890e444d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:18.816533 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f64c812-1d83-4f95-9eb5-f46d890e444d None admin] RBAC: Adding query filter params (group.id=e23549ddf078436694d5d2fecff54008, role.id=132287c7d1f9428d9195f2b4ed60756b, scope.project.id=c908bfb9e6e34f1589114650c691c8c1) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:18.817082 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f64c812-1d83-4f95-9eb5-f46d890e444d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:18.819672 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f64c812-1d83-4f95-9eb5-f46d890e444d None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:18.835489 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 185/374] 10.222.0.46 () {56 vars in 1376 bytes} [Fri Jul 1 03:43:18 2022] GET /identity/v3/role_assignments?group.id=e23549ddf078436694d5d2fecff54008&scope.project.id=c908bfb9e6e34f1589114650c691c8c1&role.id=132287c7d1f9428d9195f2b4ed60756b => generated 260 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:18.835489 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64c812-1d83-4f95-9eb5-f46d890e444d None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:19.021056 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c311d8e0-5b9e-4170-b3e1-501253073dc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:19.024635 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c311d8e0-5b9e-4170-b3e1-501253073dc6 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:19.052784 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:19.109135 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64c812-1d83-4f95-9eb5-f46d890e444d None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:19.240796 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16072b-215e-4ff7-b3d4-75a9e7be7fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:19.242674 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16072b-215e-4ff7-b3d4-75a9e7be7fad None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:19.243355 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16072b-215e-4ff7-b3d4-75a9e7be7fad None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:19.244067 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16072b-215e-4ff7-b3d4-75a9e7be7fad None admin] PATH_INFO: `/v3/groups/e23549ddf078436694d5d2fecff54008` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:19.250134 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee16072b-215e-4ff7-b3d4-75a9e7be7fad None admin] RBAC: Authorizing `identity:get_group(group_id=e23549ddf078436694d5d2fecff54008)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:19.254408 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee16072b-215e-4ff7-b3d4-75a9e7be7fad None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:19.260936 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 186/375] 10.222.0.46 () {56 vars in 1180 bytes} [Fri Jul 1 03:43:18 2022] GET /identity/v3/groups/e23549ddf078436694d5d2fecff54008 => generated 226 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:19.263744 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0018b3-1159-43e3-b696-cadf33596695 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:19.264532 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0018b3-1159-43e3-b696-cadf33596695 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:19.265207 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0018b3-1159-43e3-b696-cadf33596695 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:19.268595 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 187/376] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:43:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:43:19.270455 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0018b3-1159-43e3-b696-cadf33596695 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:19.357093 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:19.383506 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 190/377] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:43:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 851 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 03:43:19.389123 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08fd8a-e071-4b7d-9033-a15604b6cf7d None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:19.389495 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08fd8a-e071-4b7d-9033-a15604b6cf7d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:19.389724 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08fd8a-e071-4b7d-9033-a15604b6cf7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:19.425826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-4a08fd8a-e071-4b7d-9033-a15604b6cf7d None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:43:19.427052 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-4a08fd8a-e071-4b7d-9033-a15604b6cf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:43:19.504885 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0018b3-1159-43e3-b696-cadf33596695 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:19.573862 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92fb59-4125-47ef-bc52-cd9daa080dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:19.575432 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92fb59-4125-47ef-bc52-cd9daa080dea None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:19.575962 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92fb59-4125-47ef-bc52-cd9daa080dea None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:19.576439 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92fb59-4125-47ef-bc52-cd9daa080dea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:19.577503 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a92fb59-4125-47ef-bc52-cd9daa080dea None admin] RBAC: Adding query filter params (group.id=e23549ddf078436694d5d2fecff54008, role.id=132287c7d1f9428d9195f2b4ed60756b, scope.project.id=85b9c0c1c9a84ec8989ff665fc2b2a0d) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:19.578032 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a92fb59-4125-47ef-bc52-cd9daa080dea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:19.579795 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a92fb59-4125-47ef-bc52-cd9daa080dea None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:19.586697 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 188/378] 10.222.0.46 () {56 vars in 1376 bytes} [Fri Jul 1 03:43:19 2022] GET /identity/v3/role_assignments?group.id=e23549ddf078436694d5d2fecff54008&scope.project.id=85b9c0c1c9a84ec8989ff665fc2b2a0d&role.id=132287c7d1f9428d9195f2b4ed60756b => generated 260 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:19.587940 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92fb59-4125-47ef-bc52-cd9daa080dea None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:19.634009 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 191/379] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:43:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:43:19.673657 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08fd8a-e071-4b7d-9033-a15604b6cf7d None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:19.736974 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92fb59-4125-47ef-bc52-cd9daa080dea None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:19.746000 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:19.778719 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673843f6-7768-4070-88af-8c64ba770f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:19.780022 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673843f6-7768-4070-88af-8c64ba770f67 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:19.780512 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673843f6-7768-4070-88af-8c64ba770f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:19.781024 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673843f6-7768-4070-88af-8c64ba770f67 None admin] PATH_INFO: `/v3/projects/e246a3f333f94971a10397b9c77aad47` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:19.783356 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673843f6-7768-4070-88af-8c64ba770f67 None admin] RBAC: Authorizing `identity:get_project(project_id=e246a3f333f94971a10397b9c77aad47)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:19.785258 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673843f6-7768-4070-88af-8c64ba770f67 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:19.788532 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 189/380] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:43:19 2022] GET /identity/v3/projects/e246a3f333f94971a10397b9c77aad47 => generated 344 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:19.810636 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:19.813575 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673843f6-7768-4070-88af-8c64ba770f67 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:19.939589 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673843f6-7768-4070-88af-8c64ba770f67 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:19.983178 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f68d6a-7e12-487d-a7f4-52d6c47cf943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:19.984659 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f68d6a-7e12-487d-a7f4-52d6c47cf943 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:19.985200 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f68d6a-7e12-487d-a7f4-52d6c47cf943 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:19.985707 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f68d6a-7e12-487d-a7f4-52d6c47cf943 None admin] PATH_INFO: `/v3/groups/5ef33f42771346d3be3d788947cbf0ea` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:19.993421 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f68d6a-7e12-487d-a7f4-52d6c47cf943 None admin] RBAC: Authorizing `identity:get_group(group_id=5ef33f42771346d3be3d788947cbf0ea)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:19.995369 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f68d6a-7e12-487d-a7f4-52d6c47cf943 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:19.997770 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 190/381] 10.222.0.46 () {56 vars in 1180 bytes} [Fri Jul 1 03:43:19 2022] GET /identity/v3/groups/5ef33f42771346d3be3d788947cbf0ea => generated 229 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:43:20.006584 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f68d6a-7e12-487d-a7f4-52d6c47cf943 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:20.029623 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08fd8a-e071-4b7d-9033-a15604b6cf7d None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:20.064011 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:20.125213 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb91f54-97dc-4309-8b0a-19ad7301ebcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:20.126745 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb91f54-97dc-4309-8b0a-19ad7301ebcc None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:20.127214 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb91f54-97dc-4309-8b0a-19ad7301ebcc None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:20.127801 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb91f54-97dc-4309-8b0a-19ad7301ebcc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:20.144823 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f68d6a-7e12-487d-a7f4-52d6c47cf943 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:20.172085 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb91f54-97dc-4309-8b0a-19ad7301ebcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:43:20.190616 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e6d45-a280-4ecc-85b8-9618c562785b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:20.191705 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e6d45-a280-4ecc-85b8-9618c562785b None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:20.192215 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e6d45-a280-4ecc-85b8-9618c562785b None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:20.192687 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e6d45-a280-4ecc-85b8-9618c562785b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:20.193776 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7e6d45-a280-4ecc-85b8-9618c562785b None admin] RBAC: Adding query filter params (group.id=5ef33f42771346d3be3d788947cbf0ea, role.id=681755518698445fabd9a8accec13c0f, scope.project.id=e246a3f333f94971a10397b9c77aad47) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:20.194315 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7e6d45-a280-4ecc-85b8-9618c562785b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:20.196101 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7e6d45-a280-4ecc-85b8-9618c562785b None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:20.196696 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-5bb91f54-97dc-4309-8b0a-19ad7301ebcc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 03:43:20.196696 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:20.196696 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:20.196696 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:20.196696 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:20.196696 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:20.196696 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:20.196696 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:20.196696 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:20.196696 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:20.196696 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:20.196696 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:20.196696 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:43:20.196696 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:43:20.196696 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:43:20.196696 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:43:20.197533 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:43:20.197533 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:43:20.197533 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:43:20.197533 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:43:20.197533 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:20.197533 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:20.197533 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:20.197533 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:20.197533 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:20.197533 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:20.197533 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:20.197533 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:20.197533 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:20.197533 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:20.197533 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:20.197533 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:20.198322 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:20.198322 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:20.198322 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:20.198322 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:20.198322 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:43:20.198322 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:43:20.198322 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:43:20.198322 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:43:20.198322 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:43:20.198322 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:43:20.198322 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 03:43:20.198322 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:20.205958 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 191/382] 10.222.0.46 () {56 vars in 1376 bytes} [Fri Jul 1 03:43:20 2022] GET /identity/v3/role_assignments?group.id=5ef33f42771346d3be3d788947cbf0ea&scope.project.id=e246a3f333f94971a10397b9c77aad47&role.id=681755518698445fabd9a8accec13c0f => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:43:20.211783 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 192/383] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:43:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 535 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:20.218156 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb91f54-97dc-4309-8b0a-19ad7301ebcc None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:20.422836 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:20.428146 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb91f54-97dc-4309-8b0a-19ad7301ebcc None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:20.467215 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a9b26-bcc3-40de-bc8f-ae244f46b50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:20.468346 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a9b26-bcc3-40de-bc8f-ae244f46b50d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:20.469061 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a9b26-bcc3-40de-bc8f-ae244f46b50d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:20.469549 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a9b26-bcc3-40de-bc8f-ae244f46b50d None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:20.470518 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a9b26-bcc3-40de-bc8f-ae244f46b50d None admin] RBAC: Adding query filter params (name=member) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:20.471009 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a9b26-bcc3-40de-bc8f-ae244f46b50d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:20.472793 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a9b26-bcc3-40de-bc8f-ae244f46b50d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:20.501303 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 193/384] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 1 03:43:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:20.507519 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e6d45-a280-4ecc-85b8-9618c562785b None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:20.634419 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e6d45-a280-4ecc-85b8-9618c562785b None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:20.636094 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:20.673350 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345927ff-4398-4d54-8cfb-7daf17a714a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:20.674310 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345927ff-4398-4d54-8cfb-7daf17a714a3 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:20.674601 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345927ff-4398-4d54-8cfb-7daf17a714a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:20.674856 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345927ff-4398-4d54-8cfb-7daf17a714a3 None admin] PATH_INFO: `/v3/groups/e23549ddf078436694d5d2fecff54008` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:20.676120 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345927ff-4398-4d54-8cfb-7daf17a714a3 None admin] RBAC: Authorizing `identity:get_group(group_id=e23549ddf078436694d5d2fecff54008)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:20.677593 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345927ff-4398-4d54-8cfb-7daf17a714a3 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:20.680379 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 192/385] 10.222.0.46 () {56 vars in 1180 bytes} [Fri Jul 1 03:43:20 2022] GET /identity/v3/groups/e23549ddf078436694d5d2fecff54008 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:20.685891 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a9b26-bcc3-40de-bc8f-ae244f46b50d None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:20.840763 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a9b26-bcc3-40de-bc8f-ae244f46b50d None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:20.903950 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1d5ed-0553-4ea3-b461-56185ab31d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:20.905946 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1d5ed-0553-4ea3-b461-56185ab31d36 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:20.906725 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1d5ed-0553-4ea3-b461-56185ab31d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:20.907567 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1d5ed-0553-4ea3-b461-56185ab31d36 None admin] PATH_INFO: `/v3/projects/c908bfb9e6e34f1589114650c691c8c1` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:20.909870 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1d5ed-0553-4ea3-b461-56185ab31d36 None admin] RBAC: Authorizing `identity:get_project(project_id=c908bfb9e6e34f1589114650c691c8c1)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:20.913054 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1d5ed-0553-4ea3-b461-56185ab31d36 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:20.917441 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 194/386] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:43:20 2022] GET /identity/v3/projects/c908bfb9e6e34f1589114650c691c8c1 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:20.922837 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345927ff-4398-4d54-8cfb-7daf17a714a3 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:21.061075 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345927ff-4398-4d54-8cfb-7daf17a714a3 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:21.102450 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4784add-19bf-418c-85dc-6e2188524102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:21.103316 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4784add-19bf-418c-85dc-6e2188524102 None admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:21.103641 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4784add-19bf-418c-85dc-6e2188524102 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:21.103920 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4784add-19bf-418c-85dc-6e2188524102 None admin] PATH_INFO: `/v3/projects/c908bfb9e6e34f1589114650c691c8c1/groups/e23549ddf078436694d5d2fecff54008/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:21.106411 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4784add-19bf-418c-85dc-6e2188524102 None admin] RBAC: Authorizing `identity:create_grant(project_id=c908bfb9e6e34f1589114650c691c8c1, group_id=e23549ddf078436694d5d2fecff54008, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:21.107988 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4784add-19bf-418c-85dc-6e2188524102 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:21.188142 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 193/387] 10.222.0.46 () {58 vars in 1442 bytes} [Fri Jul 1 03:43:20 2022] PUT /identity/v3/projects/c908bfb9e6e34f1589114650c691c8c1/groups/e23549ddf078436694d5d2fecff54008/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 03:43:21.305609 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c70c6-1f5f-4b8f-bb07-40a009dd1bc3 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:21.306579 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c70c6-1f5f-4b8f-bb07-40a009dd1bc3 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:21.307357 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c70c6-1f5f-4b8f-bb07-40a009dd1bc3 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:21.310804 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 195/388] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:43:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:43:21.321759 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598121d-27c9-4d4b-9fda-d59f9a5107e0 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:21.322605 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598121d-27c9-4d4b-9fda-d59f9a5107e0 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:21.323295 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598121d-27c9-4d4b-9fda-d59f9a5107e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:21.363939 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-f598121d-27c9-4d4b-9fda-d59f9a5107e0 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:43:21.366386 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-f598121d-27c9-4d4b-9fda-d59f9a5107e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:43:21.435794 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:21.542245 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 194/389] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:43:21.588344 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c70c6-1f5f-4b8f-bb07-40a009dd1bc3 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:21.636091 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:21.735584 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c70c6-1f5f-4b8f-bb07-40a009dd1bc3 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:21.784980 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9bf9a-e684-4cf1-b0b3-de1b20acf293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:21.785857 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9bf9a-e684-4cf1-b0b3-de1b20acf293 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:21.786091 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9bf9a-e684-4cf1-b0b3-de1b20acf293 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:21.786370 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9bf9a-e684-4cf1-b0b3-de1b20acf293 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:21.808203 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9bf9a-e684-4cf1-b0b3-de1b20acf293 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:43:21.816271 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-30e9bf9a-e684-4cf1-b0b3-de1b20acf293 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 03:43:21.816271 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:21.816271 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:21.816271 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:21.816271 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:21.816271 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:21.816271 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:21.816271 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:21.816271 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:21.816271 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:21.816271 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:21.816271 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:21.816271 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:43:21.816271 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:43:21.816271 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:43:21.816271 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:43:21.817239 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:43:21.817239 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:43:21.817239 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:43:21.817239 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:43:21.817239 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:21.817239 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:21.817239 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:21.817239 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:21.817239 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:21.817239 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:21.817239 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:21.817239 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:21.817239 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:21.817239 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:21.817239 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:21.817239 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:21.818029 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:21.818029 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:21.818029 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:21.818029 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:21.818029 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:43:21.818029 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:43:21.818029 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:43:21.818029 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:43:21.818029 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:43:21.818029 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:43:21.818029 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 03:43:21.818029 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:21.818029 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 196/390] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:43:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:21.827719 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598121d-27c9-4d4b-9fda-d59f9a5107e0 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:21.881719 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c3dc9-11c8-4e08-a625-97a40257843d None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:21.882006 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c3dc9-11c8-4e08-a625-97a40257843d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:21.882283 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c3dc9-11c8-4e08-a625-97a40257843d None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:21.883986 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 197/391] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:43:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:43:21.889848 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d56c3-cda8-47c0-b804-985d099663de None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:21.890039 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d56c3-cda8-47c0-b804-985d099663de None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:21.890310 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d56c3-cda8-47c0-b804-985d099663de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:21.940295 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-8a6d56c3-cda8-47c0-b804-985d099663de None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:43:21.942191 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8a6d56c3-cda8-47c0-b804-985d099663de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:43:21.954685 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598121d-27c9-4d4b-9fda-d59f9a5107e0 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:21.996624 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f26ec-3309-432f-a74e-d324204a832a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:21.997642 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f26ec-3309-432f-a74e-d324204a832a None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:21.998824 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f26ec-3309-432f-a74e-d324204a832a None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:21.999488 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f26ec-3309-432f-a74e-d324204a832a None admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:22.000440 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f26ec-3309-432f-a74e-d324204a832a None admin] RBAC: Adding query filter params (name=member) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:22.001741 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f26ec-3309-432f-a74e-d324204a832a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:22.003480 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f26ec-3309-432f-a74e-d324204a832a None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:22.024423 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 195/392] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 1 03:43:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:22.034084 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f26ec-3309-432f-a74e-d324204a832a None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:22.115771 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:22.135153 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 198/393] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 03:43:22.158747 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d56c3-cda8-47c0-b804-985d099663de None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:22.223829 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:22.369265 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f26ec-3309-432f-a74e-d324204a832a None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:22.440886 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04db304-88ae-435a-8998-61272c9412c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:22.442303 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04db304-88ae-435a-8998-61272c9412c1 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:22.442792 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04db304-88ae-435a-8998-61272c9412c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:22.443937 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04db304-88ae-435a-8998-61272c9412c1 None admin] PATH_INFO: `/v3/groups/e23549ddf078436694d5d2fecff54008` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:22.451188 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04db304-88ae-435a-8998-61272c9412c1 None admin] RBAC: Authorizing `identity:get_group(group_id=e23549ddf078436694d5d2fecff54008)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:22.453864 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04db304-88ae-435a-8998-61272c9412c1 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:22.459165 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 196/394] 10.222.0.46 () {56 vars in 1180 bytes} [Fri Jul 1 03:43:22 2022] GET /identity/v3/groups/e23549ddf078436694d5d2fecff54008 => generated 226 bytes in 427 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:43:22.464159 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d56c3-cda8-47c0-b804-985d099663de None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:22.468857 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04db304-88ae-435a-8998-61272c9412c1 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:22.598868 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37994010-0fcb-4c67-9b8f-2e9765e90f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:22.600413 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37994010-0fcb-4c67-9b8f-2e9765e90f2c None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:22.600897 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37994010-0fcb-4c67-9b8f-2e9765e90f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:22.601358 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37994010-0fcb-4c67-9b8f-2e9765e90f2c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:22.644308 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37994010-0fcb-4c67-9b8f-2e9765e90f2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:43:22.684220 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-37994010-0fcb-4c67-9b8f-2e9765e90f2c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 03:43:22.684220 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:22.684220 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:22.684220 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:22.684220 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:22.684220 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:22.684220 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:22.684220 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:22.684220 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:22.684220 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:22.684220 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:22.684220 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:22.684220 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:43:22.684220 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:43:22.684220 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:43:22.684220 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:43:22.685186 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:43:22.685186 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:43:22.685186 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:43:22.685186 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:43:22.685186 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:22.685186 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:22.685186 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:22.685186 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:22.685186 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:22.685186 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:22.685186 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:22.685186 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:22.685186 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:22.685186 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:22.685186 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:22.685186 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:22.685985 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:22.685985 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:22.685985 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:22.685985 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:22.685985 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:43:22.685985 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:43:22.685985 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:43:22.685985 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:43:22.685985 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:43:22.685985 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:43:22.685985 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 03:43:22.685985 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:22.690189 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 199/395] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Jul 1 03:43:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 533 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 03:43:22.697346 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37994010-0fcb-4c67-9b8f-2e9765e90f2c None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:22.758648 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:22.811094 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04db304-88ae-435a-8998-61272c9412c1 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:22.861777 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:22.906273 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37994010-0fcb-4c67-9b8f-2e9765e90f2c None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:22.941877 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f12fcb-8544-453c-ac50-c9d1a6fec003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:22.943377 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f12fcb-8544-453c-ac50-c9d1a6fec003 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:22.943885 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f12fcb-8544-453c-ac50-c9d1a6fec003 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:22.944376 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f12fcb-8544-453c-ac50-c9d1a6fec003 None admin] PATH_INFO: `/v3/projects/85b9c0c1c9a84ec8989ff665fc2b2a0d` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:22.953105 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f12fcb-8544-453c-ac50-c9d1a6fec003 None admin] RBAC: Authorizing `identity:get_project(project_id=85b9c0c1c9a84ec8989ff665fc2b2a0d)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:22.955705 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f12fcb-8544-453c-ac50-c9d1a6fec003 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:22.962696 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 197/396] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:43:22 2022] GET /identity/v3/projects/85b9c0c1c9a84ec8989ff665fc2b2a0d => generated 302 bytes in 492 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:22.962696 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91776675-9a7f-4550-8a60-04180d497c1f None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:22.962696 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91776675-9a7f-4550-8a60-04180d497c1f None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:22.962696 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91776675-9a7f-4550-8a60-04180d497c1f None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:22.964037 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 198/397] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:43:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:43:22.969563 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c47c7b-b2a9-41e7-900a-65e307a6ef67 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:22.970141 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c47c7b-b2a9-41e7-900a-65e307a6ef67 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:22.970454 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c47c7b-b2a9-41e7-900a-65e307a6ef67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:22.974968 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca7fd1a-0d4e-4093-a5dd-dd4976353b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:22.976534 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7fd1a-0d4e-4093-a5dd-dd4976353b9a None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:22.977260 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7fd1a-0d4e-4093-a5dd-dd4976353b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:22.978049 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7fd1a-0d4e-4093-a5dd-dd4976353b9a None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:22.979850 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca7fd1a-0d4e-4093-a5dd-dd4976353b9a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:22.980727 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca7fd1a-0d4e-4093-a5dd-dd4976353b9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:22.983770 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca7fd1a-0d4e-4093-a5dd-dd4976353b9a None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:22.989384 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-b1c47c7b-b2a9-41e7-900a-65e307a6ef67 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:43:22.991376 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-b1c47c7b-b2a9-41e7-900a-65e307a6ef67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:43:23.002074 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 200/398] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:43:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:23.003974 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca7fd1a-0d4e-4093-a5dd-dd4976353b9a None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:23.075629 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 199/399] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:43:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:43:23.077190 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c47c7b-b2a9-41e7-900a-65e307a6ef67 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:23.203437 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca7fd1a-0d4e-4093-a5dd-dd4976353b9a None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:23.225585 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:23.250135 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c47c7b-b2a9-41e7-900a-65e307a6ef67 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:23.258616 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db27c1aa-7609-4f4b-9e48-c00c13eb139f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:23.260483 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27c1aa-7609-4f4b-9e48-c00c13eb139f None admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:23.262311 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27c1aa-7609-4f4b-9e48-c00c13eb139f None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:23.262805 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27c1aa-7609-4f4b-9e48-c00c13eb139f None admin] PATH_INFO: `/v3/projects/85b9c0c1c9a84ec8989ff665fc2b2a0d/groups/e23549ddf078436694d5d2fecff54008/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:23.268860 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db27c1aa-7609-4f4b-9e48-c00c13eb139f None admin] RBAC: Authorizing `identity:create_grant(project_id=85b9c0c1c9a84ec8989ff665fc2b2a0d, group_id=e23549ddf078436694d5d2fecff54008, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:23.274103 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db27c1aa-7609-4f4b-9e48-c00c13eb139f None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:23.296265 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10caee91-340d-45bd-a04d-7cc9c62f0ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:23.297139 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10caee91-340d-45bd-a04d-7cc9c62f0ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:23.297446 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10caee91-340d-45bd-a04d-7cc9c62f0ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:23.297737 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10caee91-340d-45bd-a04d-7cc9c62f0ce6 None admin] PATH_INFO: `/v3/groups/e23549ddf078436694d5d2fecff54008` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:23.298990 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10caee91-340d-45bd-a04d-7cc9c62f0ce6 None admin] RBAC: Authorizing `identity:get_group(group_id=e23549ddf078436694d5d2fecff54008)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:23.300481 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10caee91-340d-45bd-a04d-7cc9c62f0ce6 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:23.302205 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 200/400] 10.222.0.46 () {56 vars in 1180 bytes} [Fri Jul 1 03:43:23 2022] GET /identity/v3/groups/e23549ddf078436694d5d2fecff54008 => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:23.303534 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10caee91-340d-45bd-a04d-7cc9c62f0ce6 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:23.356050 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:23.370412 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 201/401] 10.222.0.46 () {58 vars in 1442 bytes} [Fri Jul 1 03:43:23 2022] PUT /identity/v3/projects/85b9c0c1c9a84ec8989ff665fc2b2a0d/groups/e23549ddf078436694d5d2fecff54008/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 03:43:23.372477 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db27c1aa-7609-4f4b-9e48-c00c13eb139f None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:23.553335 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10caee91-340d-45bd-a04d-7cc9c62f0ce6 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:23.651244 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5998d2-b2d2-47d6-a9a1-6d05b9f4b9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:23.652731 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5998d2-b2d2-47d6-a9a1-6d05b9f4b9af None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:23.653210 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5998d2-b2d2-47d6-a9a1-6d05b9f4b9af None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:23.653697 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5998d2-b2d2-47d6-a9a1-6d05b9f4b9af None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:23.668984 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5998d2-b2d2-47d6-a9a1-6d05b9f4b9af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:43:23.670606 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db27c1aa-7609-4f4b-9e48-c00c13eb139f None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:23.679664 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-fa5998d2-b2d2-47d6-a9a1-6d05b9f4b9af None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 03:43:23.679664 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:23.679664 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:23.679664 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:23.679664 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:23.679664 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:23.679664 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:23.679664 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:23.679664 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:23.679664 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:23.679664 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:23.679664 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:23.679664 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:43:23.679664 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:43:23.679664 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:43:23.679664 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:43:23.680616 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:43:23.680616 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:43:23.680616 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:43:23.680616 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:43:23.680616 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:23.680616 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:23.680616 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:23.680616 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:23.680616 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:23.680616 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:23.680616 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:23.680616 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:23.680616 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:23.680616 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:23.680616 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:23.680616 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:23.681497 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:23.681497 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:23.681497 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:23.681497 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:23.681497 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:43:23.681497 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:43:23.681497 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:43:23.681497 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:43:23.681497 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:43:23.681497 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:43:23.681497 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 03:43:23.681497 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:23.684983 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 201/402] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Jul 1 03:43:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:23.686604 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99dc78-b0a3-4a88-baee-96d19fba49d4 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:23.687095 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99dc78-b0a3-4a88-baee-96d19fba49d4 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:23.687635 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99dc78-b0a3-4a88-baee-96d19fba49d4 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:23.690069 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 202/403] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:43:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:43:23.696319 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99dc78-b0a3-4a88-baee-96d19fba49d4 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:23.721338 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:23.742178 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3334e4-637a-4930-aa1e-13653d3e0d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:23.743411 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3334e4-637a-4930-aa1e-13653d3e0d14 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:23.748392 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3334e4-637a-4930-aa1e-13653d3e0d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:23.748392 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3334e4-637a-4930-aa1e-13653d3e0d14 None admin] PATH_INFO: `/v3/projects/c908bfb9e6e34f1589114650c691c8c1` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:23.748392 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3334e4-637a-4930-aa1e-13653d3e0d14 None admin] RBAC: Authorizing `identity:get_project(project_id=c908bfb9e6e34f1589114650c691c8c1)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:23.748392 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3334e4-637a-4930-aa1e-13653d3e0d14 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:23.751973 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 202/404] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:43:23 2022] GET /identity/v3/projects/c908bfb9e6e34f1589114650c691c8c1 => generated 298 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:23.754029 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5899f-4372-4456-92df-c36fdd764cff None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:23.754587 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5899f-4372-4456-92df-c36fdd764cff None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:23.755313 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5899f-4372-4456-92df-c36fdd764cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:23.775933 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-dba5899f-4372-4456-92df-c36fdd764cff None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:43:23.777489 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-dba5899f-4372-4456-92df-c36fdd764cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:43:23.847814 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:23.854476 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 203/405] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:43:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:43:23.860639 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5899f-4372-4456-92df-c36fdd764cff None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:23.932777 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99dc78-b0a3-4a88-baee-96d19fba49d4 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:23.974554 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5899f-4372-4456-92df-c36fdd764cff None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:24.000792 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52078d45-e61b-41d8-9d7d-f6f5dd770351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:24.001986 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52078d45-e61b-41d8-9d7d-f6f5dd770351 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:24.002615 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52078d45-e61b-41d8-9d7d-f6f5dd770351 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:24.003109 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52078d45-e61b-41d8-9d7d-f6f5dd770351 None admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:24.004769 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52078d45-e61b-41d8-9d7d-f6f5dd770351 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:24.005239 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52078d45-e61b-41d8-9d7d-f6f5dd770351 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:24.008667 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52078d45-e61b-41d8-9d7d-f6f5dd770351 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:24.017074 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7438a4-4896-4469-8336-9421bc5b3956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:24.018458 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7438a4-4896-4469-8336-9421bc5b3956 None admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:24.018948 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7438a4-4896-4469-8336-9421bc5b3956 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:24.019485 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7438a4-4896-4469-8336-9421bc5b3956 None admin] PATH_INFO: `/v3/projects/c908bfb9e6e34f1589114650c691c8c1/groups/e23549ddf078436694d5d2fecff54008/roles/132287c7d1f9428d9195f2b4ed60756b` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:24.022890 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7438a4-4896-4469-8336-9421bc5b3956 None admin] RBAC: Authorizing `identity:create_grant(project_id=c908bfb9e6e34f1589114650c691c8c1, group_id=e23549ddf078436694d5d2fecff54008, role_id=132287c7d1f9428d9195f2b4ed60756b)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:24.025085 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7438a4-4896-4469-8336-9421bc5b3956 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:24.027728 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 203/406] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:43:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:24.029593 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52078d45-e61b-41d8-9d7d-f6f5dd770351 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:24.130499 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:24.138168 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 204/407] 10.222.0.46 () {58 vars in 1442 bytes} [Fri Jul 1 03:43:23 2022] PUT /identity/v3/projects/c908bfb9e6e34f1589114650c691c8c1/groups/e23549ddf078436694d5d2fecff54008/roles/132287c7d1f9428d9195f2b4ed60756b => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 03:43:24.140791 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7438a4-4896-4469-8336-9421bc5b3956 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:24.159169 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52078d45-e61b-41d8-9d7d-f6f5dd770351 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:24.215105 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6d7c1-8590-4d14-a397-3e5eb2271976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:24.216022 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6d7c1-8590-4d14-a397-3e5eb2271976 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:24.216315 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6d7c1-8590-4d14-a397-3e5eb2271976 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:24.216670 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6d7c1-8590-4d14-a397-3e5eb2271976 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:24.230503 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de6d7c1-8590-4d14-a397-3e5eb2271976 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:43:24.238553 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-3de6d7c1-8590-4d14-a397-3e5eb2271976 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:43:24.238553 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:24.238553 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:24.238553 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:24.238553 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:24.238553 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:24.238553 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:24.238553 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:24.238553 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:24.238553 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:24.238553 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:24.238553 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:24.238553 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:43:24.238553 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:43:24.238553 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:43:24.238553 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:43:24.240416 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:43:24.240416 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:43:24.240416 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:43:24.240416 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:43:24.240416 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:24.240416 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:24.240416 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:24.240416 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:24.240416 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:24.240416 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:24.240416 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:24.240416 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:24.240416 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:24.240416 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:24.240416 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:24.240416 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:24.242046 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:24.242046 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:24.242046 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:24.242046 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:24.242046 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:43:24.242046 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:43:24.242046 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:43:24.242046 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:43:24.242046 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:43:24.242046 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:43:24.242046 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:43:24.242046 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:24.242046 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 204/408] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 1 03:43:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:24.246384 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d48b7b-8c6b-440e-86a1-78a2b9f3df97 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:24.246661 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d48b7b-8c6b-440e-86a1-78a2b9f3df97 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:24.246939 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d48b7b-8c6b-440e-86a1-78a2b9f3df97 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:24.248762 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 205/409] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:43:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:43:24.249567 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d48b7b-8c6b-440e-86a1-78a2b9f3df97 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:24.315385 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:24.392167 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d48b7b-8c6b-440e-86a1-78a2b9f3df97 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:24.397770 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7438a4-4896-4469-8336-9421bc5b3956 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:24.440565 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0791ed-89dd-4423-a166-dc40cd71a77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:24.443747 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0791ed-89dd-4423-a166-dc40cd71a77c None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:24.444923 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0791ed-89dd-4423-a166-dc40cd71a77c None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:24.446028 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0791ed-89dd-4423-a166-dc40cd71a77c None admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:24.448781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0791ed-89dd-4423-a166-dc40cd71a77c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:24.450608 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0791ed-89dd-4423-a166-dc40cd71a77c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:24.453978 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0791ed-89dd-4423-a166-dc40cd71a77c None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:24.455591 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348076f0-a66f-40fd-93c2-e5a337f28d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:24.456523 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348076f0-a66f-40fd-93c2-e5a337f28d0e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:24.456803 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348076f0-a66f-40fd-93c2-e5a337f28d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:24.457078 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348076f0-a66f-40fd-93c2-e5a337f28d0e None admin] PATH_INFO: `/v3/groups/e23549ddf078436694d5d2fecff54008` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:24.458473 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348076f0-a66f-40fd-93c2-e5a337f28d0e None admin] RBAC: Authorizing `identity:get_group(group_id=e23549ddf078436694d5d2fecff54008)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:24.460789 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348076f0-a66f-40fd-93c2-e5a337f28d0e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:24.462571 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 205/410] 10.222.0.46 () {56 vars in 1180 bytes} [Fri Jul 1 03:43:24 2022] GET /identity/v3/groups/e23549ddf078436694d5d2fecff54008 => generated 226 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:24.463892 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9af6c3-75dd-48d6-add1-e0931f8f943c None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:24.464173 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9af6c3-75dd-48d6-add1-e0931f8f943c None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:24.464451 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9af6c3-75dd-48d6-add1-e0931f8f943c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:24.467804 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:24.477498 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 206/411] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:43:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:24.480450 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0791ed-89dd-4423-a166-dc40cd71a77c None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:24.490734 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-ec9af6c3-75dd-48d6-add1-e0931f8f943c None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:43:24.491989 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ec9af6c3-75dd-48d6-add1-e0931f8f943c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:43:24.588721 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 206/412] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:43:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:43:24.590160 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9af6c3-75dd-48d6-add1-e0931f8f943c None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:24.657109 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0791ed-89dd-4423-a166-dc40cd71a77c None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:24.668259 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:24.699048 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03de34-fc79-4d37-86cc-578471e098c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:24.700213 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03de34-fc79-4d37-86cc-578471e098c1 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:24.700647 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03de34-fc79-4d37-86cc-578471e098c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:24.701071 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03de34-fc79-4d37-86cc-578471e098c1 None admin] PATH_INFO: `/v3/projects/85b9c0c1c9a84ec8989ff665fc2b2a0d` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:24.702732 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce03de34-fc79-4d37-86cc-578471e098c1 None admin] RBAC: Authorizing `identity:get_project(project_id=85b9c0c1c9a84ec8989ff665fc2b2a0d)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:24.705388 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce03de34-fc79-4d37-86cc-578471e098c1 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:24.707815 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 207/413] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:43:24 2022] GET /identity/v3/projects/85b9c0c1c9a84ec8989ff665fc2b2a0d => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:24.709085 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03de34-fc79-4d37-86cc-578471e098c1 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:24.717999 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9af6c3-75dd-48d6-add1-e0931f8f943c None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:24.755219 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f5d70-4451-449c-b1bd-f1562f1dbfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:24.756551 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f5d70-4451-449c-b1bd-f1562f1dbfb5 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:24.756835 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f5d70-4451-449c-b1bd-f1562f1dbfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:24.757112 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f5d70-4451-449c-b1bd-f1562f1dbfb5 None admin] PATH_INFO: `/v3/groups/5ef33f42771346d3be3d788947cbf0ea` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:24.758374 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f5d70-4451-449c-b1bd-f1562f1dbfb5 None admin] RBAC: Authorizing `identity:get_group(group_id=5ef33f42771346d3be3d788947cbf0ea)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:24.760028 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f5d70-4451-449c-b1bd-f1562f1dbfb5 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:24.761995 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 207/414] 10.222.0.46 () {56 vars in 1180 bytes} [Fri Jul 1 03:43:24 2022] GET /identity/v3/groups/5ef33f42771346d3be3d788947cbf0ea => generated 229 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:24.762781 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f5d70-4451-449c-b1bd-f1562f1dbfb5 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:24.808035 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:24.828213 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03de34-fc79-4d37-86cc-578471e098c1 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:24.868792 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9521034-6c64-4ce1-b914-fb2c1180f52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:24.869950 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9521034-6c64-4ce1-b914-fb2c1180f52c None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:24.870388 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9521034-6c64-4ce1-b914-fb2c1180f52c None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:24.870865 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9521034-6c64-4ce1-b914-fb2c1180f52c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:24.877508 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f5d70-4451-449c-b1bd-f1562f1dbfb5 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:24.884480 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9521034-6c64-4ce1-b914-fb2c1180f52c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:43:24.893249 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-a9521034-6c64-4ce1-b914-fb2c1180f52c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 03:43:24.893249 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:24.893249 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:24.893249 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:24.893249 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:24.893249 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:24.893249 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:24.893249 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:24.893249 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:24.893249 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:24.893249 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:24.893249 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:24.893249 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:43:24.893249 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:43:24.893249 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:43:24.893249 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:43:24.894354 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:43:24.894354 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:43:24.894354 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:43:24.894354 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:43:24.894354 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:24.894354 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:24.894354 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:24.894354 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:24.894354 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:24.894354 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:24.894354 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:24.894354 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:24.894354 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:24.894354 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:24.894354 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:24.894354 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:24.895236 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:24.895236 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:24.895236 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:24.895236 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:24.895236 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:43:24.895236 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:43:24.895236 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:43:24.895236 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:43:24.895236 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:43:24.895236 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:43:24.895236 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 03:43:24.895236 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:24.902680 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 208/415] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:43:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:24.904045 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9521034-6c64-4ce1-b914-fb2c1180f52c None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:24.904808 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:24.917090 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ba00d-3153-4093-93df-d44c9b00c93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:24.918000 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ba00d-3153-4093-93df-d44c9b00c93e None admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:24.918280 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ba00d-3153-4093-93df-d44c9b00c93e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:24.918553 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ba00d-3153-4093-93df-d44c9b00c93e None admin] PATH_INFO: `/v3/projects/85b9c0c1c9a84ec8989ff665fc2b2a0d/groups/e23549ddf078436694d5d2fecff54008/roles/132287c7d1f9428d9195f2b4ed60756b` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:24.921266 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ba00d-3153-4093-93df-d44c9b00c93e None admin] RBAC: Authorizing `identity:create_grant(project_id=85b9c0c1c9a84ec8989ff665fc2b2a0d, group_id=e23549ddf078436694d5d2fecff54008, role_id=132287c7d1f9428d9195f2b4ed60756b)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:24.922843 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ba00d-3153-4093-93df-d44c9b00c93e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:25.027493 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9521034-6c64-4ce1-b914-fb2c1180f52c None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:25.035359 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 208/416] 10.222.0.46 () {58 vars in 1442 bytes} [Fri Jul 1 03:43:24 2022] PUT /identity/v3/projects/85b9c0c1c9a84ec8989ff665fc2b2a0d/groups/e23549ddf078436694d5d2fecff54008/roles/132287c7d1f9428d9195f2b4ed60756b => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 03:43:25.036229 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ba00d-3153-4093-93df-d44c9b00c93e None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:25.097346 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:25.112723 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ab4a3-04bc-4f05-8466-00b95b03ec27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:25.113624 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ab4a3-04bc-4f05-8466-00b95b03ec27 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:25.113906 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ab4a3-04bc-4f05-8466-00b95b03ec27 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:25.114185 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ab4a3-04bc-4f05-8466-00b95b03ec27 None admin] PATH_INFO: `/v3/projects/e246a3f333f94971a10397b9c77aad47` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:25.115688 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ab4a3-04bc-4f05-8466-00b95b03ec27 None admin] RBAC: Authorizing `identity:get_project(project_id=e246a3f333f94971a10397b9c77aad47)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:25.131106 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ab4a3-04bc-4f05-8466-00b95b03ec27 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:25.131106 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 209/417] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:43:24 2022] GET /identity/v3/projects/e246a3f333f94971a10397b9c77aad47 => generated 344 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:25.133255 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ab4a3-04bc-4f05-8466-00b95b03ec27 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:25.239912 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ba00d-3153-4093-93df-d44c9b00c93e None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:25.283865 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da120d4-7009-46f5-85d1-d87af7072a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:25.284571 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da120d4-7009-46f5-85d1-d87af7072a52 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:25.284857 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da120d4-7009-46f5-85d1-d87af7072a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:25.285134 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da120d4-7009-46f5-85d1-d87af7072a52 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:25.285903 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da120d4-7009-46f5-85d1-d87af7072a52 None admin] RBAC: Adding query filter params (name=member) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:25.286213 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da120d4-7009-46f5-85d1-d87af7072a52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:25.287730 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da120d4-7009-46f5-85d1-d87af7072a52 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:25.298950 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 209/418] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 1 03:43:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:25.305939 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da120d4-7009-46f5-85d1-d87af7072a52 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:25.374798 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:25.407650 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ab4a3-04bc-4f05-8466-00b95b03ec27 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:25.489312 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da120d4-7009-46f5-85d1-d87af7072a52 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:25.509678 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d087490-7bf3-4e10-9c3f-376b829283f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:25.511738 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d087490-7bf3-4e10-9c3f-376b829283f1 None admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:25.515908 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d087490-7bf3-4e10-9c3f-376b829283f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:25.519663 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d087490-7bf3-4e10-9c3f-376b829283f1 None admin] PATH_INFO: `/v3/projects/e246a3f333f94971a10397b9c77aad47/groups/5ef33f42771346d3be3d788947cbf0ea/roles/681755518698445fabd9a8accec13c0f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:25.519663 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d087490-7bf3-4e10-9c3f-376b829283f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=e246a3f333f94971a10397b9c77aad47, group_id=5ef33f42771346d3be3d788947cbf0ea, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:25.526297 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d087490-7bf3-4e10-9c3f-376b829283f1 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:25.582324 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ad2d6-758e-405f-b219-e74032d237a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:25.583711 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ad2d6-758e-405f-b219-e74032d237a3 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:25.584225 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ad2d6-758e-405f-b219-e74032d237a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:25.584577 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ad2d6-758e-405f-b219-e74032d237a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:25.614486 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 210/419] 10.222.0.46 () {58 vars in 1442 bytes} [Fri Jul 1 03:43:25 2022] PUT /identity/v3/projects/e246a3f333f94971a10397b9c77aad47/groups/5ef33f42771346d3be3d788947cbf0ea/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 03:43:25.765550 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ad2d6-758e-405f-b219-e74032d237a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:25.768251 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ad2d6-758e-405f-b219-e74032d237a3 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:25.856091 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:25.970462 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 210/420] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:43:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 665 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 01 03:43:25.979122 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d087490-7bf3-4e10-9c3f-376b829283f1 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:26.061719 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924100df-1929-4c44-bbe9-730613060d87 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:26.062088 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924100df-1929-4c44-bbe9-730613060d87 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:26.062559 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924100df-1929-4c44-bbe9-730613060d87 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:26.065141 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 211/421] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:43:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:43:26.076298 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0556f1-cbaa-4d93-932f-5d96b2eb1ad8 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:26.076781 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0556f1-cbaa-4d93-932f-5d96b2eb1ad8 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:26.077269 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0556f1-cbaa-4d93-932f-5d96b2eb1ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:26.109197 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:26.116720 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-3f0556f1-cbaa-4d93-932f-5d96b2eb1ad8 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:43:26.118850 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-3f0556f1-cbaa-4d93-932f-5d96b2eb1ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:43:26.155771 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d087490-7bf3-4e10-9c3f-376b829283f1 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:26.232817 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c5a5a-29f8-4b95-a13a-7283405d87f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:26.233807 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c5a5a-29f8-4b95-a13a-7283405d87f7 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:26.234093 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c5a5a-29f8-4b95-a13a-7283405d87f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:26.234366 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c5a5a-29f8-4b95-a13a-7283405d87f7 None admin] PATH_INFO: `/v3/projects/c908bfb9e6e34f1589114650c691c8c1` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:26.235733 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c5a5a-29f8-4b95-a13a-7283405d87f7 None admin] RBAC: Authorizing `identity:get_project(project_id=c908bfb9e6e34f1589114650c691c8c1)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:26.237309 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c5a5a-29f8-4b95-a13a-7283405d87f7 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:26.239349 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 211/422] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:43:25 2022] GET /identity/v3/projects/c908bfb9e6e34f1589114650c691c8c1 => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:26.245049 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c5a5a-29f8-4b95-a13a-7283405d87f7 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:26.246161 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 212/423] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:43:26.269352 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0556f1-cbaa-4d93-932f-5d96b2eb1ad8 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:26.392273 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:26.412729 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c5a5a-29f8-4b95-a13a-7283405d87f7 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:26.439717 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:26.456560 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a648fba-3875-4b14-a481-c90fb45f4021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:26.461856 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a648fba-3875-4b14-a481-c90fb45f4021 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:26.462798 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a648fba-3875-4b14-a481-c90fb45f4021 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:26.463625 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a648fba-3875-4b14-a481-c90fb45f4021 None admin] PATH_INFO: `/v3/groups/e23549ddf078436694d5d2fecff54008` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:26.467121 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a648fba-3875-4b14-a481-c90fb45f4021 None admin] RBAC: Authorizing `identity:get_group(group_id=e23549ddf078436694d5d2fecff54008)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:26.468024 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0556f1-cbaa-4d93-932f-5d96b2eb1ad8 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:26.471107 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a648fba-3875-4b14-a481-c90fb45f4021 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:26.477683 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 212/424] 10.222.0.46 () {56 vars in 1180 bytes} [Fri Jul 1 03:43:26 2022] GET /identity/v3/groups/e23549ddf078436694d5d2fecff54008 => generated 226 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:26.492799 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a648fba-3875-4b14-a481-c90fb45f4021 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:26.536410 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054bf878-b0e5-4a4f-be43-c47c1ce49d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:26.537401 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bf878-b0e5-4a4f-be43-c47c1ce49d17 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:26.537692 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bf878-b0e5-4a4f-be43-c47c1ce49d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:26.537969 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bf878-b0e5-4a4f-be43-c47c1ce49d17 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:26.555904 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054bf878-b0e5-4a4f-be43-c47c1ce49d17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:43:26.577715 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-054bf878-b0e5-4a4f-be43-c47c1ce49d17 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 03:43:26.577715 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:26.577715 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:26.577715 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:26.577715 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:26.577715 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:26.577715 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:26.577715 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:26.577715 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:26.577715 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:26.577715 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:26.577715 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:26.577715 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:43:26.577715 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:43:26.577715 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:43:26.577715 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:43:26.578948 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:43:26.578948 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:43:26.578948 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:43:26.578948 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:43:26.578948 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:26.578948 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:26.578948 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:26.578948 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:26.578948 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:26.578948 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:26.578948 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:26.578948 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:26.578948 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:26.578948 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:26.578948 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:26.578948 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:26.579805 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:26.579805 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:26.579805 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:26.579805 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:26.579805 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:43:26.579805 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:43:26.579805 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:43:26.579805 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:43:26.579805 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:43:26.579805 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:43:26.579805 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 03:43:26.579805 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:26.579805 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 213/425] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:43:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 03:43:26.584850 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054bf878-b0e5-4a4f-be43-c47c1ce49d17 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:26.620138 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a648fba-3875-4b14-a481-c90fb45f4021 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:26.689021 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe533fd-f3ee-4cfa-bfc8-2dc854fedfe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:26.689624 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe533fd-f3ee-4cfa-bfc8-2dc854fedfe7 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:26.689909 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe533fd-f3ee-4cfa-bfc8-2dc854fedfe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:26.690188 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe533fd-f3ee-4cfa-bfc8-2dc854fedfe7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:26.691050 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe533fd-f3ee-4cfa-bfc8-2dc854fedfe7 None admin] RBAC: Adding query filter params (group.id=e23549ddf078436694d5d2fecff54008, role.id=c0b595782ebc410db693ef7fa70522a3, scope.project.id=c908bfb9e6e34f1589114650c691c8c1) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:26.691367 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe533fd-f3ee-4cfa-bfc8-2dc854fedfe7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:26.694611 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe533fd-f3ee-4cfa-bfc8-2dc854fedfe7 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:26.705837 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 213/426] 10.222.0.46 () {56 vars in 1376 bytes} [Fri Jul 1 03:43:26 2022] GET /identity/v3/role_assignments?group.id=e23549ddf078436694d5d2fecff54008&scope.project.id=c908bfb9e6e34f1589114650c691c8c1&role.id=c0b595782ebc410db693ef7fa70522a3 => generated 611 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:43:26.764851 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054bf878-b0e5-4a4f-be43-c47c1ce49d17 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:26.810874 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711eafca-3fb8-49f7-99b1-455037ea30cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:26.811686 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711eafca-3fb8-49f7-99b1-455037ea30cc None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:26.811880 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711eafca-3fb8-49f7-99b1-455037ea30cc None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:26.812163 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711eafca-3fb8-49f7-99b1-455037ea30cc None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:26.812939 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711eafca-3fb8-49f7-99b1-455037ea30cc None admin] RBAC: Adding query filter params (name=member) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:26.813254 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711eafca-3fb8-49f7-99b1-455037ea30cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:26.814692 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711eafca-3fb8-49f7-99b1-455037ea30cc None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:26.817573 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:26.830368 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 214/427] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 1 03:43:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:26.831281 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe533fd-f3ee-4cfa-bfc8-2dc854fedfe7 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:26.928664 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:27.000317 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe533fd-f3ee-4cfa-bfc8-2dc854fedfe7 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:27.057413 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7003ea-387f-455f-8b9c-2b11cbddb9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:27.058112 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7003ea-387f-455f-8b9c-2b11cbddb9f0 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:27.058384 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7003ea-387f-455f-8b9c-2b11cbddb9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:27.058660 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7003ea-387f-455f-8b9c-2b11cbddb9f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:27.150060 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7003ea-387f-455f-8b9c-2b11cbddb9f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:27.152612 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7003ea-387f-455f-8b9c-2b11cbddb9f0 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:27.213788 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf97e62-6bd5-4dfd-935e-332ca78b8e7d None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:27.214113 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf97e62-6bd5-4dfd-935e-332ca78b8e7d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:27.214341 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf97e62-6bd5-4dfd-935e-332ca78b8e7d None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:27.216093 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 215/428] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:43:27.224801 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a0000-374f-4a51-abd6-e0d0569a9769 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:27.225093 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a0000-374f-4a51-abd6-e0d0569a9769 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:27.225374 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a0000-374f-4a51-abd6-e0d0569a9769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:27.231839 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:27.256164 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-1b6a0000-374f-4a51-abd6-e0d0569a9769 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:43:27.257387 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1b6a0000-374f-4a51-abd6-e0d0569a9769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:43:27.307152 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 214/429] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:43:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 03:43:27.317067 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7003ea-387f-455f-8b9c-2b11cbddb9f0 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:27.381941 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 216/430] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:43:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:43:27.407426 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a0000-374f-4a51-abd6-e0d0569a9769 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:27.471396 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7003ea-387f-455f-8b9c-2b11cbddb9f0 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:27.541830 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d63a2-56f8-4a88-95b1-fa4531486290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:27.543502 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d63a2-56f8-4a88-95b1-fa4531486290 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:27.543959 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d63a2-56f8-4a88-95b1-fa4531486290 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:27.544365 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d63a2-56f8-4a88-95b1-fa4531486290 None admin] PATH_INFO: `/v3/projects/85b9c0c1c9a84ec8989ff665fc2b2a0d` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:27.546464 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d63a2-56f8-4a88-95b1-fa4531486290 None admin] RBAC: Authorizing `identity:get_project(project_id=85b9c0c1c9a84ec8989ff665fc2b2a0d)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:27.549107 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d63a2-56f8-4a88-95b1-fa4531486290 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:27.553399 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 215/431] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:43:27 2022] GET /identity/v3/projects/85b9c0c1c9a84ec8989ff665fc2b2a0d => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:27.562018 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d63a2-56f8-4a88-95b1-fa4531486290 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:27.589108 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a0000-374f-4a51-abd6-e0d0569a9769 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:27.621782 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:27.653890 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:27.669830 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c707805-2097-4cfb-a361-fc216d9a1086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:27.671483 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c707805-2097-4cfb-a361-fc216d9a1086 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:27.675161 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c707805-2097-4cfb-a361-fc216d9a1086 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:27.676012 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c707805-2097-4cfb-a361-fc216d9a1086 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:27.697320 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c707805-2097-4cfb-a361-fc216d9a1086 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:43:27.721479 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-4c707805-2097-4cfb-a361-fc216d9a1086 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 03:43:27.721479 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:27.721479 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:27.721479 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:27.721479 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:27.721479 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:27.721479 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:27.721479 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:27.721479 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:27.721479 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:27.721479 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:27.721479 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:27.721479 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:43:27.721479 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:43:27.721479 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:43:27.721479 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:43:27.723162 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:43:27.723162 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:43:27.723162 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:43:27.723162 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:43:27.723162 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:27.723162 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:27.723162 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:27.723162 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:27.723162 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:27.723162 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:27.723162 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:27.723162 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:27.723162 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:27.723162 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:27.723162 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:27.723162 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:27.725244 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:27.725244 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:27.725244 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:27.725244 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:27.725244 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:43:27.725244 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:43:27.725244 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:43:27.725244 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:43:27.725244 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:43:27.725244 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:43:27.725244 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 03:43:27.725244 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:27.730517 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 217/432] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Jul 1 03:43:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:27.739417 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c707805-2097-4cfb-a361-fc216d9a1086 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:27.748783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d63a2-56f8-4a88-95b1-fa4531486290 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:27.803017 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298512cc-2b04-4924-a441-c6fd9f534da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:27.804023 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298512cc-2b04-4924-a441-c6fd9f534da0 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:27.804489 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298512cc-2b04-4924-a441-c6fd9f534da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:27.804780 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298512cc-2b04-4924-a441-c6fd9f534da0 None admin] PATH_INFO: `/v3/groups/e23549ddf078436694d5d2fecff54008` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:27.807582 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298512cc-2b04-4924-a441-c6fd9f534da0 None admin] RBAC: Authorizing `identity:get_group(group_id=e23549ddf078436694d5d2fecff54008)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:27.809746 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298512cc-2b04-4924-a441-c6fd9f534da0 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:27.812220 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 216/433] 10.222.0.46 () {56 vars in 1180 bytes} [Fri Jul 1 03:43:27 2022] GET /identity/v3/groups/e23549ddf078436694d5d2fecff54008 => generated 226 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:27.824576 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298512cc-2b04-4924-a441-c6fd9f534da0 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:27.930731 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c707805-2097-4cfb-a361-fc216d9a1086 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:27.979648 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:27.983338 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9d447-f9dc-41ea-9cbf-e900e053cb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:27.984107 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9d447-f9dc-41ea-9cbf-e900e053cb24 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:27.984393 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9d447-f9dc-41ea-9cbf-e900e053cb24 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:27.984677 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9d447-f9dc-41ea-9cbf-e900e053cb24 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:27.993944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b9d447-f9dc-41ea-9cbf-e900e053cb24 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:27.993944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b9d447-f9dc-41ea-9cbf-e900e053cb24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:27.993944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b9d447-f9dc-41ea-9cbf-e900e053cb24 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:27.994445 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298512cc-2b04-4924-a441-c6fd9f534da0 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:27.997866 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 218/434] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:43:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:28.004337 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85bf82-4f0c-4ebb-8bc3-e30a4a1b21e2 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:28.004812 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85bf82-4f0c-4ebb-8bc3-e30a4a1b21e2 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:28.006329 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85bf82-4f0c-4ebb-8bc3-e30a4a1b21e2 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:28.008362 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 219/435] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:43:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:43:28.009017 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc85bf82-4f0c-4ebb-8bc3-e30a4a1b21e2 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:28.039432 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd2238-8bc3-4824-9d99-b550bf30ed20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:28.040769 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd2238-8bc3-4824-9d99-b550bf30ed20 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:28.040769 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd2238-8bc3-4824-9d99-b550bf30ed20 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:28.040769 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd2238-8bc3-4824-9d99-b550bf30ed20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:28.041606 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd2238-8bc3-4824-9d99-b550bf30ed20 None admin] RBAC: Adding query filter params (group.id=e23549ddf078436694d5d2fecff54008, role.id=c0b595782ebc410db693ef7fa70522a3, scope.project.id=85b9c0c1c9a84ec8989ff665fc2b2a0d) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:28.041926 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd2238-8bc3-4824-9d99-b550bf30ed20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:28.043380 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd2238-8bc3-4824-9d99-b550bf30ed20 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:28.056773 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 217/436] 10.222.0.46 () {56 vars in 1376 bytes} [Fri Jul 1 03:43:27 2022] GET /identity/v3/role_assignments?group.id=e23549ddf078436694d5d2fecff54008&scope.project.id=85b9c0c1c9a84ec8989ff665fc2b2a0d&role.id=c0b595782ebc410db693ef7fa70522a3 => generated 611 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:28.056773 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484f43d-f6bb-4423-ac86-c321972e83cf None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:28.056773 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484f43d-f6bb-4423-ac86-c321972e83cf None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:28.056773 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484f43d-f6bb-4423-ac86-c321972e83cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:28.070883 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-a484f43d-f6bb-4423-ac86-c321972e83cf None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:43:28.072509 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-a484f43d-f6bb-4423-ac86-c321972e83cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:43:28.110839 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:28.158164 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 218/437] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:43:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:43:28.198982 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a484f43d-f6bb-4423-ac86-c321972e83cf None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:28.204498 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc85bf82-4f0c-4ebb-8bc3-e30a4a1b21e2 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:28.257399 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3f925-dd11-429e-8d1e-b5359a5c0122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:28.257840 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3f925-dd11-429e-8d1e-b5359a5c0122 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:28.258124 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3f925-dd11-429e-8d1e-b5359a5c0122 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:28.258404 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3f925-dd11-429e-8d1e-b5359a5c0122 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:28.313126 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:28.340653 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a484f43d-f6bb-4423-ac86-c321972e83cf None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:28.344820 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec3f925-dd11-429e-8d1e-b5359a5c0122 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:28.347497 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec3f925-dd11-429e-8d1e-b5359a5c0122 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:28.388488 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6caee-fb16-43c4-84c4-a70144047fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:28.389316 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6caee-fb16-43c4-84c4-a70144047fb3 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:28.389598 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6caee-fb16-43c4-84c4-a70144047fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:28.389897 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6caee-fb16-43c4-84c4-a70144047fb3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:28.402003 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b6caee-fb16-43c4-84c4-a70144047fb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:43:28.411010 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-e0b6caee-fb16-43c4-84c4-a70144047fb3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 03:43:28.411010 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:28.411010 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:28.411010 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:28.411010 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:28.411010 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:28.411010 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:28.411010 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:28.411010 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:28.411010 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:28.411010 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:28.411010 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:28.411010 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:43:28.411010 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:43:28.411010 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:43:28.411010 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:43:28.412110 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:43:28.412110 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:43:28.412110 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:43:28.412110 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:43:28.412110 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:28.412110 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:28.412110 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:28.412110 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:28.412110 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:28.412110 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:28.412110 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:28.412110 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:28.412110 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:28.412110 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:28.412110 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:28.412110 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:28.412927 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:28.412927 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:28.412927 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:28.412927 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:28.412927 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:43:28.412927 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:43:28.412927 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:43:28.412927 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:43:28.412927 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:43:28.412927 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:43:28.412927 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 03:43:28.412927 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:28.412927 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 219/438] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Jul 1 03:43:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:28.415682 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:28.419255 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6caee-fb16-43c4-84c4-a70144047fb3 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:28.475306 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 220/439] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:43:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 03:43:28.480679 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3f925-dd11-429e-8d1e-b5359a5c0122 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:28.544133 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6caee-fb16-43c4-84c4-a70144047fb3 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:28.585238 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70074ca-6336-4595-8c5d-dc381483dbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:28.585833 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70074ca-6336-4595-8c5d-dc381483dbff None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:28.586113 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70074ca-6336-4595-8c5d-dc381483dbff None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:28.586395 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70074ca-6336-4595-8c5d-dc381483dbff None admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:28.587154 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70074ca-6336-4595-8c5d-dc381483dbff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:28.587489 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70074ca-6336-4595-8c5d-dc381483dbff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:28.588872 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70074ca-6336-4595-8c5d-dc381483dbff None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:28.598550 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 220/440] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:43:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:43:28.600365 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941e501-ccb0-4b6a-93fe-03968bef732d None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:28.600825 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941e501-ccb0-4b6a-93fe-03968bef732d None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:28.601166 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941e501-ccb0-4b6a-93fe-03968bef732d None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:28.602615 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 221/441] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:43:28.605918 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941e501-ccb0-4b6a-93fe-03968bef732d None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:28.618338 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:28.625891 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3f925-dd11-429e-8d1e-b5359a5c0122 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:28.662349 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5404d-b40c-42a0-a273-f35509e1ccf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:28.663219 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5404d-b40c-42a0-a273-f35509e1ccf2 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:28.663531 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5404d-b40c-42a0-a273-f35509e1ccf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:28.663807 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5404d-b40c-42a0-a273-f35509e1ccf2 None admin] PATH_INFO: `/v3/projects/c908bfb9e6e34f1589114650c691c8c1` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:28.665286 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a5404d-b40c-42a0-a273-f35509e1ccf2 None admin] RBAC: Authorizing `identity:get_project(project_id=c908bfb9e6e34f1589114650c691c8c1)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:28.666747 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a5404d-b40c-42a0-a273-f35509e1ccf2 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:28.668505 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 221/442] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:43:28 2022] GET /identity/v3/projects/c908bfb9e6e34f1589114650c691c8c1 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:43:28.669696 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e372e4-3996-42b9-9a07-71a9200f98f2 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:28.669972 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e372e4-3996-42b9-9a07-71a9200f98f2 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:28.670244 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e372e4-3996-42b9-9a07-71a9200f98f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:28.687759 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-94e372e4-3996-42b9-9a07-71a9200f98f2 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:43:28.688956 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-94e372e4-3996-42b9-9a07-71a9200f98f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:43:28.706024 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:28.723762 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941e501-ccb0-4b6a-93fe-03968bef732d None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:28.764684 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4f534-e83b-48e9-9b52-c2e271b1937f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:28.765438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4f534-e83b-48e9-9b52-c2e271b1937f None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:28.765821 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4f534-e83b-48e9-9b52-c2e271b1937f None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:28.766163 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4f534-e83b-48e9-9b52-c2e271b1937f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:28.770766 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 222/443] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:43:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:43:28.771683 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e372e4-3996-42b9-9a07-71a9200f98f2 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:28.847096 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d4f534-e83b-48e9-9b52-c2e271b1937f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:28.848561 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d4f534-e83b-48e9-9b52-c2e271b1937f None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:28.860204 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:28.900788 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e372e4-3996-42b9-9a07-71a9200f98f2 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:28.938913 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be6e46-a865-45fb-b481-2197b0f9fd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:28.939807 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be6e46-a865-45fb-b481-2197b0f9fd73 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:28.940084 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be6e46-a865-45fb-b481-2197b0f9fd73 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:28.940358 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be6e46-a865-45fb-b481-2197b0f9fd73 None admin] PATH_INFO: `/v3/groups/e23549ddf078436694d5d2fecff54008` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:28.941671 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be6e46-a865-45fb-b481-2197b0f9fd73 None admin] RBAC: Authorizing `identity:get_group(group_id=e23549ddf078436694d5d2fecff54008)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:28.943159 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be6e46-a865-45fb-b481-2197b0f9fd73 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:28.944875 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 223/444] 10.222.0.46 () {56 vars in 1180 bytes} [Fri Jul 1 03:43:28 2022] GET /identity/v3/groups/e23549ddf078436694d5d2fecff54008 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:28.945673 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be6e46-a865-45fb-b481-2197b0f9fd73 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:28.972636 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 222/445] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:43:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 01 03:43:28.979532 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4f534-e83b-48e9-9b52-c2e271b1937f None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:28.981009 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:29.081433 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be6e46-a865-45fb-b481-2197b0f9fd73 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:29.086866 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4f534-e83b-48e9-9b52-c2e271b1937f None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:29.097482 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:29.131406 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ad0b6-b639-4fe9-b991-b66146faa927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:29.132251 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ad0b6-b639-4fe9-b991-b66146faa927 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:29.132520 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ad0b6-b639-4fe9-b991-b66146faa927 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:29.132791 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ad0b6-b639-4fe9-b991-b66146faa927 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:29.133039 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b286f-1a22-43cf-b813-8f9aea4717bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:29.133781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b286f-1a22-43cf-b813-8f9aea4717bb None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:29.134146 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b286f-1a22-43cf-b813-8f9aea4717bb None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:29.134507 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b286f-1a22-43cf-b813-8f9aea4717bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:29.135766 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b286f-1a22-43cf-b813-8f9aea4717bb None admin] RBAC: Adding query filter params (group.id=e23549ddf078436694d5d2fecff54008, role.id=132287c7d1f9428d9195f2b4ed60756b, scope.project.id=c908bfb9e6e34f1589114650c691c8c1) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:29.136208 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b286f-1a22-43cf-b813-8f9aea4717bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:29.137735 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b286f-1a22-43cf-b813-8f9aea4717bb None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:29.144338 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47ad0b6-b639-4fe9-b991-b66146faa927 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:43:29.147604 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 223/446] 10.222.0.46 () {56 vars in 1376 bytes} [Fri Jul 1 03:43:28 2022] GET /identity/v3/role_assignments?group.id=e23549ddf078436694d5d2fecff54008&scope.project.id=c908bfb9e6e34f1589114650c691c8c1&role.id=132287c7d1f9428d9195f2b4ed60756b => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:29.148879 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b286f-1a22-43cf-b813-8f9aea4717bb None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:29.153030 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-c47ad0b6-b639-4fe9-b991-b66146faa927 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:43:29.153030 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:29.153030 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:29.153030 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:29.153030 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:29.153030 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:29.153030 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:29.153030 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:29.153030 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:29.153030 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:29.153030 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:29.153030 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:29.153030 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:43:29.153030 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:43:29.153030 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:43:29.153030 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:43:29.154710 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:43:29.154710 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:43:29.154710 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:43:29.154710 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:43:29.154710 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:29.154710 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:29.154710 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:29.154710 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:29.154710 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:29.154710 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:29.154710 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:29.154710 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:29.154710 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:29.154710 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:29.154710 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:29.154710 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:29.156225 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:29.156225 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:29.156225 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:29.156225 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:29.156225 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:43:29.156225 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:43:29.156225 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:43:29.156225 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:43:29.156225 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:43:29.156225 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:43:29.156225 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:43:29.156225 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:29.156225 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 224/447] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 1 03:43:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:29.160753 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ad0b6-b639-4fe9-b991-b66146faa927 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:29.265941 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:29.309283 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ad0b6-b639-4fe9-b991-b66146faa927 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:29.340078 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b286f-1a22-43cf-b813-8f9aea4717bb None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:29.372152 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ccec3-9b62-480e-a100-437d2c3c854c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:29.373586 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ccec3-9b62-480e-a100-437d2c3c854c None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:29.373586 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ccec3-9b62-480e-a100-437d2c3c854c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:29.374064 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ccec3-9b62-480e-a100-437d2c3c854c None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:29.378777 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2ccec3-9b62-480e-a100-437d2c3c854c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:29.378777 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2ccec3-9b62-480e-a100-437d2c3c854c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:29.378777 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2ccec3-9b62-480e-a100-437d2c3c854c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:29.393151 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b4f50-49e4-40ce-9402-fd0f4dd95dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:29.394552 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b4f50-49e4-40ce-9402-fd0f4dd95dfd None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:29.395011 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b4f50-49e4-40ce-9402-fd0f4dd95dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:29.395521 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b4f50-49e4-40ce-9402-fd0f4dd95dfd None admin] PATH_INFO: `/v3/projects/85b9c0c1c9a84ec8989ff665fc2b2a0d` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:29.398159 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b4f50-49e4-40ce-9402-fd0f4dd95dfd None admin] RBAC: Authorizing `identity:get_project(project_id=85b9c0c1c9a84ec8989ff665fc2b2a0d)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:29.399586 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 225/448] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:43:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:43:29.400921 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b4f50-49e4-40ce-9402-fd0f4dd95dfd None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:29.404010 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ccec3-9b62-480e-a100-437d2c3c854c None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:29.407817 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 224/449] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:43:29 2022] GET /identity/v3/projects/85b9c0c1c9a84ec8989ff665fc2b2a0d => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:29.412540 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b4f50-49e4-40ce-9402-fd0f4dd95dfd None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:29.483119 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:29.579304 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b4f50-49e4-40ce-9402-fd0f4dd95dfd None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:29.588949 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ccec3-9b62-480e-a100-437d2c3c854c None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:29.643117 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047a219-a9b2-4803-aa35-18268adc83e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:29.643815 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb2dcb-621a-491a-8964-bf6980bb46c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:29.644347 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047a219-a9b2-4803-aa35-18268adc83e0 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:29.644701 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb2dcb-621a-491a-8964-bf6980bb46c8 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:29.644861 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047a219-a9b2-4803-aa35-18268adc83e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:29.645012 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb2dcb-621a-491a-8964-bf6980bb46c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:29.645201 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047a219-a9b2-4803-aa35-18268adc83e0 None admin] PATH_INFO: `/v3/groups/e23549ddf078436694d5d2fecff54008` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:29.645471 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb2dcb-621a-491a-8964-bf6980bb46c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:29.647744 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7047a219-a9b2-4803-aa35-18268adc83e0 None admin] RBAC: Authorizing `identity:get_group(group_id=e23549ddf078436694d5d2fecff54008)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:29.649375 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7047a219-a9b2-4803-aa35-18268adc83e0 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:29.651157 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 225/450] 10.222.0.46 () {56 vars in 1180 bytes} [Fri Jul 1 03:43:29 2022] GET /identity/v3/groups/e23549ddf078436694d5d2fecff54008 => generated 226 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:43:29.662051 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047a219-a9b2-4803-aa35-18268adc83e0 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:29.663275 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:29.758455 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb2dcb-621a-491a-8964-bf6980bb46c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:29.761256 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb2dcb-621a-491a-8964-bf6980bb46c8 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:29.826399 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047a219-a9b2-4803-aa35-18268adc83e0 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:29.838016 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:29.871505 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd9c988-1670-4d93-a1c2-cb5506e16449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:29.872563 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9c988-1670-4d93-a1c2-cb5506e16449 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:29.873072 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9c988-1670-4d93-a1c2-cb5506e16449 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:29.873578 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9c988-1670-4d93-a1c2-cb5506e16449 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:29.875020 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd9c988-1670-4d93-a1c2-cb5506e16449 None admin] RBAC: Adding query filter params (group.id=e23549ddf078436694d5d2fecff54008, role.id=132287c7d1f9428d9195f2b4ed60756b, scope.project.id=85b9c0c1c9a84ec8989ff665fc2b2a0d) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:29.875552 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd9c988-1670-4d93-a1c2-cb5506e16449 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:29.878025 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd9c988-1670-4d93-a1c2-cb5506e16449 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:29.888103 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 226/451] 10.222.0.46 () {56 vars in 1376 bytes} [Fri Jul 1 03:43:29 2022] GET /identity/v3/role_assignments?group.id=e23549ddf078436694d5d2fecff54008&scope.project.id=85b9c0c1c9a84ec8989ff665fc2b2a0d&role.id=132287c7d1f9428d9195f2b4ed60756b => generated 611 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:29.913795 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 226/452] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:43:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 01 03:43:29.920372 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd9c988-1670-4d93-a1c2-cb5506e16449 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:30.059502 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd9c988-1670-4d93-a1c2-cb5506e16449 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:30.106148 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2272befc-3a71-463f-b4c6-f8f89135b7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:30.107176 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272befc-3a71-463f-b4c6-f8f89135b7aa None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:30.107757 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272befc-3a71-463f-b4c6-f8f89135b7aa None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:30.108126 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272befc-3a71-463f-b4c6-f8f89135b7aa None admin] PATH_INFO: `/v3/projects/e246a3f333f94971a10397b9c77aad47` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:30.110002 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2272befc-3a71-463f-b4c6-f8f89135b7aa None admin] RBAC: Authorizing `identity:get_project(project_id=e246a3f333f94971a10397b9c77aad47)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:30.112513 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2272befc-3a71-463f-b4c6-f8f89135b7aa None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:30.115357 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 227/453] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:43:29 2022] GET /identity/v3/projects/e246a3f333f94971a10397b9c77aad47 => generated 344 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:43:30.121579 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb2dcb-621a-491a-8964-bf6980bb46c8 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:30.172301 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:30.236182 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb2dcb-621a-491a-8964-bf6980bb46c8 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:30.274661 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ed024-57fc-40ea-b124-20b8a4f19574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:30.275563 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ed024-57fc-40ea-b124-20b8a4f19574 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:30.275849 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ed024-57fc-40ea-b124-20b8a4f19574 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:30.276121 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ed024-57fc-40ea-b124-20b8a4f19574 None admin] PATH_INFO: `/v3/groups/5ef33f42771346d3be3d788947cbf0ea` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:30.277350 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ed024-57fc-40ea-b124-20b8a4f19574 None admin] RBAC: Authorizing `identity:get_group(group_id=5ef33f42771346d3be3d788947cbf0ea)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:30.278826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ed024-57fc-40ea-b124-20b8a4f19574 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:30.280530 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 227/454] 10.222.0.46 () {56 vars in 1180 bytes} [Fri Jul 1 03:43:30 2022] GET /identity/v3/groups/5ef33f42771346d3be3d788947cbf0ea => generated 229 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:43:30.286606 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2272befc-3a71-463f-b4c6-f8f89135b7aa None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:30.341057 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:30.400675 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2272befc-3a71-463f-b4c6-f8f89135b7aa None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:30.435086 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87826ba-7902-45ba-af43-ab97eed21820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:30.435679 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87826ba-7902-45ba-af43-ab97eed21820 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:30.435959 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87826ba-7902-45ba-af43-ab97eed21820 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:30.436230 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87826ba-7902-45ba-af43-ab97eed21820 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:30.437061 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87826ba-7902-45ba-af43-ab97eed21820 None admin] RBAC: Adding query filter params (group.id=5ef33f42771346d3be3d788947cbf0ea, role.id=681755518698445fabd9a8accec13c0f, scope.project.id=e246a3f333f94971a10397b9c77aad47) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:30.437369 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87826ba-7902-45ba-af43-ab97eed21820 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:30.438829 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87826ba-7902-45ba-af43-ab97eed21820 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:30.445976 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 228/455] 10.222.0.46 () {56 vars in 1376 bytes} [Fri Jul 1 03:43:30 2022] GET /identity/v3/role_assignments?group.id=5ef33f42771346d3be3d788947cbf0ea&scope.project.id=e246a3f333f94971a10397b9c77aad47&role.id=681755518698445fabd9a8accec13c0f => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:43:33.054881 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86c8d5-5877-4ac7-b9f5-0cf6b01f9a01 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:33.055402 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86c8d5-5877-4ac7-b9f5-0cf6b01f9a01 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:33.055402 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86c8d5-5877-4ac7-b9f5-0cf6b01f9a01 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:33.057195 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 228/456] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:43:33.062598 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378ae57-2666-4ee1-a9e5-1971944d192a None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:33.063123 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378ae57-2666-4ee1-a9e5-1971944d192a None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:33.063123 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378ae57-2666-4ee1-a9e5-1971944d192a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:33.084597 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-0378ae57-2666-4ee1-a9e5-1971944d192a None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:43:33.085803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-0378ae57-2666-4ee1-a9e5-1971944d192a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:43:33.186314 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 229/457] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:43:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:43:33.227361 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86c8d5-5877-4ac7-b9f5-0cf6b01f9a01 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:33.300737 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85043a6f-294d-4b0a-a9e7-e6a257ec127d None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:33.301073 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85043a6f-294d-4b0a-a9e7-e6a257ec127d None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:33.301318 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85043a6f-294d-4b0a-a9e7-e6a257ec127d None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:33.303546 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 230/458] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:43:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:43:33.309422 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0016ccf-679e-4e89-9d19-c9052dcbfedb None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:33.309695 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0016ccf-679e-4e89-9d19-c9052dcbfedb None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:33.309904 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0016ccf-679e-4e89-9d19-c9052dcbfedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:33.327743 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-c0016ccf-679e-4e89-9d19-c9052dcbfedb None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:43:33.328958 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-c0016ccf-679e-4e89-9d19-c9052dcbfedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:43:33.387847 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:33.398166 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86c8d5-5877-4ac7-b9f5-0cf6b01f9a01 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:33.413589 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:33.463018 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c02427-5bfa-4d56-90f7-7edc7483e4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:33.465214 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c02427-5bfa-4d56-90f7-7edc7483e4e6 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:33.465728 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c02427-5bfa-4d56-90f7-7edc7483e4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:33.466219 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c02427-5bfa-4d56-90f7-7edc7483e4e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:33.486240 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c02427-5bfa-4d56-90f7-7edc7483e4e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:33.491473 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c02427-5bfa-4d56-90f7-7edc7483e4e6 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:33.505300 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 231/459] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:43:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 03:43:33.526803 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-34c02427-5bfa-4d56-90f7-7edc7483e4e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:33.526803 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:33.526803 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:33.526803 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:33.526803 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:33.526803 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:33.526803 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:33.526803 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:33.526803 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:33.526803 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:33.526803 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:33.526803 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:33.526803 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:43:33.526803 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:43:33.526803 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:43:33.527744 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:43:33.527744 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:33.527744 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:33.527744 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:33.527744 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:33.527744 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:33.527744 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:33.527744 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:33.527744 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:33.527744 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:33.527744 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:33.527744 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:33.527744 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:33.527744 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:33.527744 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:33.527744 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:33.527744 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:33.528596 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:43:33.528596 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:43:33.528596 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:33.528596 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:33.529488 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 229/460] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:43:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:33.535266 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0016ccf-679e-4e89-9d19-c9052dcbfedb None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:33.570483 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c02427-5bfa-4d56-90f7-7edc7483e4e6 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:33.679192 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0016ccf-679e-4e89-9d19-c9052dcbfedb None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:33.771101 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23506b8c-b57c-4a3a-8e04-ec74763873d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:33.771822 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23506b8c-b57c-4a3a-8e04-ec74763873d6 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:33.772111 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23506b8c-b57c-4a3a-8e04-ec74763873d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:33.772389 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23506b8c-b57c-4a3a-8e04-ec74763873d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:33.773134 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23506b8c-b57c-4a3a-8e04-ec74763873d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:33.773444 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23506b8c-b57c-4a3a-8e04-ec74763873d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:33.775039 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23506b8c-b57c-4a3a-8e04-ec74763873d6 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:33.781847 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c02427-5bfa-4d56-90f7-7edc7483e4e6 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:33.802334 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 232/461] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:33.807698 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23506b8c-b57c-4a3a-8e04-ec74763873d6 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:33.846383 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:33.849891 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71756ff7-09da-49e9-8dea-d4e4c801bf2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:33.851282 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71756ff7-09da-49e9-8dea-d4e4c801bf2c None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:33.851819 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71756ff7-09da-49e9-8dea-d4e4c801bf2c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:33.852618 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71756ff7-09da-49e9-8dea-d4e4c801bf2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:33.872324 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71756ff7-09da-49e9-8dea-d4e4c801bf2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:33.875297 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71756ff7-09da-49e9-8dea-d4e4c801bf2c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:33.912407 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-71756ff7-09da-49e9-8dea-d4e4c801bf2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:33.912407 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:33.912407 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:33.912407 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:33.912407 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:33.912407 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:33.912407 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:33.912407 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:33.912407 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:33.912407 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:33.912407 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:33.912407 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:33.912407 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:43:33.912407 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:43:33.912407 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:43:33.913333 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:43:33.913333 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:33.913333 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:33.913333 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:33.913333 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:33.913333 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:33.913333 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:33.913333 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:33.913333 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:33.913333 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:33.913333 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:33.913333 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:33.913333 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:33.913333 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:33.913333 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:33.913333 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:33.913333 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:33.914422 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:43:33.914422 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:43:33.914422 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:33.914422 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:33.915376 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 230/462] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:43:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:33.925074 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71756ff7-09da-49e9-8dea-d4e4c801bf2c None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:33.943795 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23506b8c-b57c-4a3a-8e04-ec74763873d6 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:33.964666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:33.996314 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f455b-a9b2-4ca8-a100-9ad4363c9243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:33.997027 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f455b-a9b2-4ca8-a100-9ad4363c9243 None admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:33.997321 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f455b-a9b2-4ca8-a100-9ad4363c9243 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:33.997606 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f455b-a9b2-4ca8-a100-9ad4363c9243 None admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:33.998362 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f455b-a9b2-4ca8-a100-9ad4363c9243 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:33.999922 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f455b-a9b2-4ca8-a100-9ad4363c9243 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:34.154802 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71756ff7-09da-49e9-8dea-d4e4c801bf2c None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:34.221299 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721cbd4-ae3e-43dd-8ec6-b808f58a5b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:34.221988 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721cbd4-ae3e-43dd-8ec6-b808f58a5b6f None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:34.222574 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721cbd4-ae3e-43dd-8ec6-b808f58a5b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:34.222863 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721cbd4-ae3e-43dd-8ec6-b808f58a5b6f None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:34.223784 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0721cbd4-ae3e-43dd-8ec6-b808f58a5b6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:34.224098 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0721cbd4-ae3e-43dd-8ec6-b808f58a5b6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:34.225555 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0721cbd4-ae3e-43dd-8ec6-b808f58a5b6f None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:34.228736 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 233/463] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Jul 1 03:43:33 2022] POST /identity/v3/users => generated 246 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 03:43:34.231354 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9b124-1937-4892-a36c-2dc1653e11ce None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:34.231976 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9b124-1937-4892-a36c-2dc1653e11ce None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:34.232530 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9b124-1937-4892-a36c-2dc1653e11ce None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:34.235526 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 234/464] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:43:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:43:34.244969 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61a47c-822e-498d-9e37-80af1b828bb5 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:34.245279 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61a47c-822e-498d-9e37-80af1b828bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:34.251602 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61a47c-822e-498d-9e37-80af1b828bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:34.258017 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 231/465] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:34.264948 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-3c61a47c-822e-498d-9e37-80af1b828bb5 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:43:34.267303 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721cbd4-ae3e-43dd-8ec6-b808f58a5b6f None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:34.272886 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-3c61a47c-822e-498d-9e37-80af1b828bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:43:34.451543 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 235/466] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:43:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 03:43:34.453251 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:34.454823 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4fe129-40f8-4c30-b673-17926bb503fa None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:34.455285 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4fe129-40f8-4c30-b673-17926bb503fa None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:34.455800 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4fe129-40f8-4c30-b673-17926bb503fa None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:34.462458 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 236/467] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:43:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:43:34.466553 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a742f-4308-4d73-88d4-82551d8f29d7 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:34.467028 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a742f-4308-4d73-88d4-82551d8f29d7 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:34.467541 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a742f-4308-4d73-88d4-82551d8f29d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:34.499296 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-cd8a742f-4308-4d73-88d4-82551d8f29d7 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:43:34.499946 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721cbd4-ae3e-43dd-8ec6-b808f58a5b6f None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:34.501290 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-cd8a742f-4308-4d73-88d4-82551d8f29d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:43:34.509506 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:34.560043 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65626de-c157-4626-ac86-59f3e7d1e939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:34.561199 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65626de-c157-4626-ac86-59f3e7d1e939 None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:34.561695 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65626de-c157-4626-ac86-59f3e7d1e939 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:34.562179 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65626de-c157-4626-ac86-59f3e7d1e939 None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:34.564241 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65626de-c157-4626-ac86-59f3e7d1e939 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:34.566192 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65626de-c157-4626-ac86-59f3e7d1e939 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:34.605163 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 237/468] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:43:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:43:34.605163 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a742f-4308-4d73-88d4-82551d8f29d7 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:34.658486 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 232/469] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Jul 1 03:43:34 2022] POST /identity/v3/users => generated 248 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 03:43:34.660045 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65626de-c157-4626-ac86-59f3e7d1e939 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:34.720707 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a742f-4308-4d73-88d4-82551d8f29d7 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:34.798357 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d12ad9-c650-4813-a240-83d7a3a2e804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:34.799966 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d12ad9-c650-4813-a240-83d7a3a2e804 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:34.800804 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d12ad9-c650-4813-a240-83d7a3a2e804 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:34.801669 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d12ad9-c650-4813-a240-83d7a3a2e804 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:34.822404 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:34.827815 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d12ad9-c650-4813-a240-83d7a3a2e804 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:34.829313 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d12ad9-c650-4813-a240-83d7a3a2e804 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:34.852361 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65626de-c157-4626-ac86-59f3e7d1e939 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:34.862099 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-c8d12ad9-c650-4813-a240-83d7a3a2e804 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:34.862099 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:34.862099 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:34.862099 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:34.862099 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:34.862099 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:34.862099 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:34.862099 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:34.862099 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:34.862099 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:34.862099 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:34.862099 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:34.862099 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:43:34.862099 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:43:34.862099 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:43:34.863088 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:43:34.863088 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:34.863088 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:34.863088 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:34.863088 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:34.863088 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:34.863088 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:34.863088 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:34.863088 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:34.863088 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:34.863088 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:34.863088 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:34.863088 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:34.863088 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:34.863088 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:34.863088 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:34.863088 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:34.865263 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:43:34.865263 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:43:34.865263 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:34.865263 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:34.865263 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 238/470] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:43:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:34.865649 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdfb34-be57-4728-aa1d-27ada45154a5 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:34.865886 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdfb34-be57-4728-aa1d-27ada45154a5 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:34.866158 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdfb34-be57-4728-aa1d-27ada45154a5 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:34.867844 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 239/471] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:43:34.872926 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fdfb34-be57-4728-aa1d-27ada45154a5 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:34.889069 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:34.900062 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb009c2-7d6d-42f3-8419-10da159a0489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:34.906531 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb009c2-7d6d-42f3-8419-10da159a0489 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:34.906531 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb009c2-7d6d-42f3-8419-10da159a0489 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:34.906531 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb009c2-7d6d-42f3-8419-10da159a0489 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:34.915495 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb009c2-7d6d-42f3-8419-10da159a0489 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:34.917389 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb009c2-7d6d-42f3-8419-10da159a0489 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:34.937211 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-8cb009c2-7d6d-42f3-8419-10da159a0489 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:34.937211 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:34.937211 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:34.937211 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:34.937211 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:34.937211 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:34.937211 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:34.937211 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:34.937211 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:34.937211 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:34.937211 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:34.937211 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:34.937211 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:43:34.937211 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:43:34.937211 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:43:34.938086 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:43:34.938086 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:34.938086 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:34.938086 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:34.938086 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:34.938086 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:34.938086 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:34.938086 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:34.938086 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:34.938086 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:34.938086 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:34.938086 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:34.938086 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:34.938086 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:34.938086 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:34.938086 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:34.938086 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:34.938949 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:43:34.938949 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:43:34.938949 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:34.938949 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:34.940706 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 233/472] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:43:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:34.942239 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ba311-911b-4572-b483-82dd1139d718 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:34.942585 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ba311-911b-4572-b483-82dd1139d718 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:34.942872 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ba311-911b-4572-b483-82dd1139d718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:34.962414 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-fe7ba311-911b-4572-b483-82dd1139d718 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:43:34.964288 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-fe7ba311-911b-4572-b483-82dd1139d718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:43:35.017031 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fdfb34-be57-4728-aa1d-27ada45154a5 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:35.049083 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 234/473] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:43:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:43:35.050358 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ba311-911b-4572-b483-82dd1139d718 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:35.064775 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551dfa5-ca97-4cee-baf0-fdf168ed0745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:35.066228 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551dfa5-ca97-4cee-baf0-fdf168ed0745 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:35.066714 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551dfa5-ca97-4cee-baf0-fdf168ed0745 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:35.067684 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551dfa5-ca97-4cee-baf0-fdf168ed0745 None admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:35.068902 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6551dfa5-ca97-4cee-baf0-fdf168ed0745 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:35.069407 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6551dfa5-ca97-4cee-baf0-fdf168ed0745 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:35.071846 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6551dfa5-ca97-4cee-baf0-fdf168ed0745 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:35.088557 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 240/474] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:43:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:35.105114 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551dfa5-ca97-4cee-baf0-fdf168ed0745 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:35.183925 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:35.192066 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ba311-911b-4572-b483-82dd1139d718 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:35.202888 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:35.230935 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551dfa5-ca97-4cee-baf0-fdf168ed0745 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:35.241556 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188b564-588c-4510-a6a5-8379a8904c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:35.242668 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188b564-588c-4510-a6a5-8379a8904c59 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:35.243112 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188b564-588c-4510-a6a5-8379a8904c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:35.243767 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188b564-588c-4510-a6a5-8379a8904c59 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:35.244730 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6188b564-588c-4510-a6a5-8379a8904c59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:35.245218 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6188b564-588c-4510-a6a5-8379a8904c59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:35.246971 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6188b564-588c-4510-a6a5-8379a8904c59 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:35.261096 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 235/475] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:35.262305 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188b564-588c-4510-a6a5-8379a8904c59 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:35.277889 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f528c-dc03-40db-8e19-3d08c2a65f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:35.278497 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f528c-dc03-40db-8e19-3d08c2a65f19 None admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:35.278786 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f528c-dc03-40db-8e19-3d08c2a65f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:35.279066 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f528c-dc03-40db-8e19-3d08c2a65f19 None admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:35.280012 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f528c-dc03-40db-8e19-3d08c2a65f19 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:35.281478 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f528c-dc03-40db-8e19-3d08c2a65f19 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:35.377766 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 241/476] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Jul 1 03:43:35 2022] POST /identity/v3/users => generated 248 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 03:43:35.379393 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f528c-dc03-40db-8e19-3d08c2a65f19 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:35.386799 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188b564-588c-4510-a6a5-8379a8904c59 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:35.450523 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b587ffd-c96f-4f61-8c93-5b66997ccf53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:35.451700 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b587ffd-c96f-4f61-8c93-5b66997ccf53 None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:35.452250 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b587ffd-c96f-4f61-8c93-5b66997ccf53 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:35.452760 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b587ffd-c96f-4f61-8c93-5b66997ccf53 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:35.453821 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b587ffd-c96f-4f61-8c93-5b66997ccf53 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:35.455667 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b587ffd-c96f-4f61-8c93-5b66997ccf53 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:35.504324 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.sql.core [None req-3b587ffd-c96f-4f61-8c93-5b66997ccf53 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 01 03:43:35.504324 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 01 03:43:35.504324 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [parameters: {'id': 'db0263dece28495da7ce7e36e1bada46', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 01 03:43:35.504324 dv-cinder-846842-8-smb devstack@keystone.service[80377]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80377) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 01 03:43:35.526117 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-3b587ffd-c96f-4f61-8c93-5b66997ccf53 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 01 03:43:35.526117 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:35.526117 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 01 03:43:35.526117 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 01 03:43:35.526117 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 01 03:43:35.526117 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 01 03:43:35.526117 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 01 03:43:35.526117 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application result = self._query(query) Jul 01 03:43:35.526117 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 01 03:43:35.526117 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application conn.query(q) Jul 01 03:43:35.526117 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 01 03:43:35.526117 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 01 03:43:35.526117 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 01 03:43:35.526117 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application result.read() Jul 01 03:43:35.526117 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 01 03:43:35.527132 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 01 03:43:35.527132 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 01 03:43:35.527132 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 01 03:43:35.527132 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 01 03:43:35.527132 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 01 03:43:35.527132 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 01 03:43:35.527132 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 01 03:43:35.527132 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 01 03:43:35.527132 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:35.527132 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 01 03:43:35.527132 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:35.527132 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:35.527132 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 01 03:43:35.527132 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 01 03:43:35.527132 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 01 03:43:35.527132 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return ref.to_dict() Jul 01 03:43:35.527132 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 01 03:43:35.527132 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application next(self.gen) Jul 01 03:43:35.528224 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 01 03:43:35.528224 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application yield resource Jul 01 03:43:35.528224 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 01 03:43:35.528224 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application next(self.gen) Jul 01 03:43:35.528224 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 01 03:43:35.528224 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self.session.rollback() Jul 01 03:43:35.528224 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 03:43:35.528224 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self.force_reraise() Jul 01 03:43:35.528224 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 03:43:35.528224 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise self.value Jul 01 03:43:35.528224 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 01 03:43:35.528224 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 01 03:43:35.528224 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 01 03:43:35.528224 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application session.commit() Jul 01 03:43:35.528224 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 01 03:43:35.528224 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 01 03:43:35.528224 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 01 03:43:35.529079 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._prepare_impl() Jul 01 03:43:35.529079 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 01 03:43:35.529079 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self.session.flush() Jul 01 03:43:35.529079 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 01 03:43:35.529079 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._flush(objects) Jul 01 03:43:35.529079 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 01 03:43:35.529079 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 01 03:43:35.529079 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 01 03:43:35.529079 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application compat.raise_( Jul 01 03:43:35.529079 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 01 03:43:35.529079 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception Jul 01 03:43:35.529079 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 01 03:43:35.529079 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application flush_context.execute() Jul 01 03:43:35.529079 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 01 03:43:35.529079 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rec.execute(self) Jul 01 03:43:35.529079 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 01 03:43:35.529079 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 01 03:43:35.529954 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 01 03:43:35.529954 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 01 03:43:35.529954 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 01 03:43:35.529954 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 01 03:43:35.529954 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 01 03:43:35.529954 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 01 03:43:35.529954 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 01 03:43:35.529954 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 01 03:43:35.529954 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 01 03:43:35.529954 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 01 03:43:35.529954 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 01 03:43:35.529954 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 01 03:43:35.529954 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 01 03:43:35.529954 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 01 03:43:35.529954 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 01 03:43:35.529954 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception Jul 01 03:43:35.530758 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 01 03:43:35.530758 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 01 03:43:35.530758 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 01 03:43:35.530758 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 01 03:43:35.530758 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 01 03:43:35.530758 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application result = self._query(query) Jul 01 03:43:35.530758 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 01 03:43:35.530758 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application conn.query(q) Jul 01 03:43:35.530758 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 01 03:43:35.530758 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 01 03:43:35.530758 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 01 03:43:35.530758 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application result.read() Jul 01 03:43:35.530758 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 01 03:43:35.530758 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 01 03:43:35.530758 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 01 03:43:35.530758 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 01 03:43:35.533240 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 01 03:43:35.533240 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 01 03:43:35.533240 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 01 03:43:35.533240 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 01 03:43:35.533240 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 01 03:43:35.533240 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 01 03:43:35.533240 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [parameters: {'id': 'db0263dece28495da7ce7e36e1bada46', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 01 03:43:35.533240 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 01 03:43:35.533240 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:35.533240 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 03:43:35.533240 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:35.533240 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:35.533240 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:35.533240 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:35.533240 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:35.533240 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:35.535230 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:35.535230 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:35.535230 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:35.535230 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:35.535230 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:35.535230 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:35.535230 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 01 03:43:35.535230 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 01 03:43:35.535230 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:35.535230 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:35.535230 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 01 03:43:35.535230 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 01 03:43:35.535230 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 01 03:43:35.535230 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 01 03:43:35.535230 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 01 03:43:35.535230 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:35.540719 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 236/477] 10.222.0.46 () {60 vars in 1131 bytes} [Fri Jul 1 03:43:35 2022] POST /identity/v3/roles => generated 144 bytes in 279 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:35.547002 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b587ffd-c96f-4f61-8c93-5b66997ccf53 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:35.586619 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f528c-dc03-40db-8e19-3d08c2a65f19 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:35.592595 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:35.599336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:35.628782 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230000f8-8174-4293-a4e2-afde94303996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:35.629518 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230000f8-8174-4293-a4e2-afde94303996 None admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:35.630443 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230000f8-8174-4293-a4e2-afde94303996 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:35.630728 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230000f8-8174-4293-a4e2-afde94303996 None admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:35.631468 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230000f8-8174-4293-a4e2-afde94303996 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:35.632986 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230000f8-8174-4293-a4e2-afde94303996 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:35.683777 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b587ffd-c96f-4f61-8c93-5b66997ccf53 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:35.727541 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 242/478] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Jul 1 03:43:35 2022] POST /identity/v3/users => generated 249 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 03:43:35.728938 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34873d1-f02a-4039-aee5-1c0a8e64188a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:35.730077 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34873d1-f02a-4039-aee5-1c0a8e64188a None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:35.730410 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34873d1-f02a-4039-aee5-1c0a8e64188a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:35.730745 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34873d1-f02a-4039-aee5-1c0a8e64188a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:35.743866 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34873d1-f02a-4039-aee5-1c0a8e64188a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:43:35.752610 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-c34873d1-f02a-4039-aee5-1c0a8e64188a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 03:43:35.752610 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:35.752610 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:35.752610 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:35.752610 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:35.752610 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:35.752610 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:35.752610 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:35.752610 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:35.752610 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:35.752610 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:35.752610 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:35.752610 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:43:35.752610 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:43:35.752610 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:43:35.752610 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:43:35.753557 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:43:35.753557 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:43:35.753557 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:43:35.753557 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:43:35.753557 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:35.753557 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:35.753557 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:35.753557 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:35.753557 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:35.753557 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:35.753557 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:35.753557 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:35.753557 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:35.753557 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:35.753557 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:35.753557 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:35.754418 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:35.754418 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:35.754418 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:35.754418 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:35.754418 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:43:35.754418 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:43:35.754418 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:43:35.754418 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:43:35.754418 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:43:35.754418 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:43:35.754418 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 03:43:35.754418 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:35.754418 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 237/479] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Jul 1 03:43:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:35.762268 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230000f8-8174-4293-a4e2-afde94303996 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:35.885850 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230000f8-8174-4293-a4e2-afde94303996 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:35.923977 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb771bc-d4d7-4072-b367-5a4ea23a6f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:35.924743 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb771bc-d4d7-4072-b367-5a4ea23a6f21 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:35.925024 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb771bc-d4d7-4072-b367-5a4ea23a6f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:35.925298 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb771bc-d4d7-4072-b367-5a4ea23a6f21 None admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:35.926048 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb771bc-d4d7-4072-b367-5a4ea23a6f21 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:35.926355 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb771bc-d4d7-4072-b367-5a4ea23a6f21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:35.928315 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb771bc-d4d7-4072-b367-5a4ea23a6f21 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:35.937672 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 243/480] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:43:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:43:36.820138 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7affb3a3-c809-47c6-94c0-427a6ef88168 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:36.820629 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7affb3a3-c809-47c6-94c0-427a6ef88168 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:36.820629 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7affb3a3-c809-47c6-94c0-427a6ef88168 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:36.822323 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 238/481] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:43:36.837644 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b813a1-f800-48c5-a3ee-3a2585c2c5a1 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:36.838180 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b813a1-f800-48c5-a3ee-3a2585c2c5a1 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:36.838256 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b813a1-f800-48c5-a3ee-3a2585c2c5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:36.860534 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-78b813a1-f800-48c5-a3ee-3a2585c2c5a1 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:43:36.861747 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-78b813a1-f800-48c5-a3ee-3a2585c2c5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:43:36.887029 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:36.976272 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 244/482] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:43:37.020250 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7affb3a3-c809-47c6-94c0-427a6ef88168 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:37.200010 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7affb3a3-c809-47c6-94c0-427a6ef88168 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:37.207910 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:37.266443 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede1167-22cc-4d66-88fd-7d57637f698f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:37.267273 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede1167-22cc-4d66-88fd-7d57637f698f None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:37.267582 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede1167-22cc-4d66-88fd-7d57637f698f None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:37.267856 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede1167-22cc-4d66-88fd-7d57637f698f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:37.289273 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ede1167-22cc-4d66-88fd-7d57637f698f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:43:37.302174 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-8ede1167-22cc-4d66-88fd-7d57637f698f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 03:43:37.302174 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:37.302174 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:37.302174 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:37.302174 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:37.302174 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:37.302174 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:37.302174 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:37.302174 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:37.302174 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:37.302174 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:37.302174 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:37.302174 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:43:37.302174 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:43:37.302174 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:43:37.302174 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:43:37.303140 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:43:37.303140 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:43:37.303140 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:43:37.303140 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:43:37.303140 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:37.303140 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:37.303140 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:37.303140 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:37.303140 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:37.303140 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:37.303140 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:37.303140 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:37.303140 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:37.303140 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:37.303140 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:37.303140 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:37.303955 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:37.303955 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:37.303955 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:37.303955 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:37.303955 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:43:37.303955 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:43:37.303955 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:43:37.303955 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:43:37.303955 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:43:37.303955 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:43:37.303955 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 03:43:37.303955 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:37.303955 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 239/483] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Jul 1 03:43:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:37.310552 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b813a1-f800-48c5-a3ee-3a2585c2c5a1 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:37.501249 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b813a1-f800-48c5-a3ee-3a2585c2c5a1 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:37.560768 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ecab04-6ef2-43c9-9b73-63371a721a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:37.561449 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ecab04-6ef2-43c9-9b73-63371a721a3d None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:37.561732 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ecab04-6ef2-43c9-9b73-63371a721a3d None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:37.562009 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ecab04-6ef2-43c9-9b73-63371a721a3d None admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:37.562767 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ecab04-6ef2-43c9-9b73-63371a721a3d None admin] RBAC: Adding query filter params (name=service) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:37.563068 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ecab04-6ef2-43c9-9b73-63371a721a3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:37.564480 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ecab04-6ef2-43c9-9b73-63371a721a3d None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:37.579927 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 245/484] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Jul 1 03:43:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:37.585747 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede1167-22cc-4d66-88fd-7d57637f698f None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:37.781200 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede1167-22cc-4d66-88fd-7d57637f698f None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:37.804607 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692a9a7-cc6d-4082-8949-dc1852c9c529 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:37.804885 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692a9a7-cc6d-4082-8949-dc1852c9c529 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:37.805198 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692a9a7-cc6d-4082-8949-dc1852c9c529 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:37.806533 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 246/485] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:43:37.816639 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f83bb1-4578-44c8-8384-5ba9783451b0 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:37.818083 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f83bb1-4578-44c8-8384-5ba9783451b0 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:37.818876 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f83bb1-4578-44c8-8384-5ba9783451b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:37.855392 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-64f83bb1-4578-44c8-8384-5ba9783451b0 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:43:37.858979 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-64f83bb1-4578-44c8-8384-5ba9783451b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:43:37.860177 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685d682-6cb0-441c-b7b2-31c90aba4e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:37.861042 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685d682-6cb0-441c-b7b2-31c90aba4e70 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:37.861323 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685d682-6cb0-441c-b7b2-31c90aba4e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:37.861592 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685d682-6cb0-441c-b7b2-31c90aba4e70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:37.885783 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4685d682-6cb0-441c-b7b2-31c90aba4e70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:37.887292 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4685d682-6cb0-441c-b7b2-31c90aba4e70 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:37.892335 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:37.928639 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-4685d682-6cb0-441c-b7b2-31c90aba4e70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:37.928639 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:37.928639 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:37.928639 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:37.928639 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:37.928639 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:37.928639 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:37.928639 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:37.928639 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:37.928639 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:37.928639 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:37.928639 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:37.928639 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:43:37.928639 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:43:37.928639 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:43:37.930715 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:43:37.930715 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:37.930715 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:37.930715 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:37.930715 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:37.930715 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:37.930715 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:37.930715 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:37.930715 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:37.930715 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:37.930715 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:37.930715 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:37.930715 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:37.930715 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:37.930715 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:37.930715 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:37.930715 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:37.932896 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:43:37.932896 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:43:37.932896 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:37.932896 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:37.932896 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 240/486] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:43:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:37.940501 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685d682-6cb0-441c-b7b2-31c90aba4e70 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:37.951864 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:38.016765 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 247/487] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:43:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 03:43:38.064556 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f83bb1-4578-44c8-8384-5ba9783451b0 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:38.253804 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685d682-6cb0-441c-b7b2-31c90aba4e70 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:38.277606 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f83bb1-4578-44c8-8384-5ba9783451b0 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:38.340514 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06743d-f9ac-4cf0-8a20-a1184a9b4de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:38.341185 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06743d-f9ac-4cf0-8a20-a1184a9b4de4 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:38.341470 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06743d-f9ac-4cf0-8a20-a1184a9b4de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:38.341791 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06743d-f9ac-4cf0-8a20-a1184a9b4de4 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:38.342782 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d06743d-f9ac-4cf0-8a20-a1184a9b4de4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:38.343093 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d06743d-f9ac-4cf0-8a20-a1184a9b4de4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:38.344533 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d06743d-f9ac-4cf0-8a20-a1184a9b4de4 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:38.351439 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055ea53-0afd-4f4a-91ae-01e8cf2b2d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:38.354005 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055ea53-0afd-4f4a-91ae-01e8cf2b2d15 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:38.354871 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055ea53-0afd-4f4a-91ae-01e8cf2b2d15 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:38.355691 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055ea53-0afd-4f4a-91ae-01e8cf2b2d15 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:38.374079 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 241/488] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:38.378225 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5055ea53-0afd-4f4a-91ae-01e8cf2b2d15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:43:38.382536 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06743d-f9ac-4cf0-8a20-a1184a9b4de4 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:38.395889 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-5055ea53-0afd-4f4a-91ae-01e8cf2b2d15 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 03:43:38.395889 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:38.395889 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:38.395889 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:38.395889 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:38.395889 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:38.395889 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:38.395889 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:38.395889 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:38.395889 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:38.395889 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:38.395889 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:38.395889 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:43:38.395889 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:43:38.395889 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:43:38.395889 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:43:38.397639 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:43:38.397639 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:43:38.397639 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:43:38.397639 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:43:38.397639 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:38.397639 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:38.397639 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:38.397639 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:38.397639 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:38.397639 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:38.397639 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:38.397639 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:38.397639 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:38.397639 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:38.397639 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:38.397639 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:38.399203 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:38.399203 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:38.399203 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:38.399203 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:38.399203 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:43:38.399203 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:43:38.399203 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:43:38.399203 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:43:38.399203 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:43:38.399203 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:43:38.399203 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 03:43:38.399203 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:38.404892 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 248/489] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Jul 1 03:43:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:38.407612 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b56440-2e57-4367-8fff-9064c47ae7e3 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:38.409174 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b56440-2e57-4367-8fff-9064c47ae7e3 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:38.409907 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b56440-2e57-4367-8fff-9064c47ae7e3 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:38.414905 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 249/490] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:43:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:43:38.416896 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b56440-2e57-4367-8fff-9064c47ae7e3 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:38.437962 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:38.473058 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:38.518557 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06743d-f9ac-4cf0-8a20-a1184a9b4de4 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:38.556686 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e906007-cffe-4635-b3c1-f90f350b184d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:38.557498 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e906007-cffe-4635-b3c1-f90f350b184d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:38.557780 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e906007-cffe-4635-b3c1-f90f350b184d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:38.558057 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e906007-cffe-4635-b3c1-f90f350b184d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:38.566220 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e906007-cffe-4635-b3c1-f90f350b184d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:38.568292 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e906007-cffe-4635-b3c1-f90f350b184d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:38.585901 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-1e906007-cffe-4635-b3c1-f90f350b184d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 01 03:43:38.585901 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:38.585901 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:38.585901 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:38.585901 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:38.585901 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:38.585901 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:38.585901 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:38.585901 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:38.585901 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:38.585901 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:38.585901 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:38.585901 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 03:43:38.585901 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 03:43:38.585901 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 03:43:38.585901 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 03:43:38.587658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:38.587658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:38.587658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 03:43:38.587658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:43:38.587658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 03:43:38.587658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:43:38.587658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:38.587658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:38.587658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:38.587658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:38.587658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:38.587658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:38.587658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:38.587658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:38.587658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:38.587658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:38.587658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:38.587658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:38.589360 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:38.589360 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:38.589360 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 03:43:38.589360 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 03:43:38.589360 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 03:43:38.589360 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 03:43:38.589360 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 03:43:38.589360 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 03:43:38.589360 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 01 03:43:38.589360 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:38.589360 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 242/491] 10.222.0.46 () {56 vars in 1093 bytes} [Fri Jul 1 03:43:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:38.589360 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9fe5b4-62d2-47ef-8937-af4c06940227 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:38.589360 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9fe5b4-62d2-47ef-8937-af4c06940227 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:38.591728 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9fe5b4-62d2-47ef-8937-af4c06940227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:38.606761 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-1f9fe5b4-62d2-47ef-8937-af4c06940227 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:43:38.608001 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1f9fe5b4-62d2-47ef-8937-af4c06940227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:43:38.626385 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b56440-2e57-4367-8fff-9064c47ae7e3 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:38.691109 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8526cc-b9b2-446c-b791-a5d6f6a275fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:38.691731 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 243/492] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:43:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:43:38.693256 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9fe5b4-62d2-47ef-8937-af4c06940227 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:38.693867 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8526cc-b9b2-446c-b791-a5d6f6a275fe None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:38.694627 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8526cc-b9b2-446c-b791-a5d6f6a275fe None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:38.695411 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8526cc-b9b2-446c-b791-a5d6f6a275fe None admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:38.697178 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8526cc-b9b2-446c-b791-a5d6f6a275fe None admin] RBAC: Adding query filter params (name=service) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:38.698033 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8526cc-b9b2-446c-b791-a5d6f6a275fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:38.700894 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8526cc-b9b2-446c-b791-a5d6f6a275fe None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:38.717721 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 250/493] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Jul 1 03:43:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:38.726456 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8526cc-b9b2-446c-b791-a5d6f6a275fe None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:38.794115 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:38.854763 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:38.863225 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9fe5b4-62d2-47ef-8937-af4c06940227 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:38.895932 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8526cc-b9b2-446c-b791-a5d6f6a275fe None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:38.930461 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992df50-152b-4e87-95dd-2dffb495523c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:38.932134 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992df50-152b-4e87-95dd-2dffb495523c None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:38.932867 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992df50-152b-4e87-95dd-2dffb495523c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:38.933522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992df50-152b-4e87-95dd-2dffb495523c None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:38.936163 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5992df50-152b-4e87-95dd-2dffb495523c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:38.937038 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5992df50-152b-4e87-95dd-2dffb495523c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:38.937260 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3dd08-c37b-4d0a-a688-264774a6db3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:38.938074 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3dd08-c37b-4d0a-a688-264774a6db3c None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:38.938355 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3dd08-c37b-4d0a-a688-264774a6db3c None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:38.938631 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3dd08-c37b-4d0a-a688-264774a6db3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:38.941234 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5992df50-152b-4e87-95dd-2dffb495523c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:38.951685 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb3dd08-c37b-4d0a-a688-264774a6db3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:38.953178 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb3dd08-c37b-4d0a-a688-264774a6db3c None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:38.973153 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-deb3dd08-c37b-4d0a-a688-264774a6db3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:38.973153 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:38.973153 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:38.973153 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:38.973153 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:38.973153 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:38.973153 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:38.973153 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:38.973153 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:38.973153 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:38.973153 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:38.973153 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:38.973153 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:43:38.973153 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:43:38.973153 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:43:38.981878 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:43:38.981878 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:38.981878 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:38.981878 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:38.981878 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:38.981878 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:38.981878 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:38.981878 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:38.981878 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:38.981878 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:38.981878 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:38.981878 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:38.981878 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:38.981878 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:38.981878 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:38.981878 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:38.981878 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:38.983681 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:43:38.983681 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:43:38.983681 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:38.983681 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:38.983681 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 251/494] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:43:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:38.983681 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3dd08-c37b-4d0a-a688-264774a6db3c None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:39.035662 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 244/495] 10.222.0.46 () {56 vars in 1133 bytes} [Fri Jul 1 03:43:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:39.037761 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992df50-152b-4e87-95dd-2dffb495523c None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:39.099093 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3dd08-c37b-4d0a-a688-264774a6db3c None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:39.125559 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:39.140387 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ee832-1858-4505-b384-5a3d7c900455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:39.141229 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ee832-1858-4505-b384-5a3d7c900455 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:39.141473 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ee832-1858-4505-b384-5a3d7c900455 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:39.141746 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ee832-1858-4505-b384-5a3d7c900455 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:39.154225 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ee832-1858-4505-b384-5a3d7c900455 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:39.155748 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ee832-1858-4505-b384-5a3d7c900455 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:39.177778 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-e27ee832-1858-4505-b384-5a3d7c900455 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:39.177778 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:39.177778 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:39.177778 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:39.177778 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:39.177778 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:39.177778 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:39.177778 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:39.177778 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:39.177778 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:39.177778 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:39.177778 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:39.177778 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:43:39.177778 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:43:39.177778 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:43:39.179646 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:43:39.179646 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:39.179646 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:39.179646 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:39.179646 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:39.179646 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:39.179646 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:39.179646 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:39.179646 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:39.179646 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:39.179646 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:39.179646 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:39.179646 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:39.179646 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:39.179646 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:39.179646 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:39.179646 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:39.181205 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:43:39.181205 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:43:39.181205 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:39.181205 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:39.181205 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 252/496] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:43:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:39.181205 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ee832-1858-4505-b384-5a3d7c900455 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:39.187316 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992df50-152b-4e87-95dd-2dffb495523c None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:39.203411 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:39.233362 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8cbcf-93b6-4eda-8f20-b703b34c5a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:39.234383 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8cbcf-93b6-4eda-8f20-b703b34c5a1e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:39.234934 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8cbcf-93b6-4eda-8f20-b703b34c5a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:39.235580 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8cbcf-93b6-4eda-8f20-b703b34c5a1e None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:39.236342 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e8cbcf-93b6-4eda-8f20-b703b34c5a1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:39.236657 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e8cbcf-93b6-4eda-8f20-b703b34c5a1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:39.238173 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e8cbcf-93b6-4eda-8f20-b703b34c5a1e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:39.251338 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 245/497] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:39.252788 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8cceb9-7e6a-4382-b19d-56c44c326857 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:39.253074 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8cceb9-7e6a-4382-b19d-56c44c326857 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:39.253359 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8cceb9-7e6a-4382-b19d-56c44c326857 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:39.255299 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 246/498] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:43:39.260859 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36833316-4532-4de2-9907-4a7f5c946b11 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:39.261162 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36833316-4532-4de2-9907-4a7f5c946b11 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:39.261413 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36833316-4532-4de2-9907-4a7f5c946b11 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:39.262892 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 247/499] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:43:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:43:39.263753 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36833316-4532-4de2-9907-4a7f5c946b11 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:39.302818 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ee832-1858-4505-b384-5a3d7c900455 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:39.345296 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef3c57-716d-434c-80e6-287ad90d2652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:39.346124 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef3c57-716d-434c-80e6-287ad90d2652 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:39.346524 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef3c57-716d-434c-80e6-287ad90d2652 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:39.346929 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef3c57-716d-434c-80e6-287ad90d2652 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:39.380765 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36833316-4532-4de2-9907-4a7f5c946b11 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:39.401292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:39.439821 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c28a03-71b0-4503-8739-5ee28d83babf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:39.440921 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c28a03-71b0-4503-8739-5ee28d83babf None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:39.441373 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c28a03-71b0-4503-8739-5ee28d83babf None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:39.442336 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c28a03-71b0-4503-8739-5ee28d83babf None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:39.442566 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ef3c57-716d-434c-80e6-287ad90d2652 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:39.443705 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c28a03-71b0-4503-8739-5ee28d83babf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:39.444267 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c28a03-71b0-4503-8739-5ee28d83babf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:39.445147 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ef3c57-716d-434c-80e6-287ad90d2652 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:39.446573 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c28a03-71b0-4503-8739-5ee28d83babf None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:39.466731 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 248/500] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:39.468027 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c28a03-71b0-4503-8739-5ee28d83babf None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:39.503582 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:39.579278 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 253/501] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:43:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 03:43:39.580688 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd2cf4-5f8b-4a2e-9e88-94a75bfadafc None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:39.580959 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd2cf4-5f8b-4a2e-9e88-94a75bfadafc None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:39.581158 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd2cf4-5f8b-4a2e-9e88-94a75bfadafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:39.592976 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c28a03-71b0-4503-8739-5ee28d83babf None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:39.601012 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-92cd2cf4-5f8b-4a2e-9e88-94a75bfadafc None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:43:39.602216 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-92cd2cf4-5f8b-4a2e-9e88-94a75bfadafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:43:39.629286 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b474cf-f765-4652-a42c-0a3f6ae59bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:39.630732 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b474cf-f765-4652-a42c-0a3f6ae59bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:39.631111 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b474cf-f765-4652-a42c-0a3f6ae59bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:39.631279 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b474cf-f765-4652-a42c-0a3f6ae59bb8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:39.644726 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b474cf-f765-4652-a42c-0a3f6ae59bb8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:39.647530 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b474cf-f765-4652-a42c-0a3f6ae59bb8 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:39.676144 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-c0b474cf-f765-4652-a42c-0a3f6ae59bb8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 01 03:43:39.676144 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:39.676144 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:39.676144 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:39.676144 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:39.676144 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:39.676144 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:39.676144 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:39.676144 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:39.676144 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:39.676144 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:39.676144 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:39.676144 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 03:43:39.676144 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 03:43:39.676144 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 03:43:39.676144 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 03:43:39.677811 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:39.677811 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:39.677811 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 03:43:39.677811 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:43:39.677811 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 03:43:39.677811 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:43:39.677811 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:39.677811 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:39.677811 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:39.677811 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:39.677811 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:39.677811 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:39.677811 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:39.677811 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:39.677811 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:39.677811 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:39.677811 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:39.677811 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:39.678898 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:39.678898 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:39.678898 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 03:43:39.678898 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 03:43:39.678898 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 03:43:39.678898 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 03:43:39.678898 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 03:43:39.678898 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 03:43:39.678898 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 01 03:43:39.678898 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:39.678898 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 249/502] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:43:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:39.679742 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cc9af-40e4-4799-a962-70d7e15a30a0 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:39.679826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cc9af-40e4-4799-a962-70d7e15a30a0 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:39.680052 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cc9af-40e4-4799-a962-70d7e15a30a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:39.682368 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 254/503] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:43:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:43:39.683813 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd2cf4-5f8b-4a2e-9e88-94a75bfadafc None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:39.693799 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:39.710663 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-131cc9af-40e4-4799-a962-70d7e15a30a0 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:43:39.711979 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-131cc9af-40e4-4799-a962-70d7e15a30a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:43:39.786692 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 250/504] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:43:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:43:39.787834 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131cc9af-40e4-4799-a962-70d7e15a30a0 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:39.812769 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:39.819962 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd2cf4-5f8b-4a2e-9e88-94a75bfadafc None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:39.857678 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034811f8-99c2-4b07-abd6-fa2705f7c538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:39.858357 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034811f8-99c2-4b07-abd6-fa2705f7c538 None admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:39.858730 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034811f8-99c2-4b07-abd6-fa2705f7c538 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:39.859023 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034811f8-99c2-4b07-abd6-fa2705f7c538 None admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:39.859804 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034811f8-99c2-4b07-abd6-fa2705f7c538 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:39.861279 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034811f8-99c2-4b07-abd6-fa2705f7c538 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:39.911119 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131cc9af-40e4-4799-a962-70d7e15a30a0 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:39.948141 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ee438-7931-4bfd-bc9d-0c58b8ae97ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:39.948952 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ee438-7931-4bfd-bc9d-0c58b8ae97ab None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:39.949232 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ee438-7931-4bfd-bc9d-0c58b8ae97ab None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:39.949505 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ee438-7931-4bfd-bc9d-0c58b8ae97ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:39.957766 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 255/505] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Jul 1 03:43:39 2022] POST /identity/v3/users => generated 247 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 03:43:39.959569 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034811f8-99c2-4b07-abd6-fa2705f7c538 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:39.960916 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747ee438-7931-4bfd-bc9d-0c58b8ae97ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:39.962444 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747ee438-7931-4bfd-bc9d-0c58b8ae97ab None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:39.982937 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-747ee438-7931-4bfd-bc9d-0c58b8ae97ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:39.982937 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:39.982937 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:39.982937 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:39.982937 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:39.982937 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:39.982937 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:39.982937 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:39.982937 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:39.982937 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:39.982937 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:39.982937 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:39.982937 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:43:39.982937 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:43:39.982937 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:43:39.991301 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:43:39.991301 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:39.991301 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:39.991301 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:39.991301 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:39.991301 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:39.991301 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:39.991301 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:39.991301 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:39.991301 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:39.991301 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:39.991301 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:39.991301 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:39.991301 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:39.991301 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:39.991301 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:39.991301 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:39.992647 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:43:39.992647 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:43:39.992647 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:39.992647 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:39.992647 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 251/506] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:43:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:39.992647 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ee438-7931-4bfd-bc9d-0c58b8ae97ab None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:40.058548 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:40.096232 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:40.130837 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034811f8-99c2-4b07-abd6-fa2705f7c538 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:40.131182 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ee438-7931-4bfd-bc9d-0c58b8ae97ab None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:40.255673 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b43a7-0d08-4b34-a711-9be85ad83f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:40.256369 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b43a7-0d08-4b34-a711-9be85ad83f96 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:40.256653 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b43a7-0d08-4b34-a711-9be85ad83f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:40.256933 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b43a7-0d08-4b34-a711-9be85ad83f96 None admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:40.257817 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b43a7-0d08-4b34-a711-9be85ad83f96 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:40.258132 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b43a7-0d08-4b34-a711-9be85ad83f96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:40.259632 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b43a7-0d08-4b34-a711-9be85ad83f96 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:40.270886 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085c1ce-a60a-4bff-ad06-e319398075f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:40.272286 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085c1ce-a60a-4bff-ad06-e319398075f9 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:40.272787 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085c1ce-a60a-4bff-ad06-e319398075f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:40.273287 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085c1ce-a60a-4bff-ad06-e319398075f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:40.292192 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7085c1ce-a60a-4bff-ad06-e319398075f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:43:40.308284 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 256/507] 10.222.0.46 () {56 vars in 1137 bytes} [Fri Jul 1 03:43:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:40.308284 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b43a7-0d08-4b34-a711-9be85ad83f96 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:40.308550 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-7085c1ce-a60a-4bff-ad06-e319398075f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 03:43:40.308550 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:40.308550 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:40.308550 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:40.308550 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:40.308550 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:40.308550 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:40.308550 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:40.308550 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:40.308550 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:40.308550 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:40.308550 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:40.308550 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:43:40.308550 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:43:40.308550 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:43:40.308550 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:43:40.309383 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:43:40.309383 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:43:40.309383 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:43:40.309383 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:43:40.309383 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:40.309383 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:40.309383 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:40.309383 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:40.309383 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:40.309383 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:40.309383 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:40.309383 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:40.309383 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:40.309383 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:40.309383 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:40.309383 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:40.310207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:40.310207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:40.310207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:40.310207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:40.310207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:43:40.310207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:43:40.310207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:43:40.310207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:43:40.310207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:43:40.310207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:43:40.310207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 03:43:40.310207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:40.310207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 252/508] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Jul 1 03:43:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:40.310207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085c1ce-a60a-4bff-ad06-e319398075f9 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:40.464162 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b43a7-0d08-4b34-a711-9be85ad83f96 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:40.464431 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085c1ce-a60a-4bff-ad06-e319398075f9 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:40.491665 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:40.507626 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90101b-8749-4ee6-95ba-af1ab5cdf894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:40.507626 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90101b-8749-4ee6-95ba-af1ab5cdf894 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:40.507626 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90101b-8749-4ee6-95ba-af1ab5cdf894 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:40.507626 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90101b-8749-4ee6-95ba-af1ab5cdf894 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:40.524716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f90101b-8749-4ee6-95ba-af1ab5cdf894 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:43:40.532274 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a8bde-6734-40e4-8cbe-b50447c05434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:40.533428 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a8bde-6734-40e4-8cbe-b50447c05434 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:40.533936 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a8bde-6734-40e4-8cbe-b50447c05434 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:40.534234 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-7f90101b-8749-4ee6-95ba-af1ab5cdf894 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 03:43:40.534234 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:40.534234 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:40.534234 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:40.534234 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:40.534234 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:40.534234 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:40.534234 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:40.534234 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:40.534234 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:40.534234 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:40.534234 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:40.534234 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:43:40.534234 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:43:40.534234 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:43:40.534234 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:43:40.536742 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:43:40.536742 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:43:40.536742 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:43:40.536742 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:43:40.536742 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:40.536742 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:40.536742 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:40.536742 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:40.536742 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:40.536742 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:40.536742 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:40.536742 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:40.536742 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:40.536742 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:40.536742 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:40.536742 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:40.538865 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:40.538865 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:40.538865 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:40.538865 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:40.538865 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:43:40.538865 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:43:40.538865 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:43:40.538865 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:43:40.538865 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:43:40.538865 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:43:40.538865 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 03:43:40.538865 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:40.540202 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a8bde-6734-40e4-8cbe-b50447c05434 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:40.540202 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023a8bde-6734-40e4-8cbe-b50447c05434 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:40.540202 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023a8bde-6734-40e4-8cbe-b50447c05434 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:40.540202 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023a8bde-6734-40e4-8cbe-b50447c05434 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:40.548823 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 257/509] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Jul 1 03:43:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:40.550225 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90101b-8749-4ee6-95ba-af1ab5cdf894 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:40.555336 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:40.562936 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 253/510] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:40.564017 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a8bde-6734-40e4-8cbe-b50447c05434 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:40.690799 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90101b-8749-4ee6-95ba-af1ab5cdf894 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:40.702267 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a8bde-6734-40e4-8cbe-b50447c05434 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:40.728093 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6c807-7b85-4898-b005-9a95cde0cd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:40.728882 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6c807-7b85-4898-b005-9a95cde0cd54 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:40.729213 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6c807-7b85-4898-b005-9a95cde0cd54 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:40.729542 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6c807-7b85-4898-b005-9a95cde0cd54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:40.756668 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe4ae22-1bbd-453d-a739-259f8b7b1508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:40.757508 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4ae22-1bbd-453d-a739-259f8b7b1508 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:40.757866 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4ae22-1bbd-453d-a739-259f8b7b1508 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:40.758117 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4ae22-1bbd-453d-a739-259f8b7b1508 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:40.758821 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe4ae22-1bbd-453d-a739-259f8b7b1508 None admin] RBAC: Adding query filter params (name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:40.759135 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe4ae22-1bbd-453d-a739-259f8b7b1508 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:40.760615 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe4ae22-1bbd-453d-a739-259f8b7b1508 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:40.769686 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 254/511] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Jul 1 03:43:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:40.770573 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe4ae22-1bbd-453d-a739-259f8b7b1508 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:40.807982 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:40.831311 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6c807-7b85-4898-b005-9a95cde0cd54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:40.832885 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6c807-7b85-4898-b005-9a95cde0cd54 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:40.880859 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:40.948210 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe4ae22-1bbd-453d-a739-259f8b7b1508 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:40.959177 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 258/512] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:43:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 03:43:40.959177 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6c807-7b85-4898-b005-9a95cde0cd54 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:40.999061 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a835b-ccfc-4254-a02c-76860d96c4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:40.999904 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a835b-ccfc-4254-a02c-76860d96c4e4 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:41.000187 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a835b-ccfc-4254-a02c-76860d96c4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:41.000461 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a835b-ccfc-4254-a02c-76860d96c4e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:41.001217 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a835b-ccfc-4254-a02c-76860d96c4e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:41.001523 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a835b-ccfc-4254-a02c-76860d96c4e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:41.002965 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a835b-ccfc-4254-a02c-76860d96c4e4 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:41.013083 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 255/513] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Jul 1 03:43:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:41.013971 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a835b-ccfc-4254-a02c-76860d96c4e4 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:41.092144 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:41.126623 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6c807-7b85-4898-b005-9a95cde0cd54 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:41.165332 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a835b-ccfc-4254-a02c-76860d96c4e4 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:41.189900 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:41.194536 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b0ba0-c738-420f-ab6e-97ff082e7f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:41.195518 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b0ba0-c738-420f-ab6e-97ff082e7f63 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:41.196054 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b0ba0-c738-420f-ab6e-97ff082e7f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:41.196458 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b0ba0-c738-420f-ab6e-97ff082e7f63 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:41.206515 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b0ba0-c738-420f-ab6e-97ff082e7f63 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:41.208063 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b0ba0-c738-420f-ab6e-97ff082e7f63 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:41.212510 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2beac29-815f-43f8-921c-f8abd0db5cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:41.213508 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2beac29-815f-43f8-921c-f8abd0db5cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:41.213882 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2beac29-815f-43f8-921c-f8abd0db5cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:41.214320 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2beac29-815f-43f8-921c-f8abd0db5cf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:41.223538 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-0b1b0ba0-c738-420f-ab6e-97ff082e7f63 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:43:41.223538 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:41.223538 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:41.223538 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:41.223538 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:41.223538 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:41.223538 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:41.223538 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:41.223538 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:41.223538 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:41.223538 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:41.223538 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:41.223538 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 03:43:41.223538 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 03:43:41.223538 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 03:43:41.225196 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 03:43:41.225196 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:41.225196 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:41.225196 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:41.225196 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:41.225196 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:41.225196 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:41.225196 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:41.225196 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:41.225196 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:41.225196 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:41.225196 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:41.225196 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:41.225196 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:41.225196 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:41.225196 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:41.225196 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:41.226708 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 03:43:41.226708 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 03:43:41.226708 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 03:43:41.226708 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 03:43:41.226708 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 03:43:41.226708 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 03:43:41.226708 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:43:41.226708 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:41.229523 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 259/514] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:43:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:41.230352 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b0ba0-c738-420f-ab6e-97ff082e7f63 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:41.234184 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2beac29-815f-43f8-921c-f8abd0db5cf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:41.236511 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2beac29-815f-43f8-921c-f8abd0db5cf8 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:41.259745 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-c2beac29-815f-43f8-921c-f8abd0db5cf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:41.259745 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:41.259745 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:41.259745 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:41.259745 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:41.259745 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:41.259745 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:41.259745 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:41.259745 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:41.259745 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:41.259745 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:41.259745 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:41.259745 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:43:41.259745 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:43:41.259745 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:43:41.260937 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:43:41.260937 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:41.260937 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:41.260937 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:41.260937 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:41.260937 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:41.260937 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:41.260937 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:41.260937 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:41.260937 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:41.260937 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:41.260937 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:41.260937 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:41.260937 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:41.260937 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:41.260937 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:41.260937 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:41.262369 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:43:41.262369 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:43:41.262369 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:41.262369 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:41.262369 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 256/515] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:43:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:41.262864 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2beac29-815f-43f8-921c-f8abd0db5cf8 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:41.401607 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b0ba0-c738-420f-ab6e-97ff082e7f63 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:41.429528 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2beac29-815f-43f8-921c-f8abd0db5cf8 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:41.463729 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3eacc9-2de9-48da-974a-856926b38ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:41.465343 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3eacc9-2de9-48da-974a-856926b38ec5 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:41.465596 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3eacc9-2de9-48da-974a-856926b38ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:41.466091 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3eacc9-2de9-48da-974a-856926b38ec5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:41.479491 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:41.488127 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3eacc9-2de9-48da-974a-856926b38ec5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:41.489560 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3eacc9-2de9-48da-974a-856926b38ec5 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:41.492344 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf99db-a800-464a-b5c1-f815009c7cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:41.493695 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf99db-a800-464a-b5c1-f815009c7cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:41.494184 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf99db-a800-464a-b5c1-f815009c7cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:41.494637 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf99db-a800-464a-b5c1-f815009c7cb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:41.508289 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bf99db-a800-464a-b5c1-f815009c7cb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:41.509781 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bf99db-a800-464a-b5c1-f815009c7cb2 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:41.522516 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-2c3eacc9-2de9-48da-974a-856926b38ec5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:41.522516 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:41.522516 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:41.522516 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:41.522516 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:41.522516 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:41.522516 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:41.522516 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:41.522516 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:41.522516 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:41.522516 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:41.522516 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:41.522516 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:43:41.522516 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:43:41.522516 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:43:41.523945 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:43:41.523945 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:41.523945 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:41.523945 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:41.523945 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:41.523945 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:41.523945 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:41.523945 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:41.523945 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:41.523945 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:41.523945 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:41.523945 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:41.523945 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:41.523945 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:41.523945 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:41.523945 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:41.523945 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:41.525077 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:43:41.525077 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:43:41.525077 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:41.525077 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:41.525077 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 260/516] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:43:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:41.526266 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3eacc9-2de9-48da-974a-856926b38ec5 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:41.533902 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-16bf99db-a800-464a-b5c1-f815009c7cb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:41.533902 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:41.533902 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:41.533902 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:41.533902 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:41.533902 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:41.533902 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:41.533902 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:41.533902 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:41.533902 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:41.533902 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:41.533902 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:41.533902 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:43:41.533902 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:43:41.533902 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:43:41.535291 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:43:41.535291 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:41.535291 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:41.535291 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:41.535291 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:41.535291 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:41.535291 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:41.535291 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:41.535291 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:41.535291 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:41.535291 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:41.535291 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:41.535291 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:41.535291 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:41.535291 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:41.535291 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:41.535291 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:41.536359 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:43:41.536359 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:43:41.536359 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:41.536359 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:41.539672 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 257/517] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:43:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:41.541364 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf99db-a800-464a-b5c1-f815009c7cb2 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:41.585096 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:41.679754 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3eacc9-2de9-48da-974a-856926b38ec5 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:41.706515 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf99db-a800-464a-b5c1-f815009c7cb2 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:41.720684 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b263cfd-8a81-4a84-b692-af3f783c1e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:41.721362 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b263cfd-8a81-4a84-b692-af3f783c1e5d None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:41.721650 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b263cfd-8a81-4a84-b692-af3f783c1e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:41.721927 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b263cfd-8a81-4a84-b692-af3f783c1e5d None admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:41.722725 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b263cfd-8a81-4a84-b692-af3f783c1e5d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:41.723617 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b263cfd-8a81-4a84-b692-af3f783c1e5d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:41.725731 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b263cfd-8a81-4a84-b692-af3f783c1e5d None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:41.755967 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 261/518] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 1 03:43:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:41.755967 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b263cfd-8a81-4a84-b692-af3f783c1e5d None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:41.762687 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb01f0a-732d-49c7-8b21-261932ed029f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:41.763372 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb01f0a-732d-49c7-8b21-261932ed029f None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:41.763683 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb01f0a-732d-49c7-8b21-261932ed029f None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:41.763957 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb01f0a-732d-49c7-8b21-261932ed029f None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:41.764717 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb01f0a-732d-49c7-8b21-261932ed029f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:41.765024 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb01f0a-732d-49c7-8b21-261932ed029f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:41.766555 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb01f0a-732d-49c7-8b21-261932ed029f None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:41.781387 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 258/519] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:41.782507 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb01f0a-732d-49c7-8b21-261932ed029f None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:41.857189 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:41.928629 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:41.952722 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b263cfd-8a81-4a84-b692-af3f783c1e5d None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:41.962552 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb01f0a-732d-49c7-8b21-261932ed029f None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:42.011382 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7f680-918c-42cf-9b47-c641804d9cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:42.012221 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7f680-918c-42cf-9b47-c641804d9cce None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:42.012404 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7f680-918c-42cf-9b47-c641804d9cce None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:42.012623 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7f680-918c-42cf-9b47-c641804d9cce None admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:42.013374 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf7f680-918c-42cf-9b47-c641804d9cce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:42.013689 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf7f680-918c-42cf-9b47-c641804d9cce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:42.015110 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf7f680-918c-42cf-9b47-c641804d9cce None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:42.027308 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a667c0a7-9f91-4c92-ab18-b9c441ebccbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:42.028810 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667c0a7-9f91-4c92-ab18-b9c441ebccbf None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:42.029015 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 262/520] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:42.029695 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667c0a7-9f91-4c92-ab18-b9c441ebccbf None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:42.029848 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7f680-918c-42cf-9b47-c641804d9cce None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:42.030554 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667c0a7-9f91-4c92-ab18-b9c441ebccbf None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:42.031991 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a667c0a7-9f91-4c92-ab18-b9c441ebccbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:42.032540 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a667c0a7-9f91-4c92-ab18-b9c441ebccbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:42.035129 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a667c0a7-9f91-4c92-ab18-b9c441ebccbf None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:42.058577 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 259/521] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:42.060086 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a667c0a7-9f91-4c92-ab18-b9c441ebccbf None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:42.196469 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7f680-918c-42cf-9b47-c641804d9cce None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:42.196935 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a667c0a7-9f91-4c92-ab18-b9c441ebccbf None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:42.216699 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:42.237592 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67572bb5-e645-49c7-9da3-95dbd7d878b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:42.239008 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67572bb5-e645-49c7-9da3-95dbd7d878b5 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:42.239558 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67572bb5-e645-49c7-9da3-95dbd7d878b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:42.240063 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67572bb5-e645-49c7-9da3-95dbd7d878b5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:42.241958 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d67d74-9c6d-40ff-8955-76b118f5c7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:42.242609 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d67d74-9c6d-40ff-8955-76b118f5c7a3 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:42.242886 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d67d74-9c6d-40ff-8955-76b118f5c7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:42.243158 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d67d74-9c6d-40ff-8955-76b118f5c7a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:42.244026 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d67d74-9c6d-40ff-8955-76b118f5c7a3 None admin] RBAC: Adding query filter params (role.id=66426d7dd6f64f6ebfcb1cbb8188b0d2, scope.project.id=da83db15a312499fb627691ae442f233, user.id=2da466ad31d344898f5c838f77d45181) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:42.244338 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d67d74-9c6d-40ff-8955-76b118f5c7a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:42.245778 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d67d74-9c6d-40ff-8955-76b118f5c7a3 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:42.262034 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 263/522] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:43:42 2022] GET /identity/v3/role_assignments?user.id=2da466ad31d344898f5c838f77d45181&scope.project.id=da83db15a312499fb627691ae442f233&role.id=66426d7dd6f64f6ebfcb1cbb8188b0d2 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:42.262034 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d67d74-9c6d-40ff-8955-76b118f5c7a3 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:42.262331 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67572bb5-e645-49c7-9da3-95dbd7d878b5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:42.262331 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67572bb5-e645-49c7-9da3-95dbd7d878b5 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:42.289912 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-67572bb5-e645-49c7-9da3-95dbd7d878b5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 01 03:43:42.289912 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:42.289912 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:42.289912 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:42.289912 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:42.289912 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:42.289912 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:42.289912 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:42.289912 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:42.289912 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:42.289912 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:42.289912 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:42.289912 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 03:43:42.289912 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 03:43:42.289912 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 03:43:42.289912 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 03:43:42.290973 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:42.290973 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:42.290973 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 03:43:42.290973 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:43:42.290973 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 03:43:42.290973 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:43:42.290973 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:42.290973 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:42.290973 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:42.290973 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:42.290973 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:42.290973 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:42.290973 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:42.290973 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:42.290973 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:42.290973 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:42.290973 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:42.290973 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:42.291915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:42.291915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:42.291915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 03:43:42.291915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 03:43:42.291915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 03:43:42.291915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 03:43:42.291915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 03:43:42.291915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 03:43:42.291915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 01 03:43:42.291915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:42.293770 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 260/523] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Jul 1 03:43:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:42.294028 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67572bb5-e645-49c7-9da3-95dbd7d878b5 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:42.303286 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:42.423960 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d67d74-9c6d-40ff-8955-76b118f5c7a3 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:42.472196 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab63cf-1c99-4173-82dd-971c62d8097e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:42.473555 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab63cf-1c99-4173-82dd-971c62d8097e None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:42.473842 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab63cf-1c99-4173-82dd-971c62d8097e None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:42.474120 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab63cf-1c99-4173-82dd-971c62d8097e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:42.482037 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab63cf-1c99-4173-82dd-971c62d8097e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:42.483571 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab63cf-1c99-4173-82dd-971c62d8097e None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:42.500029 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-f2ab63cf-1c99-4173-82dd-971c62d8097e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:43:42.500029 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:42.500029 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:42.500029 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:42.500029 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:42.500029 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:42.500029 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:42.500029 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:42.500029 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:42.500029 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:42.500029 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:42.500029 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:42.500029 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 03:43:42.500029 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 03:43:42.500029 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 03:43:42.501709 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 03:43:42.501709 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:42.501709 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:42.501709 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:42.501709 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:42.501709 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:42.501709 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:42.501709 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:42.501709 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:42.501709 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:42.501709 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:42.501709 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:42.501709 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:42.501709 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:42.501709 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:42.501709 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:42.501709 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:42.503386 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 03:43:42.503386 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 03:43:42.503386 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 03:43:42.503386 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 03:43:42.503386 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 03:43:42.503386 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 03:43:42.503386 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:43:42.503386 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:42.503386 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 264/524] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:43:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:42.503386 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040bb59-5673-4956-a2d4-7244e9c5bae5 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:42.503386 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040bb59-5673-4956-a2d4-7244e9c5bae5 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:42.504626 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040bb59-5673-4956-a2d4-7244e9c5bae5 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:42.505626 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 265/525] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:43:42.505626 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040bb59-5673-4956-a2d4-7244e9c5bae5 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:42.509448 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67572bb5-e645-49c7-9da3-95dbd7d878b5 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:42.558079 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:42.577825 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a8aca-a815-4357-b97a-4160975abf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:42.579304 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a8aca-a815-4357-b97a-4160975abf06 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:42.579856 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a8aca-a815-4357-b97a-4160975abf06 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:42.580365 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a8aca-a815-4357-b97a-4160975abf06 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:42.595544 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a8aca-a815-4357-b97a-4160975abf06 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:42.598374 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a8aca-a815-4357-b97a-4160975abf06 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:42.620468 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-697a8aca-a815-4357-b97a-4160975abf06 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 01 03:43:42.620468 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:42.620468 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:42.620468 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:42.620468 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:42.620468 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:42.620468 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:42.620468 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:42.620468 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:42.620468 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:42.620468 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:42.620468 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:42.620468 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 03:43:42.620468 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 03:43:42.620468 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 03:43:42.620468 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 03:43:42.622085 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:42.622085 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:42.622085 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 03:43:42.622085 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:43:42.622085 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 03:43:42.622085 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:43:42.622085 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:42.622085 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:42.622085 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:42.622085 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:42.622085 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:42.622085 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:42.622085 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:42.622085 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:42.622085 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:42.622085 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:42.622085 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:42.622085 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:42.624263 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:42.624263 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:42.624263 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 03:43:42.624263 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 03:43:42.624263 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 03:43:42.624263 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 03:43:42.624263 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 03:43:42.624263 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 03:43:42.624263 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 01 03:43:42.624263 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:42.626417 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 261/526] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:43:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:42.627229 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a8aca-a815-4357-b97a-4160975abf06 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:42.673000 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040bb59-5673-4956-a2d4-7244e9c5bae5 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:42.728225 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:42.735171 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619888ea-7bb4-42a6-94b9-e7016d27eb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:42.736248 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619888ea-7bb4-42a6-94b9-e7016d27eb88 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:42.736818 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619888ea-7bb4-42a6-94b9-e7016d27eb88 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:42.742004 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619888ea-7bb4-42a6-94b9-e7016d27eb88 None admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:42.742004 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619888ea-7bb4-42a6-94b9-e7016d27eb88 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:42.742004 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619888ea-7bb4-42a6-94b9-e7016d27eb88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:42.742004 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619888ea-7bb4-42a6-94b9-e7016d27eb88 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:42.765370 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 266/527] 10.222.0.46 () {56 vars in 1139 bytes} [Fri Jul 1 03:43:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:42.767984 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26048450-9007-4c06-8f24-f5aa12242a71 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:42.768798 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26048450-9007-4c06-8f24-f5aa12242a71 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:42.769554 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26048450-9007-4c06-8f24-f5aa12242a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:42.790842 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-26048450-9007-4c06-8f24-f5aa12242a71 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:43:42.792496 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-26048450-9007-4c06-8f24-f5aa12242a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:43:42.802303 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a8aca-a815-4357-b97a-4160975abf06 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:42.869810 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c6abf-016d-4114-ad97-c2c524010594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:42.870855 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c6abf-016d-4114-ad97-c2c524010594 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:42.871301 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c6abf-016d-4114-ad97-c2c524010594 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:42.871859 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c6abf-016d-4114-ad97-c2c524010594 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:42.873419 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c6abf-016d-4114-ad97-c2c524010594 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:42.874588 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c6abf-016d-4114-ad97-c2c524010594 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:42.883658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c6abf-016d-4114-ad97-c2c524010594 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:42.896617 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 267/528] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:43:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:43:42.897901 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26048450-9007-4c06-8f24-f5aa12242a71 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:42.927575 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 262/529] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 1 03:43:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:42.927575 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c6abf-016d-4114-ad97-c2c524010594 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:42.950544 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:43.080277 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26048450-9007-4c06-8f24-f5aa12242a71 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:43.115089 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c6abf-016d-4114-ad97-c2c524010594 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:43.141101 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00520f82-fe98-45f6-8eab-c3393b93415b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:43.141901 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00520f82-fe98-45f6-8eab-c3393b93415b None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:43.142244 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00520f82-fe98-45f6-8eab-c3393b93415b None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:43.142582 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00520f82-fe98-45f6-8eab-c3393b93415b None admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:43.143626 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00520f82-fe98-45f6-8eab-c3393b93415b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:43.144132 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00520f82-fe98-45f6-8eab-c3393b93415b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:43.147258 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00520f82-fe98-45f6-8eab-c3393b93415b None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:43.160291 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:43.178983 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 268/530] 10.222.0.46 () {56 vars in 1137 bytes} [Fri Jul 1 03:43:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:43.181041 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00520f82-fe98-45f6-8eab-c3393b93415b None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:43.190216 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c984dbb-b7cd-42c7-af43-826139dbee3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:43.191093 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c984dbb-b7cd-42c7-af43-826139dbee3e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:43.192058 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c984dbb-b7cd-42c7-af43-826139dbee3e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:43.192465 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c984dbb-b7cd-42c7-af43-826139dbee3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:43.287875 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:43.311567 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00520f82-fe98-45f6-8eab-c3393b93415b None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:43.323559 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c984dbb-b7cd-42c7-af43-826139dbee3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:43.327072 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c984dbb-b7cd-42c7-af43-826139dbee3e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:43.356315 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec690424-aa81-4aa3-91bc-02df129c2a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:43.357229 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec690424-aa81-4aa3-91bc-02df129c2a76 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:43.357584 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec690424-aa81-4aa3-91bc-02df129c2a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:43.357961 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec690424-aa81-4aa3-91bc-02df129c2a76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:43.359575 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec690424-aa81-4aa3-91bc-02df129c2a76 None admin] RBAC: Adding query filter params (role.id=66426d7dd6f64f6ebfcb1cbb8188b0d2, scope.project.id=da83db15a312499fb627691ae442f233, user.id=418106a8c3104dcfa40fcc6c68356294) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:43.359742 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec690424-aa81-4aa3-91bc-02df129c2a76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:43.361932 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec690424-aa81-4aa3-91bc-02df129c2a76 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:43.379612 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 269/531] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:43:43 2022] GET /identity/v3/role_assignments?user.id=418106a8c3104dcfa40fcc6c68356294&scope.project.id=da83db15a312499fb627691ae442f233&role.id=66426d7dd6f64f6ebfcb1cbb8188b0d2 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:43.379612 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec690424-aa81-4aa3-91bc-02df129c2a76 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:43.530272 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec690424-aa81-4aa3-91bc-02df129c2a76 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:43.565523 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 263/532] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:43:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 643 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 03:43:43.568971 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c984dbb-b7cd-42c7-af43-826139dbee3e None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:43.581029 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304e31a-d6b7-45af-9f72-cee2d9318087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:43.581915 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304e31a-d6b7-45af-9f72-cee2d9318087 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:43.582736 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304e31a-d6b7-45af-9f72-cee2d9318087 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:43.583016 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304e31a-d6b7-45af-9f72-cee2d9318087 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:43.598315 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9304e31a-d6b7-45af-9f72-cee2d9318087 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:43:43.608475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-9304e31a-d6b7-45af-9f72-cee2d9318087 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 03:43:43.608475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:43.608475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:43.608475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:43.608475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:43.608475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:43.608475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:43.608475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:43.608475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:43.608475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:43.608475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:43.608475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:43.608475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:43:43.608475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:43:43.608475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:43:43.608475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:43:43.610664 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:43:43.610664 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:43:43.610664 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:43:43.610664 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:43:43.610664 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:43.610664 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:43.610664 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:43.610664 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:43.610664 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:43.610664 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:43.610664 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:43.610664 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:43.610664 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:43.610664 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:43.610664 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:43.610664 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:43.612515 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:43.612515 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:43.612515 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:43.612515 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:43.612515 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:43:43.612515 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:43:43.612515 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:43:43.612515 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:43:43.612515 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:43:43.612515 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:43:43.612515 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 03:43:43.612515 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:43.612515 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 270/533] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Jul 1 03:43:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:43.612515 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304e31a-d6b7-45af-9f72-cee2d9318087 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:43.616785 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:43.633762 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:43.763759 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304e31a-d6b7-45af-9f72-cee2d9318087 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:43.810173 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac2a39-16b6-4082-b9df-f85f2a29fdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:43.811153 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac2a39-16b6-4082-b9df-f85f2a29fdb4 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:43.811585 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac2a39-16b6-4082-b9df-f85f2a29fdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:43.811963 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac2a39-16b6-4082-b9df-f85f2a29fdb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:43.812825 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c984dbb-b7cd-42c7-af43-826139dbee3e None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:43.824829 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac2a39-16b6-4082-b9df-f85f2a29fdb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:43.826472 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac2a39-16b6-4082-b9df-f85f2a29fdb4 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:43.845690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-e3ac2a39-16b6-4082-b9df-f85f2a29fdb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:43.845690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:43.845690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:43.845690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:43.845690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:43.845690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:43.845690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:43.845690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:43.845690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:43.845690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:43.845690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:43.845690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:43.845690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:43:43.845690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:43:43.845690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:43:43.848158 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:43:43.848158 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:43.848158 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:43.848158 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:43.848158 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:43.848158 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:43.848158 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:43.848158 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:43.848158 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:43.848158 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:43.848158 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:43.848158 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:43.848158 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:43.848158 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:43.848158 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:43.848158 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:43.848158 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:43.850359 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:43:43.850359 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:43:43.850359 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:43.850359 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:43.850359 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 271/534] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:43:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:43.851330 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac2a39-16b6-4082-b9df-f85f2a29fdb4 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:43.877609 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83a4fc-334b-4e33-abfe-a7156695061b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:43.878481 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83a4fc-334b-4e33-abfe-a7156695061b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:43.878878 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83a4fc-334b-4e33-abfe-a7156695061b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:43.879308 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83a4fc-334b-4e33-abfe-a7156695061b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:43.917977 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:43.972058 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac2a39-16b6-4082-b9df-f85f2a29fdb4 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:44.014107 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b559f-11e1-4331-9881-a751e6acaabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:44.014325 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f83a4fc-334b-4e33-abfe-a7156695061b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:44.015143 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b559f-11e1-4331-9881-a751e6acaabb None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:44.015619 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b559f-11e1-4331-9881-a751e6acaabb None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:44.016052 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b559f-11e1-4331-9881-a751e6acaabb None admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:44.017118 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2b559f-11e1-4331-9881-a751e6acaabb None admin] RBAC: Adding query filter params (name=service) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:44.017254 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f83a4fc-334b-4e33-abfe-a7156695061b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:44.017732 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2b559f-11e1-4331-9881-a751e6acaabb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:44.019333 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2b559f-11e1-4331-9881-a751e6acaabb None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:44.030005 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 272/535] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Jul 1 03:43:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:44.031143 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b559f-11e1-4331-9881-a751e6acaabb None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:44.072949 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:44.155818 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b559f-11e1-4331-9881-a751e6acaabb None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:44.176180 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:44.196282 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cfe219-488d-4dd7-b966-f6338af4aaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:44.196967 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfe219-488d-4dd7-b966-f6338af4aaca None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:44.197254 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfe219-488d-4dd7-b966-f6338af4aaca None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:44.197533 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfe219-488d-4dd7-b966-f6338af4aaca None admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:44.198279 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cfe219-488d-4dd7-b966-f6338af4aaca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:44.198592 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cfe219-488d-4dd7-b966-f6338af4aaca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:44.200395 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cfe219-488d-4dd7-b966-f6338af4aaca None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:44.220655 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 273/537] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:44.220947 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 264/537] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:43:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 03:43:44.221786 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83a4fc-334b-4e33-abfe-a7156695061b None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:44.233884 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cfe219-488d-4dd7-b966-f6338af4aaca None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:44.354925 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83a4fc-334b-4e33-abfe-a7156695061b None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:44.381423 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:44.394350 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b3862-8ab1-4cc5-94af-e444556739dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:44.395736 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b3862-8ab1-4cc5-94af-e444556739dc None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:44.396023 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b3862-8ab1-4cc5-94af-e444556739dc None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:44.399514 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b3862-8ab1-4cc5-94af-e444556739dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:44.407785 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b3862-8ab1-4cc5-94af-e444556739dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:44.409286 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b3862-8ab1-4cc5-94af-e444556739dc None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:44.430294 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-6d4b3862-8ab1-4cc5-94af-e444556739dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:44.430294 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:44.430294 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:44.430294 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:44.430294 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:44.430294 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:44.430294 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:44.430294 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:44.430294 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:44.430294 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:44.430294 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:44.430294 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:44.430294 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:43:44.430294 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:43:44.430294 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:43:44.431975 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:43:44.431975 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:44.431975 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:44.431975 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:44.431975 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:44.431975 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:44.431975 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:44.431975 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:44.431975 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:44.431975 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:44.431975 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:44.431975 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:44.431975 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:44.431975 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:44.431975 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:44.431975 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:44.431975 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:44.433929 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:43:44.433929 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:43:44.433929 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:44.433929 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:44.436310 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 265/538] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:43:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:44.437293 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b3862-8ab1-4cc5-94af-e444556739dc None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:44.464694 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cfe219-488d-4dd7-b966-f6338af4aaca None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:44.533862 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8ac6b-d271-4765-a02a-32a00e84b6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:44.535821 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8ac6b-d271-4765-a02a-32a00e84b6d9 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:44.536603 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8ac6b-d271-4765-a02a-32a00e84b6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:44.537353 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8ac6b-d271-4765-a02a-32a00e84b6d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:44.550889 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a8ac6b-d271-4765-a02a-32a00e84b6d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:44.554693 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a8ac6b-d271-4765-a02a-32a00e84b6d9 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:44.585077 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-56a8ac6b-d271-4765-a02a-32a00e84b6d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:43:44.585077 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:44.585077 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:44.585077 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:44.585077 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:44.585077 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:44.585077 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:44.585077 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:44.585077 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:44.585077 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:44.585077 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:44.585077 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:44.585077 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 03:43:44.585077 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 03:43:44.585077 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 03:43:44.586904 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 03:43:44.586904 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:44.586904 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:44.586904 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:44.586904 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:44.586904 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:44.586904 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:44.586904 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:44.586904 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:44.586904 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:44.586904 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:44.586904 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:44.586904 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:44.586904 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:44.586904 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:44.586904 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:44.586904 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:44.588620 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 03:43:44.588620 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 03:43:44.588620 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 03:43:44.588620 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 03:43:44.588620 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 03:43:44.588620 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 03:43:44.588620 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:43:44.588620 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:44.589370 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b3862-8ab1-4cc5-94af-e444556739dc None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:44.592956 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 274/539] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:43:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 03:43:44.594727 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8ac6b-d271-4765-a02a-32a00e84b6d9 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:44.659947 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f74e5-5419-4021-983e-d69b6619607d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:44.661547 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f74e5-5419-4021-983e-d69b6619607d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:44.662562 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f74e5-5419-4021-983e-d69b6619607d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:44.663063 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f74e5-5419-4021-983e-d69b6619607d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:44.687615 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f74e5-5419-4021-983e-d69b6619607d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:44.692083 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f74e5-5419-4021-983e-d69b6619607d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:44.712989 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:44.735947 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-267f74e5-5419-4021-983e-d69b6619607d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:44.735947 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:44.735947 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:44.735947 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:44.735947 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:44.735947 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:44.735947 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:44.735947 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:44.735947 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:44.735947 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:44.735947 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:44.735947 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:44.735947 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:43:44.735947 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:43:44.735947 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:43:44.738809 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:43:44.738809 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:44.738809 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:44.738809 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:44.738809 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:44.738809 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:44.738809 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:44.738809 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:44.738809 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:44.738809 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:44.738809 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:44.738809 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:44.738809 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:44.738809 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:44.738809 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:44.738809 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:44.738809 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:44.740269 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:43:44.740269 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:43:44.740269 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:44.740269 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:44.743558 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 266/540] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:43:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:44.745472 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f74e5-5419-4021-983e-d69b6619607d None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:44.806424 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:44.822741 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8ac6b-d271-4765-a02a-32a00e84b6d9 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:44.896574 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9a7de-cd56-446e-a01a-c0156f2d0eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:44.897744 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9a7de-cd56-446e-a01a-c0156f2d0eae None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:44.898317 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9a7de-cd56-446e-a01a-c0156f2d0eae None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:44.898893 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9a7de-cd56-446e-a01a-c0156f2d0eae None admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:44.900512 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec9a7de-cd56-446e-a01a-c0156f2d0eae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:44.901066 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec9a7de-cd56-446e-a01a-c0156f2d0eae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:44.903875 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec9a7de-cd56-446e-a01a-c0156f2d0eae None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:44.927848 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 275/541] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:44.929517 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9a7de-cd56-446e-a01a-c0156f2d0eae None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:44.959918 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f74e5-5419-4021-983e-d69b6619607d None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:45.029406 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebde393-ed06-4198-ad99-08fb8782b776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:45.030959 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebde393-ed06-4198-ad99-08fb8782b776 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:45.031764 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebde393-ed06-4198-ad99-08fb8782b776 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:45.032513 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebde393-ed06-4198-ad99-08fb8782b776 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:45.034329 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebde393-ed06-4198-ad99-08fb8782b776 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:45.035337 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebde393-ed06-4198-ad99-08fb8782b776 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:45.038638 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebde393-ed06-4198-ad99-08fb8782b776 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:45.068688 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 267/542] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 1 03:43:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:45.070845 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebde393-ed06-4198-ad99-08fb8782b776 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:45.122835 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:45.130600 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9a7de-cd56-446e-a01a-c0156f2d0eae None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:45.244655 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437c954-eb7e-4c5d-9037-18fc87b84295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:45.245818 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437c954-eb7e-4c5d-9037-18fc87b84295 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:45.246123 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437c954-eb7e-4c5d-9037-18fc87b84295 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:45.246695 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437c954-eb7e-4c5d-9037-18fc87b84295 None admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:45.247619 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4437c954-eb7e-4c5d-9037-18fc87b84295 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:45.248104 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4437c954-eb7e-4c5d-9037-18fc87b84295 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:45.249643 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4437c954-eb7e-4c5d-9037-18fc87b84295 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:45.270598 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 276/543] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:45.270598 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437c954-eb7e-4c5d-9037-18fc87b84295 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:45.279685 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:45.316412 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebde393-ed06-4198-ad99-08fb8782b776 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:45.390803 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e38f8-f712-45f3-bd32-0dd8950dd087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:45.392983 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e38f8-f712-45f3-bd32-0dd8950dd087 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:45.393478 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e38f8-f712-45f3-bd32-0dd8950dd087 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:45.393968 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e38f8-f712-45f3-bd32-0dd8950dd087 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:45.400182 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437c954-eb7e-4c5d-9037-18fc87b84295 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:45.409011 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e38f8-f712-45f3-bd32-0dd8950dd087 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:45.412362 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e38f8-f712-45f3-bd32-0dd8950dd087 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:45.442521 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-f77e38f8-f712-45f3-bd32-0dd8950dd087 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 01 03:43:45.442521 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:45.442521 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:45.442521 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:45.442521 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:45.442521 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:45.442521 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:45.442521 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:45.442521 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:45.442521 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:45.442521 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:45.442521 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:45.442521 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 03:43:45.442521 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 03:43:45.442521 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 03:43:45.442521 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 03:43:45.443526 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:45.443526 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:45.443526 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 03:43:45.443526 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:43:45.443526 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 03:43:45.443526 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:43:45.443526 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:45.443526 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:45.443526 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:45.443526 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:45.443526 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:45.443526 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:45.443526 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:45.443526 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:45.443526 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:45.443526 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:45.443526 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:45.443526 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:45.444481 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:45.444481 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:45.444481 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 03:43:45.444481 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 03:43:45.444481 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 03:43:45.444481 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 03:43:45.444481 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 03:43:45.444481 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 03:43:45.444481 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 01 03:43:45.444481 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:45.444980 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 268/544] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 1 03:43:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:45.447144 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b969805-e90e-49c2-9010-d1da27e736e6 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:45.447742 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b969805-e90e-49c2-9010-d1da27e736e6 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:45.448248 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b969805-e90e-49c2-9010-d1da27e736e6 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:45.454677 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 269/545] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:43:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:43:45.454677 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b969805-e90e-49c2-9010-d1da27e736e6 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:45.458168 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12bd66-0bb5-409b-965a-08a4c70f2545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:45.459228 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12bd66-0bb5-409b-965a-08a4c70f2545 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:45.459805 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12bd66-0bb5-409b-965a-08a4c70f2545 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:45.460180 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12bd66-0bb5-409b-965a-08a4c70f2545 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:45.461255 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e12bd66-0bb5-409b-965a-08a4c70f2545 None admin] RBAC: Adding query filter params (role.id=66426d7dd6f64f6ebfcb1cbb8188b0d2, scope.project.id=da83db15a312499fb627691ae442f233, user.id=93929b81a23c482ca7ce47e7a94682e4) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:45.461621 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e12bd66-0bb5-409b-965a-08a4c70f2545 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:45.463271 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e12bd66-0bb5-409b-965a-08a4c70f2545 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:45.480040 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 277/546] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:43:45 2022] GET /identity/v3/role_assignments?user.id=93929b81a23c482ca7ce47e7a94682e4&scope.project.id=da83db15a312499fb627691ae442f233&role.id=66426d7dd6f64f6ebfcb1cbb8188b0d2 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:45.487923 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12bd66-0bb5-409b-965a-08a4c70f2545 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:45.550114 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:45.694906 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b969805-e90e-49c2-9010-d1da27e736e6 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:45.710602 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12bd66-0bb5-409b-965a-08a4c70f2545 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:45.761096 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37324404-c003-41ec-a67a-c81882eb4268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:45.762703 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37324404-c003-41ec-a67a-c81882eb4268 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:45.763278 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37324404-c003-41ec-a67a-c81882eb4268 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:45.763862 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37324404-c003-41ec-a67a-c81882eb4268 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:45.766990 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c0976-ca5f-4cd7-aaa6-e75bc7375cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:45.768376 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c0976-ca5f-4cd7-aaa6-e75bc7375cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:45.769182 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c0976-ca5f-4cd7-aaa6-e75bc7375cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:45.770417 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c0976-ca5f-4cd7-aaa6-e75bc7375cc2 None admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:45.772466 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c0976-ca5f-4cd7-aaa6-e75bc7375cc2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:45.773309 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c0976-ca5f-4cd7-aaa6-e75bc7375cc2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:45.776586 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c0976-ca5f-4cd7-aaa6-e75bc7375cc2 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:45.778238 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37324404-c003-41ec-a67a-c81882eb4268 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:45.780989 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37324404-c003-41ec-a67a-c81882eb4268 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:45.810260 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-37324404-c003-41ec-a67a-c81882eb4268 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:43:45.810260 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:45.810260 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:45.810260 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:45.810260 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:45.810260 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:45.810260 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:45.810260 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:45.810260 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:45.810260 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:45.810260 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:45.810260 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:45.810260 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 03:43:45.810260 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 03:43:45.810260 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 03:43:45.812005 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 03:43:45.812005 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:45.812005 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:45.812005 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:45.812005 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:45.812005 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:45.812005 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:45.812005 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:45.812005 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:45.812005 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:45.812005 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:45.812005 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:45.812005 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:45.812005 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:45.812005 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:45.812005 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:45.812005 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:45.814442 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 03:43:45.814442 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 03:43:45.814442 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 03:43:45.814442 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 03:43:45.814442 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 03:43:45.814442 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 03:43:45.814442 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:43:45.814442 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:45.814442 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 270/547] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:43:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:45.816151 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f333d8-12a3-40da-9243-98380677fac0 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:45.816151 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f333d8-12a3-40da-9243-98380677fac0 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:45.816151 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f333d8-12a3-40da-9243-98380677fac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:45.821082 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 278/548] 10.222.0.46 () {56 vars in 1135 bytes} [Fri Jul 1 03:43:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:45.822914 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c0976-ca5f-4cd7-aaa6-e75bc7375cc2 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:45.844153 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:45.855407 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-32f333d8-12a3-40da-9243-98380677fac0 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:43:45.857626 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-32f333d8-12a3-40da-9243-98380677fac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:43:45.987664 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:45.995980 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 271/549] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:43:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:43:45.997593 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f333d8-12a3-40da-9243-98380677fac0 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:46.022943 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c0976-ca5f-4cd7-aaa6-e75bc7375cc2 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:46.088355 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725ed492-a7c7-41f9-9777-9189f8eb3c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:46.090477 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ed492-a7c7-41f9-9777-9189f8eb3c7e None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:46.091201 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ed492-a7c7-41f9-9777-9189f8eb3c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:46.091722 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ed492-a7c7-41f9-9777-9189f8eb3c7e None admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:46.092994 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725ed492-a7c7-41f9-9777-9189f8eb3c7e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:46.093519 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725ed492-a7c7-41f9-9777-9189f8eb3c7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:46.096746 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725ed492-a7c7-41f9-9777-9189f8eb3c7e None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:46.115977 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 279/550] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 1 03:43:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:46.118092 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725ed492-a7c7-41f9-9777-9189f8eb3c7e None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:46.252333 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f333d8-12a3-40da-9243-98380677fac0 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:46.316164 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725ed492-a7c7-41f9-9777-9189f8eb3c7e None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:46.325610 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25db45-938e-41c0-9e08-52518e26e36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:46.327990 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25db45-938e-41c0-9e08-52518e26e36e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:46.328879 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25db45-938e-41c0-9e08-52518e26e36e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:46.329695 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25db45-938e-41c0-9e08-52518e26e36e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:46.338697 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:46.365850 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4e5b1-38f9-42fd-8cb4-1a6798d37a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:46.366583 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4e5b1-38f9-42fd-8cb4-1a6798d37a35 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:46.366868 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4e5b1-38f9-42fd-8cb4-1a6798d37a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:46.367141 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4e5b1-38f9-42fd-8cb4-1a6798d37a35 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:46.377279 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:46.384672 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b4e5b1-38f9-42fd-8cb4-1a6798d37a35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:43:46.394475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-d0b4e5b1-38f9-42fd-8cb4-1a6798d37a35 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 03:43:46.394475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:46.394475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:46.394475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:46.394475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:46.394475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:46.394475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:46.394475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:46.394475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:46.394475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:46.394475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:46.394475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:46.394475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:43:46.394475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:43:46.394475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:43:46.394475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:43:46.396308 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:43:46.396308 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:43:46.396308 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:43:46.396308 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:43:46.396308 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:46.396308 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:46.396308 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:46.396308 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:46.396308 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:46.396308 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:46.396308 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:46.396308 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:46.396308 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:46.396308 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:46.396308 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:46.396308 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:46.398420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:46.398420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:46.398420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:46.398420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:46.398420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:43:46.398420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:43:46.398420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:43:46.398420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:43:46.398420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:43:46.398420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:43:46.398420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 03:43:46.398420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:46.399730 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 280/551] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Jul 1 03:43:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:46.401526 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4e5b1-38f9-42fd-8cb4-1a6798d37a35 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:46.455202 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e25db45-938e-41c0-9e08-52518e26e36e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:46.456903 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e25db45-938e-41c0-9e08-52518e26e36e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:46.580369 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4e5b1-38f9-42fd-8cb4-1a6798d37a35 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:46.623697 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 272/552] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:43:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 03:43:46.625525 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5020f84-c09d-46b1-a59d-a56feaf5538f None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:46.626022 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5020f84-c09d-46b1-a59d-a56feaf5538f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:46.626308 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5020f84-c09d-46b1-a59d-a56feaf5538f None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:46.628035 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 273/553] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:43:46.633531 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5020f84-c09d-46b1-a59d-a56feaf5538f None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:46.662658 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2565a-b1ce-477a-aab3-b9453a67546e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:46.663941 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2565a-b1ce-477a-aab3-b9453a67546e None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:46.664441 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2565a-b1ce-477a-aab3-b9453a67546e None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:46.664925 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2565a-b1ce-477a-aab3-b9453a67546e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:46.666466 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a2565a-b1ce-477a-aab3-b9453a67546e None admin] RBAC: Adding query filter params (role.id=66426d7dd6f64f6ebfcb1cbb8188b0d2, scope.project.id=da83db15a312499fb627691ae442f233, user.id=ff2e6387d102445d963de072c55833d3) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:46.667025 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a2565a-b1ce-477a-aab3-b9453a67546e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:46.669809 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a2565a-b1ce-477a-aab3-b9453a67546e None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:46.687485 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 281/554] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:43:46 2022] GET /identity/v3/role_assignments?user.id=ff2e6387d102445d963de072c55833d3&scope.project.id=da83db15a312499fb627691ae442f233&role.id=66426d7dd6f64f6ebfcb1cbb8188b0d2 => generated 259 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:46.687485 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2565a-b1ce-477a-aab3-b9453a67546e None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:46.695590 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:46.797547 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:46.818286 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5020f84-c09d-46b1-a59d-a56feaf5538f None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:46.857040 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2565a-b1ce-477a-aab3-b9453a67546e None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:46.878522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ecfff1-6226-462b-95b6-9f7a8918247d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:46.879861 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecfff1-6226-462b-95b6-9f7a8918247d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:46.880351 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecfff1-6226-462b-95b6-9f7a8918247d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:46.880965 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecfff1-6226-462b-95b6-9f7a8918247d None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:46.882379 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ecfff1-6226-462b-95b6-9f7a8918247d None admin] RBAC: Adding query filter params (name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:46.882937 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ecfff1-6226-462b-95b6-9f7a8918247d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:46.885620 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ecfff1-6226-462b-95b6-9f7a8918247d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:46.908179 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 274/555] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Jul 1 03:43:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:46.908471 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462496f-b67a-426e-a5cc-1d43d831fb14 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:46.909092 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462496f-b67a-426e-a5cc-1d43d831fb14 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:46.909698 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462496f-b67a-426e-a5cc-1d43d831fb14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:46.914575 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33971b-9389-4b0f-8eea-a2928384bf96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:46.916054 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33971b-9389-4b0f-8eea-a2928384bf96 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:46.916559 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33971b-9389-4b0f-8eea-a2928384bf96 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:46.917054 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33971b-9389-4b0f-8eea-a2928384bf96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:46.937553 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-0462496f-b67a-426e-a5cc-1d43d831fb14 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:43:46.939717 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0462496f-b67a-426e-a5cc-1d43d831fb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:43:46.940180 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de33971b-9389-4b0f-8eea-a2928384bf96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:46.943706 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de33971b-9389-4b0f-8eea-a2928384bf96 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:46.986217 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-de33971b-9389-4b0f-8eea-a2928384bf96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:46.986217 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:46.986217 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:46.986217 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:46.986217 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:46.986217 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:46.986217 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:46.986217 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:46.986217 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:46.986217 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:46.986217 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:46.986217 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:46.986217 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:43:46.986217 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:43:46.986217 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:43:46.987243 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:43:46.987243 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:46.987243 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:46.987243 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:46.987243 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:46.987243 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:46.987243 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:46.987243 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:46.987243 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:46.987243 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:46.987243 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:46.987243 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:46.987243 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:46.987243 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:46.987243 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:46.987243 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:46.987243 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:46.988203 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:43:46.988203 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:43:46.988203 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:46.988203 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:46.989443 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 282/556] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:43:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:46.991622 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33971b-9389-4b0f-8eea-a2928384bf96 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:47.060810 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 275/557] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:43:47.061960 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0462496f-b67a-426e-a5cc-1d43d831fb14 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:47.125433 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:47.202918 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33971b-9389-4b0f-8eea-a2928384bf96 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:47.227799 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0462496f-b67a-426e-a5cc-1d43d831fb14 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:47.235633 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:47.266312 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0284aee-5c10-4af8-ba4a-a6942075a07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:47.266993 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0284aee-5c10-4af8-ba4a-a6942075a07b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:47.267273 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0284aee-5c10-4af8-ba4a-a6942075a07b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:47.267604 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0284aee-5c10-4af8-ba4a-a6942075a07b None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:47.268338 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0284aee-5c10-4af8-ba4a-a6942075a07b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:47.268644 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0284aee-5c10-4af8-ba4a-a6942075a07b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:47.270152 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0284aee-5c10-4af8-ba4a-a6942075a07b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:47.272812 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50406e5c-bd0c-41a3-9cba-08e0db55696e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:47.274364 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50406e5c-bd0c-41a3-9cba-08e0db55696e None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:47.274984 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50406e5c-bd0c-41a3-9cba-08e0db55696e None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:47.275650 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50406e5c-bd0c-41a3-9cba-08e0db55696e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:47.283609 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 276/558] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:47.284508 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0284aee-5c10-4af8-ba4a-a6942075a07b None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:47.298379 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50406e5c-bd0c-41a3-9cba-08e0db55696e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:47.301605 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50406e5c-bd0c-41a3-9cba-08e0db55696e None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:47.325342 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-50406e5c-bd0c-41a3-9cba-08e0db55696e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:47.325342 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:47.325342 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:47.325342 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:47.325342 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:47.325342 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:47.325342 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:47.325342 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:47.325342 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:47.325342 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:47.325342 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:47.325342 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:47.325342 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:43:47.325342 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:43:47.325342 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:43:47.328121 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:43:47.328121 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:47.328121 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:47.328121 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:47.328121 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:47.328121 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:47.328121 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:47.328121 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:47.328121 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:47.328121 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:47.328121 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:47.328121 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:47.328121 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:47.328121 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:47.328121 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:47.328121 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:47.328121 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:47.329026 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:43:47.329026 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:43:47.329026 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:47.329026 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:47.333705 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 283/559] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:43:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:47.334932 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50406e5c-bd0c-41a3-9cba-08e0db55696e None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:47.397205 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0284aee-5c10-4af8-ba4a-a6942075a07b None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:47.407916 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:47.435744 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8424ff2c-40c7-45cd-b46b-d7d4667a4c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:47.436661 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424ff2c-40c7-45cd-b46b-d7d4667a4c84 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:47.436946 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424ff2c-40c7-45cd-b46b-d7d4667a4c84 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:47.438099 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424ff2c-40c7-45cd-b46b-d7d4667a4c84 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:47.450428 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8424ff2c-40c7-45cd-b46b-d7d4667a4c84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:43:47.451249 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50406e5c-bd0c-41a3-9cba-08e0db55696e None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:47.459069 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-8424ff2c-40c7-45cd-b46b-d7d4667a4c84 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 03:43:47.459069 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:47.459069 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:47.459069 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:47.459069 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:47.459069 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:47.459069 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:47.459069 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:47.459069 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:47.459069 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:47.459069 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:47.459069 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:47.459069 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:43:47.459069 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:43:47.459069 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:43:47.459069 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:43:47.460071 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:43:47.460071 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:43:47.460071 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:43:47.460071 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:43:47.460071 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:47.460071 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:47.460071 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:47.460071 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:47.460071 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:47.460071 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:47.460071 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:47.460071 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:47.460071 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:47.460071 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:47.460071 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:47.460071 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:47.461222 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:47.461222 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:47.461222 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:47.461222 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:47.461222 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:43:47.461222 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:43:47.461222 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:43:47.461222 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:43:47.461222 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:43:47.461222 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:43:47.461222 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 03:43:47.461222 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:47.463713 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 277/560] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Jul 1 03:43:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:47.464734 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8424ff2c-40c7-45cd-b46b-d7d4667a4c84 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:47.496727 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817d60f-4580-4537-9da6-855e1c3fe349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:47.497640 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817d60f-4580-4537-9da6-855e1c3fe349 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:47.498073 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817d60f-4580-4537-9da6-855e1c3fe349 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:47.498337 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817d60f-4580-4537-9da6-855e1c3fe349 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:47.506141 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d817d60f-4580-4537-9da6-855e1c3fe349 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:47.507841 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d817d60f-4580-4537-9da6-855e1c3fe349 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:47.523416 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-d817d60f-4580-4537-9da6-855e1c3fe349 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:43:47.523416 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:47.523416 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:47.523416 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:47.523416 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:47.523416 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:47.523416 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:47.523416 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:47.523416 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:47.523416 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:47.523416 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:47.523416 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:47.523416 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 03:43:47.523416 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 03:43:47.523416 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 03:43:47.524381 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 03:43:47.524381 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:47.524381 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:47.524381 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:47.524381 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:47.524381 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:47.524381 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:47.524381 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:47.524381 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:47.524381 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:47.524381 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:47.524381 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:47.524381 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:47.524381 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:47.524381 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:47.524381 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:47.524381 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:47.525270 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 03:43:47.525270 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 03:43:47.525270 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 03:43:47.525270 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 03:43:47.525270 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 03:43:47.525270 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 03:43:47.525270 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:43:47.525270 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:47.529717 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 284/561] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:43:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:47.530774 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817d60f-4580-4537-9da6-855e1c3fe349 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:47.588329 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8424ff2c-40c7-45cd-b46b-d7d4667a4c84 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:47.603923 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:47.628422 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35a3a7-06d1-4b4b-ba8f-87222a94ebae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:47.629447 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35a3a7-06d1-4b4b-ba8f-87222a94ebae None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:47.629914 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35a3a7-06d1-4b4b-ba8f-87222a94ebae None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:47.630362 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35a3a7-06d1-4b4b-ba8f-87222a94ebae None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:47.631305 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb35a3a7-06d1-4b4b-ba8f-87222a94ebae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:47.631932 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb35a3a7-06d1-4b4b-ba8f-87222a94ebae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:47.633629 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb35a3a7-06d1-4b4b-ba8f-87222a94ebae None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:47.641386 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817d60f-4580-4537-9da6-855e1c3fe349 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:47.648300 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 278/562] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:47.649445 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35a3a7-06d1-4b4b-ba8f-87222a94ebae None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:47.661789 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:47.689855 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5b3ce-78ef-4079-9adb-85662d73f172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:47.690613 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5b3ce-78ef-4079-9adb-85662d73f172 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:47.690904 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5b3ce-78ef-4079-9adb-85662d73f172 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:47.691274 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5b3ce-78ef-4079-9adb-85662d73f172 None admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:47.692228 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d5b3ce-78ef-4079-9adb-85662d73f172 None admin] RBAC: Adding query filter params (name=service) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:47.692546 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d5b3ce-78ef-4079-9adb-85662d73f172 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:47.694900 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d5b3ce-78ef-4079-9adb-85662d73f172 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:47.707621 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 285/563] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Jul 1 03:43:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:47.708866 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5b3ce-78ef-4079-9adb-85662d73f172 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:47.772437 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35a3a7-06d1-4b4b-ba8f-87222a94ebae None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:47.813808 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8b38d-bd54-470b-8c0a-3ed44968dbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:47.814484 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8b38d-bd54-470b-8c0a-3ed44968dbcc None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:47.814767 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8b38d-bd54-470b-8c0a-3ed44968dbcc None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:47.815046 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8b38d-bd54-470b-8c0a-3ed44968dbcc None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:47.816952 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc8b38d-bd54-470b-8c0a-3ed44968dbcc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:47.816952 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc8b38d-bd54-470b-8c0a-3ed44968dbcc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:47.817755 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc8b38d-bd54-470b-8c0a-3ed44968dbcc None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:47.841927 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 279/564] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 1 03:43:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:47.841927 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8b38d-bd54-470b-8c0a-3ed44968dbcc None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:47.851782 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:47.864411 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5b3ce-78ef-4079-9adb-85662d73f172 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:47.904593 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594b39b-482e-43cf-9899-5fb2d06be60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:47.905475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594b39b-482e-43cf-9899-5fb2d06be60c None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:47.905765 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594b39b-482e-43cf-9899-5fb2d06be60c None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:47.906045 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594b39b-482e-43cf-9899-5fb2d06be60c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:47.916090 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1594b39b-482e-43cf-9899-5fb2d06be60c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:47.917563 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1594b39b-482e-43cf-9899-5fb2d06be60c None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:47.922521 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:47.934648 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-1594b39b-482e-43cf-9899-5fb2d06be60c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 01 03:43:47.934648 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:47.934648 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:47.934648 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:47.934648 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:47.934648 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:47.934648 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:47.934648 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:47.934648 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:47.934648 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:47.934648 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:47.934648 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:47.934648 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 03:43:47.934648 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 03:43:47.934648 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 03:43:47.934648 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 03:43:47.935926 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:47.935926 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:47.935926 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 03:43:47.935926 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:43:47.935926 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 03:43:47.935926 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:43:47.935926 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:47.935926 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:47.935926 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:47.935926 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:47.935926 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:47.935926 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:47.935926 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:47.935926 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:47.935926 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:47.935926 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:47.935926 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:47.935926 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:47.937227 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:47.937227 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:47.937227 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 03:43:47.937227 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 03:43:47.937227 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 03:43:47.937227 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 03:43:47.937227 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 03:43:47.937227 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 03:43:47.937227 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 01 03:43:47.937227 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:47.937227 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 286/565] 10.222.0.46 () {56 vars in 1093 bytes} [Fri Jul 1 03:43:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:47.938013 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c48776-2fd2-4fd3-a1cd-ade237ffc3e0 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:47.938013 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c48776-2fd2-4fd3-a1cd-ade237ffc3e0 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:47.938013 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c48776-2fd2-4fd3-a1cd-ade237ffc3e0 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:47.943494 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 287/566] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:43:47.943494 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c48776-2fd2-4fd3-a1cd-ade237ffc3e0 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:47.975196 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8b38d-bd54-470b-8c0a-3ed44968dbcc None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:48.022710 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6add6-6929-4a04-80fa-3c44675a1598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:48.023552 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6add6-6929-4a04-80fa-3c44675a1598 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:48.023845 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6add6-6929-4a04-80fa-3c44675a1598 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:48.024306 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6add6-6929-4a04-80fa-3c44675a1598 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:48.037550 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e6add6-6929-4a04-80fa-3c44675a1598 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:48.039289 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e6add6-6929-4a04-80fa-3c44675a1598 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:48.057722 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-22e6add6-6929-4a04-80fa-3c44675a1598 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:48.057722 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:48.057722 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:48.057722 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:48.057722 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:48.057722 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:48.057722 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:48.057722 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:48.057722 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:48.057722 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:48.057722 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:48.057722 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:48.057722 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:43:48.057722 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:43:48.057722 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:43:48.059522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:43:48.059522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:48.059522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:48.059522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:48.059522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:48.059522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:48.059522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:48.059522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:48.059522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:48.059522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:48.059522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:48.059522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:48.059522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:48.059522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:48.059522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:48.059522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:48.059522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:48.062465 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:43:48.062465 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:43:48.062465 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:48.062465 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:48.062465 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 280/567] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:43:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:48.062465 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6add6-6929-4a04-80fa-3c44675a1598 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:48.098340 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c48776-2fd2-4fd3-a1cd-ade237ffc3e0 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:48.156399 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8e6d0-ed52-4402-a8ea-3ad71056eca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:48.157313 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8e6d0-ed52-4402-a8ea-3ad71056eca4 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:48.157769 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8e6d0-ed52-4402-a8ea-3ad71056eca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:48.158176 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8e6d0-ed52-4402-a8ea-3ad71056eca4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:48.159173 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c8e6d0-ed52-4402-a8ea-3ad71056eca4 None admin] RBAC: Adding query filter params (role.id=66426d7dd6f64f6ebfcb1cbb8188b0d2, scope.project.id=da83db15a312499fb627691ae442f233, user.id=83787880173b459c8975b834bd47a51a) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:48.159731 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c8e6d0-ed52-4402-a8ea-3ad71056eca4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:48.162120 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c8e6d0-ed52-4402-a8ea-3ad71056eca4 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:48.169812 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 288/568] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:43:47 2022] GET /identity/v3/role_assignments?user.id=83787880173b459c8975b834bd47a51a&scope.project.id=da83db15a312499fb627691ae442f233&role.id=66426d7dd6f64f6ebfcb1cbb8188b0d2 => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:48.172007 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81facd-95c7-4cb4-9a32-3751c176d961 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:48.172496 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81facd-95c7-4cb4-9a32-3751c176d961 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:48.172977 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81facd-95c7-4cb4-9a32-3751c176d961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:48.199431 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-5e81facd-95c7-4cb4-9a32-3751c176d961 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:43:48.200978 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-5e81facd-95c7-4cb4-9a32-3751c176d961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:43:48.202458 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6add6-6929-4a04-80fa-3c44675a1598 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:48.220138 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:48.254946 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:48.276898 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d67242-14f1-4267-a7d8-1bb6e97ac157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:48.279587 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d67242-14f1-4267-a7d8-1bb6e97ac157 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:48.280425 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d67242-14f1-4267-a7d8-1bb6e97ac157 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:48.281462 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d67242-14f1-4267-a7d8-1bb6e97ac157 None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:48.282666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d67242-14f1-4267-a7d8-1bb6e97ac157 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:48.283190 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d67242-14f1-4267-a7d8-1bb6e97ac157 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:48.285225 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d67242-14f1-4267-a7d8-1bb6e97ac157 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:48.312811 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 281/569] 10.222.0.46 () {56 vars in 1133 bytes} [Fri Jul 1 03:43:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:48.314027 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d67242-14f1-4267-a7d8-1bb6e97ac157 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:48.323513 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 289/570] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:43:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:43:48.325770 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e81facd-95c7-4cb4-9a32-3751c176d961 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:48.466627 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e81facd-95c7-4cb4-9a32-3751c176d961 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:48.489153 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d67242-14f1-4267-a7d8-1bb6e97ac157 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:48.507031 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a70f9a-70af-484a-ad69-87ebefacf7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:48.508117 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a70f9a-70af-484a-ad69-87ebefacf7dc None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:48.508238 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a70f9a-70af-484a-ad69-87ebefacf7dc None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:48.508478 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a70f9a-70af-484a-ad69-87ebefacf7dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:48.521496 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a70f9a-70af-484a-ad69-87ebefacf7dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:48.522985 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a70f9a-70af-484a-ad69-87ebefacf7dc None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:48.526534 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:48.544270 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-30a70f9a-70af-484a-ad69-87ebefacf7dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:48.544270 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:48.544270 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:48.544270 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:48.544270 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:48.544270 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:48.544270 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:48.544270 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:48.544270 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:48.544270 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:48.544270 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:48.544270 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:48.544270 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:43:48.544270 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:43:48.544270 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:43:48.545240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:43:48.545240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:48.545240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:48.545240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:48.545240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:48.545240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:48.545240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:48.545240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:48.545240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:48.545240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:48.545240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:48.545240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:48.545240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:48.545240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:48.545240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:48.545240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:48.545240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:48.546128 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:43:48.546128 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:43:48.546128 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:48.546128 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:48.546372 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1a101-1e16-4675-8278-c15ec8bea76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:48.547847 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1a101-1e16-4675-8278-c15ec8bea76b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:48.548364 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1a101-1e16-4675-8278-c15ec8bea76b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:48.548842 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1a101-1e16-4675-8278-c15ec8bea76b None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:48.549896 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a1a101-1e16-4675-8278-c15ec8bea76b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:48.550458 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a1a101-1e16-4675-8278-c15ec8bea76b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:48.550673 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 290/571] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:43:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 03:43:48.551639 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a70f9a-70af-484a-ad69-87ebefacf7dc None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:48.552758 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a1a101-1e16-4675-8278-c15ec8bea76b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:48.571106 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 282/572] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:48.572416 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1a101-1e16-4675-8278-c15ec8bea76b None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:48.663920 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:48.679844 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a70f9a-70af-484a-ad69-87ebefacf7dc None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:48.724242 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f8b854-0f7b-4440-9a7f-b28cf1994e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:48.725165 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8b854-0f7b-4440-9a7f-b28cf1994e26 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:48.725425 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8b854-0f7b-4440-9a7f-b28cf1994e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:48.725690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8b854-0f7b-4440-9a7f-b28cf1994e26 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:48.739240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f8b854-0f7b-4440-9a7f-b28cf1994e26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:43:48.747313 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-b4f8b854-0f7b-4440-9a7f-b28cf1994e26 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 03:43:48.747313 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:48.747313 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:48.747313 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:48.747313 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:48.747313 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:48.747313 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:48.747313 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:48.747313 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:48.747313 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:48.747313 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:48.747313 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:48.747313 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:43:48.747313 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:43:48.747313 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:43:48.747313 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:43:48.749179 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:43:48.749179 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:43:48.749179 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:43:48.749179 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:43:48.749179 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:48.749179 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:48.749179 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:48.749179 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:48.749179 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:48.749179 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:48.749179 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:48.749179 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:48.749179 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:48.749179 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:48.749179 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:48.749179 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:48.750761 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:48.750761 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:48.750761 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:48.750761 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:48.750761 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:43:48.750761 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:43:48.750761 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:43:48.750761 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:43:48.750761 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:43:48.750761 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:43:48.750761 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 03:43:48.750761 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:48.750761 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 291/573] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Jul 1 03:43:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:48.750761 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f8b854-0f7b-4440-9a7f-b28cf1994e26 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:48.812391 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1a101-1e16-4675-8278-c15ec8bea76b None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:48.834600 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:48.896095 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ee82c-384b-4ba5-a4ef-70f4be3f57c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:48.897986 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ee82c-384b-4ba5-a4ef-70f4be3f57c1 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:48.898695 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ee82c-384b-4ba5-a4ef-70f4be3f57c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:48.899703 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ee82c-384b-4ba5-a4ef-70f4be3f57c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:48.902238 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514ee82c-384b-4ba5-a4ef-70f4be3f57c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:48.903009 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514ee82c-384b-4ba5-a4ef-70f4be3f57c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:48.906692 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514ee82c-384b-4ba5-a4ef-70f4be3f57c1 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:48.917187 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f8b854-0f7b-4440-9a7f-b28cf1994e26 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:48.936073 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 283/574] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:48.937651 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ee82c-384b-4ba5-a4ef-70f4be3f57c1 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:48.972334 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebaf22b-6eed-4c60-81b8-4f44b9675f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:48.974340 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebaf22b-6eed-4c60-81b8-4f44b9675f99 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:48.975027 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebaf22b-6eed-4c60-81b8-4f44b9675f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:48.976043 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebaf22b-6eed-4c60-81b8-4f44b9675f99 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:48.990222 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebaf22b-6eed-4c60-81b8-4f44b9675f99 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:48.992180 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebaf22b-6eed-4c60-81b8-4f44b9675f99 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:49.014523 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-aebaf22b-6eed-4c60-81b8-4f44b9675f99 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 01 03:43:49.014523 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:49.014523 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:49.014523 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:49.014523 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:49.014523 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:49.014523 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:49.014523 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:49.014523 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:49.014523 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:49.014523 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:49.014523 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:49.014523 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 03:43:49.014523 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 03:43:49.014523 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 03:43:49.014523 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 03:43:49.016173 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:49.016173 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:49.016173 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 03:43:49.016173 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:43:49.016173 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 03:43:49.016173 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:43:49.016173 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:49.016173 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:49.016173 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:49.016173 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:49.016173 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:49.016173 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:49.016173 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:49.016173 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:49.016173 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:49.016173 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:49.016173 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:49.016173 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:49.017675 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:49.017675 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:49.017675 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 03:43:49.017675 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 03:43:49.017675 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 03:43:49.017675 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 03:43:49.017675 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 03:43:49.017675 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 03:43:49.017675 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 01 03:43:49.017675 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:49.021331 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 292/575] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:43:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:49.022666 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb8799-daa0-4221-8459-e74a9f3141c0 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:49.022948 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb8799-daa0-4221-8459-e74a9f3141c0 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:49.023234 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb8799-daa0-4221-8459-e74a9f3141c0 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:49.024916 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 293/576] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:43:49.025675 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb8799-daa0-4221-8459-e74a9f3141c0 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:49.066465 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:49.070723 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ee82c-384b-4ba5-a4ef-70f4be3f57c1 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:49.110212 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b44c5c-1503-448e-9196-87451353a335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:49.110907 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b44c5c-1503-448e-9196-87451353a335 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:49.111187 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b44c5c-1503-448e-9196-87451353a335 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:49.111494 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b44c5c-1503-448e-9196-87451353a335 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:49.112256 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b44c5c-1503-448e-9196-87451353a335 None admin] RBAC: Adding query filter params (name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:49.112564 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b44c5c-1503-448e-9196-87451353a335 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:49.113993 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b44c5c-1503-448e-9196-87451353a335 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:49.124138 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 284/577] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Jul 1 03:43:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:49.124804 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b44c5c-1503-448e-9196-87451353a335 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:49.182946 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb8799-daa0-4221-8459-e74a9f3141c0 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:49.222228 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:49.251231 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b44c5c-1503-448e-9196-87451353a335 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:49.256739 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66618302-922e-40ee-9c76-d7d9e3c0d8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:49.258136 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66618302-922e-40ee-9c76-d7d9e3c0d8eb None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:49.258633 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66618302-922e-40ee-9c76-d7d9e3c0d8eb None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:49.259142 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66618302-922e-40ee-9c76-d7d9e3c0d8eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:49.274100 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66618302-922e-40ee-9c76-d7d9e3c0d8eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:49.277026 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66618302-922e-40ee-9c76-d7d9e3c0d8eb None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:49.300423 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031518d-e0fb-43e8-9ffb-d7b26e140a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:49.301381 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031518d-e0fb-43e8-9ffb-d7b26e140a97 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:49.301810 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031518d-e0fb-43e8-9ffb-d7b26e140a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:49.302233 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031518d-e0fb-43e8-9ffb-d7b26e140a97 None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:49.303315 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031518d-e0fb-43e8-9ffb-d7b26e140a97 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:49.303827 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031518d-e0fb-43e8-9ffb-d7b26e140a97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:49.305427 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-66618302-922e-40ee-9c76-d7d9e3c0d8eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:43:49.305427 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:49.305427 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:49.305427 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:49.305427 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:49.305427 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:49.305427 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:49.305427 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:49.305427 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:49.305427 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:49.305427 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:49.305427 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:49.305427 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 03:43:49.305427 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 03:43:49.305427 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 03:43:49.306537 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 03:43:49.306537 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:49.306537 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:49.306537 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:49.306537 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:49.306537 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:49.306537 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:49.306537 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:49.306537 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:49.306537 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:49.306537 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:49.306537 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:49.306537 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:49.306537 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:49.306537 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:49.306537 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:49.306537 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:49.307618 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 03:43:49.307618 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 03:43:49.307618 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 03:43:49.307618 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 03:43:49.307618 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 03:43:49.307618 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 03:43:49.307618 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:43:49.307618 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:49.308247 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 294/578] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:43:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:49.308758 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031518d-e0fb-43e8-9ffb-d7b26e140a97 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:49.309666 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8fa20-b729-46fb-8af5-11da7a1ae6f2 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:49.309955 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8fa20-b729-46fb-8af5-11da7a1ae6f2 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:49.310234 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8fa20-b729-46fb-8af5-11da7a1ae6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:49.338367 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-d8e8fa20-b729-46fb-8af5-11da7a1ae6f2 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:43:49.340414 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-d8e8fa20-b729-46fb-8af5-11da7a1ae6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:43:49.340777 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 285/579] 10.222.0.46 () {56 vars in 1137 bytes} [Fri Jul 1 03:43:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:49.341847 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031518d-e0fb-43e8-9ffb-d7b26e140a97 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:49.372219 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:49.463523 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 295/580] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:43:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:43:49.463523 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8fa20-b729-46fb-8af5-11da7a1ae6f2 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:49.475791 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031518d-e0fb-43e8-9ffb-d7b26e140a97 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:49.521454 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8bc70c-9065-4196-8258-321476ed08da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:49.522560 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bc70c-9065-4196-8258-321476ed08da None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:49.522857 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bc70c-9065-4196-8258-321476ed08da None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:49.523607 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bc70c-9065-4196-8258-321476ed08da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:49.537666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8bc70c-9065-4196-8258-321476ed08da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:49.539406 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8bc70c-9065-4196-8258-321476ed08da None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:49.561348 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-ff8bc70c-9065-4196-8258-321476ed08da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:49.561348 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:49.561348 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:49.561348 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:49.561348 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:49.561348 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:49.561348 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:49.561348 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:49.561348 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:49.561348 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:49.561348 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:49.561348 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:49.561348 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:43:49.561348 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:43:49.561348 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:43:49.563145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:43:49.563145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:49.563145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:49.563145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:49.563145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:49.563145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:49.563145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:49.563145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:49.563145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:49.563145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:49.563145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:49.563145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:49.563145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:49.563145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:49.563145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:49.563145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:49.563145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:49.565094 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:43:49.565094 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:43:49.565094 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:49.565094 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:49.565094 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 286/581] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:43:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:49.565094 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8bc70c-9065-4196-8258-321476ed08da None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:49.618218 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8fa20-b729-46fb-8af5-11da7a1ae6f2 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:49.629827 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:49.656336 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:49.663360 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f4b836-04cf-4b48-8144-259a5ed3e46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:49.664925 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4b836-04cf-4b48-8144-259a5ed3e46e None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:49.665672 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4b836-04cf-4b48-8144-259a5ed3e46e None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:49.666333 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4b836-04cf-4b48-8144-259a5ed3e46e None admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:49.667888 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f4b836-04cf-4b48-8144-259a5ed3e46e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:49.669179 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f4b836-04cf-4b48-8144-259a5ed3e46e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:49.670512 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f4b836-04cf-4b48-8144-259a5ed3e46e None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:49.685430 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 296/582] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 1 03:43:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:49.686581 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f4b836-04cf-4b48-8144-259a5ed3e46e None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:49.702016 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8bc70c-9065-4196-8258-321476ed08da None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:49.742040 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cceeb56-c21e-46bd-95eb-78e9b581194e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:49.742889 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cceeb56-c21e-46bd-95eb-78e9b581194e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:49.743178 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cceeb56-c21e-46bd-95eb-78e9b581194e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:49.743489 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cceeb56-c21e-46bd-95eb-78e9b581194e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:49.761146 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cceeb56-c21e-46bd-95eb-78e9b581194e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:49.762670 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cceeb56-c21e-46bd-95eb-78e9b581194e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:49.785631 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-0cceeb56-c21e-46bd-95eb-78e9b581194e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:49.785631 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:49.785631 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:49.785631 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:49.785631 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:49.785631 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:49.785631 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:49.785631 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:49.785631 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:49.785631 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:49.785631 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:49.785631 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:49.785631 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:43:49.785631 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:43:49.785631 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:43:49.786561 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:43:49.786561 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:49.786561 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:49.786561 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:49.786561 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:49.786561 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:49.786561 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:49.786561 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:49.786561 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:49.786561 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:49.786561 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:49.786561 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:49.786561 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:49.786561 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:49.786561 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:49.786561 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:49.786561 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:49.787427 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:43:49.787427 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:43:49.787427 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:49.787427 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:49.788519 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 287/583] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:43:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:49.789114 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cceeb56-c21e-46bd-95eb-78e9b581194e None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:49.830651 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f4b836-04cf-4b48-8144-259a5ed3e46e None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:49.869637 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f8aa07-33db-44f2-9fce-ce05663761a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:49.870462 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8aa07-33db-44f2-9fce-ce05663761a6 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:49.870751 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8aa07-33db-44f2-9fce-ce05663761a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:49.871030 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8aa07-33db-44f2-9fce-ce05663761a6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:49.884630 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f8aa07-33db-44f2-9fce-ce05663761a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:43:49.893411 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-30f8aa07-33db-44f2-9fce-ce05663761a6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 03:43:49.893411 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:49.893411 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:49.893411 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:49.893411 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:49.893411 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:49.893411 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:49.893411 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:49.893411 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:49.893411 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:49.893411 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:49.893411 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:49.893411 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:43:49.893411 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:43:49.893411 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:43:49.893411 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:43:49.904588 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:43:49.904588 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:43:49.904588 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:43:49.904588 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:43:49.904588 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:49.904588 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:49.904588 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:49.904588 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:49.904588 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:49.904588 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:49.904588 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:49.904588 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:49.904588 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:49.904588 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:49.904588 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:49.904588 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:49.906671 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:49.906671 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:49.906671 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:49.906671 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:49.906671 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:43:49.906671 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:43:49.906671 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:43:49.906671 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:43:49.906671 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:43:49.906671 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:43:49.906671 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 03:43:49.906671 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:49.906671 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 297/584] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Jul 1 03:43:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:49.906671 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f8aa07-33db-44f2-9fce-ce05663761a6 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:49.936803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:49.950771 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cceeb56-c21e-46bd-95eb-78e9b581194e None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:49.991823 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:50.006077 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37549333-c448-468c-ac21-d011b9ed3e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:50.006950 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37549333-c448-468c-ac21-d011b9ed3e61 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:50.007247 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37549333-c448-468c-ac21-d011b9ed3e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:50.007621 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37549333-c448-468c-ac21-d011b9ed3e61 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:50.008861 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37549333-c448-468c-ac21-d011b9ed3e61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:50.008861 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37549333-c448-468c-ac21-d011b9ed3e61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:50.010100 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37549333-c448-468c-ac21-d011b9ed3e61 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:50.026676 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 288/585] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:43:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:50.026676 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37549333-c448-468c-ac21-d011b9ed3e61 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:50.036662 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f8aa07-33db-44f2-9fce-ce05663761a6 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:50.097935 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e135141-23db-490a-a1bf-142bde6591fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:50.099584 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e135141-23db-490a-a1bf-142bde6591fe None admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:50.100179 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e135141-23db-490a-a1bf-142bde6591fe None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:50.100800 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e135141-23db-490a-a1bf-142bde6591fe None admin] PATH_INFO: `/v3/projects/da83db15a312499fb627691ae442f233/users/2da466ad31d344898f5c838f77d45181/roles/66426d7dd6f64f6ebfcb1cbb8188b0d2` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:50.124761 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e135141-23db-490a-a1bf-142bde6591fe None admin] RBAC: Authorizing `identity:create_grant(project_id=da83db15a312499fb627691ae442f233, user_id=2da466ad31d344898f5c838f77d45181, role_id=66426d7dd6f64f6ebfcb1cbb8188b0d2)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:50.126982 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e135141-23db-490a-a1bf-142bde6591fe None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:50.141017 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37549333-c448-468c-ac21-d011b9ed3e61 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:50.179945 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d949b7-c24a-4231-bb99-c5cbdf1d144a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:50.180624 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d949b7-c24a-4231-bb99-c5cbdf1d144a None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:50.180907 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d949b7-c24a-4231-bb99-c5cbdf1d144a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:50.181188 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d949b7-c24a-4231-bb99-c5cbdf1d144a None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:50.181915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d949b7-c24a-4231-bb99-c5cbdf1d144a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:50.182225 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d949b7-c24a-4231-bb99-c5cbdf1d144a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:50.183767 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d949b7-c24a-4231-bb99-c5cbdf1d144a None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:50.198390 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 289/586] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:50.199931 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d949b7-c24a-4231-bb99-c5cbdf1d144a None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:50.209982 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 298/587] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 1 03:43:49 2022] PUT /identity/v3/projects/da83db15a312499fb627691ae442f233/users/2da466ad31d344898f5c838f77d45181/roles/66426d7dd6f64f6ebfcb1cbb8188b0d2 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 03:43:50.211765 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e135141-23db-490a-a1bf-142bde6591fe None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:50.288308 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:50.364461 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d949b7-c24a-4231-bb99-c5cbdf1d144a None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:50.394934 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:50.424111 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efee7f1-fc3e-49e8-b818-a6fe5eab432b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:50.424902 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efee7f1-fc3e-49e8-b818-a6fe5eab432b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:50.425261 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efee7f1-fc3e-49e8-b818-a6fe5eab432b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:50.425608 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efee7f1-fc3e-49e8-b818-a6fe5eab432b None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:50.426493 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efee7f1-fc3e-49e8-b818-a6fe5eab432b None admin] RBAC: Adding query filter params (name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:50.426943 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efee7f1-fc3e-49e8-b818-a6fe5eab432b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:50.428511 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efee7f1-fc3e-49e8-b818-a6fe5eab432b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:50.443489 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 290/588] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Jul 1 03:43:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:50.443489 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efee7f1-fc3e-49e8-b818-a6fe5eab432b None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:50.447673 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e135141-23db-490a-a1bf-142bde6591fe None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:50.526829 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5cd26a-3da7-4d92-b5c7-a1a8f801a907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:50.528823 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5cd26a-3da7-4d92-b5c7-a1a8f801a907 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:50.529599 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5cd26a-3da7-4d92-b5c7-a1a8f801a907 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:50.530384 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5cd26a-3da7-4d92-b5c7-a1a8f801a907 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:50.544888 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5cd26a-3da7-4d92-b5c7-a1a8f801a907 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:50.547790 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5cd26a-3da7-4d92-b5c7-a1a8f801a907 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:50.556122 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efee7f1-fc3e-49e8-b818-a6fe5eab432b None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:50.558712 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:50.578979 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-de5cd26a-3da7-4d92-b5c7-a1a8f801a907 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 01 03:43:50.578979 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:50.578979 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:50.578979 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:50.578979 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:50.578979 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:50.578979 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:50.578979 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:50.578979 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:50.578979 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:50.578979 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:50.578979 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:50.578979 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 03:43:50.578979 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 03:43:50.578979 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 03:43:50.578979 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 03:43:50.580933 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:50.580933 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:50.580933 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 03:43:50.580933 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:43:50.580933 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 03:43:50.580933 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:43:50.580933 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:50.580933 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:50.580933 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:50.580933 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:50.580933 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:50.580933 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:50.580933 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:50.580933 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:50.580933 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:50.580933 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:50.580933 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:50.580933 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:50.583223 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:50.583223 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:50.583223 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 03:43:50.583223 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 03:43:50.583223 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 03:43:50.583223 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 03:43:50.583223 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 03:43:50.583223 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 03:43:50.583223 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 01 03:43:50.583223 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:50.587811 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 299/589] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Jul 1 03:43:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:50.589821 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5cd26a-3da7-4d92-b5c7-a1a8f801a907 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:50.597566 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a1cb6-685d-4e33-af1d-d8da9f71799a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:50.598384 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a1cb6-685d-4e33-af1d-d8da9f71799a None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:50.598664 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a1cb6-685d-4e33-af1d-d8da9f71799a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:50.598942 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a1cb6-685d-4e33-af1d-d8da9f71799a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:50.606919 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a1cb6-685d-4e33-af1d-d8da9f71799a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:50.608580 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a1cb6-685d-4e33-af1d-d8da9f71799a None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:50.624522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-508a1cb6-685d-4e33-af1d-d8da9f71799a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:43:50.624522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:50.624522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:50.624522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:50.624522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:50.624522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:50.624522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:50.624522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:50.624522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:50.624522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:50.624522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:50.624522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:50.624522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 03:43:50.624522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 03:43:50.624522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 03:43:50.627021 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 03:43:50.627021 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:50.627021 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:50.627021 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:50.627021 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:50.627021 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:50.627021 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:50.627021 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:50.627021 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:50.627021 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:50.627021 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:50.627021 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:50.627021 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:50.627021 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:50.627021 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:50.627021 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:50.627021 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:50.629319 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 03:43:50.629319 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 03:43:50.629319 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 03:43:50.629319 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 03:43:50.629319 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 03:43:50.629319 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 03:43:50.629319 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:43:50.629319 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:50.629319 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 291/590] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:43:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:50.629319 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a1cb6-685d-4e33-af1d-d8da9f71799a None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:50.741750 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a1cb6-685d-4e33-af1d-d8da9f71799a None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:50.746811 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5cd26a-3da7-4d92-b5c7-a1a8f801a907 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:50.780528 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f2998-feda-4fa4-ac75-6510fbc312a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:50.781220 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f2998-feda-4fa4-ac75-6510fbc312a9 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:50.781500 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f2998-feda-4fa4-ac75-6510fbc312a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:50.781770 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f2998-feda-4fa4-ac75-6510fbc312a9 None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:50.782613 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2f2998-feda-4fa4-ac75-6510fbc312a9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:50.783016 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2f2998-feda-4fa4-ac75-6510fbc312a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:50.784400 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2f2998-feda-4fa4-ac75-6510fbc312a9 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:50.785104 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0c060-2b05-4f0b-aca4-6097e18878a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:50.785845 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0c060-2b05-4f0b-aca4-6097e18878a6 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:50.786123 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0c060-2b05-4f0b-aca4-6097e18878a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:50.786385 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0c060-2b05-4f0b-aca4-6097e18878a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:50.790313 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:50.805757 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0c060-2b05-4f0b-aca4-6097e18878a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:50.805757 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0c060-2b05-4f0b-aca4-6097e18878a6 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:50.812381 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 292/591] 10.222.0.46 () {56 vars in 1139 bytes} [Fri Jul 1 03:43:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:50.813479 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f2998-feda-4fa4-ac75-6510fbc312a9 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:50.827370 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-9ad0c060-2b05-4f0b-aca4-6097e18878a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:50.827370 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:50.827370 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:50.827370 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:50.827370 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:50.827370 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:50.827370 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:50.827370 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:50.827370 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:50.827370 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:50.827370 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:50.827370 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:50.827370 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:43:50.827370 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:43:50.827370 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:43:50.828438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:43:50.828438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:50.828438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:50.828438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:50.828438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:50.828438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:50.828438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:50.828438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:50.828438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:50.828438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:50.828438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:50.828438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:50.828438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:50.828438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:50.828438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:50.828438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:50.828438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:50.829429 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:43:50.829429 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:43:50.829429 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:50.829429 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:50.831856 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 300/592] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:43:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:50.834196 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0c060-2b05-4f0b-aca4-6097e18878a6 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:50.850062 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:50.959764 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f2998-feda-4fa4-ac75-6510fbc312a9 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:50.979267 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0c060-2b05-4f0b-aca4-6097e18878a6 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:50.998554 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37783a9-7879-412e-a67a-f18a3948a2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:50.999231 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37783a9-7879-412e-a67a-f18a3948a2cc None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:50.999550 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37783a9-7879-412e-a67a-f18a3948a2cc None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:50.999852 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37783a9-7879-412e-a67a-f18a3948a2cc None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:51.000636 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37783a9-7879-412e-a67a-f18a3948a2cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:51.000949 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37783a9-7879-412e-a67a-f18a3948a2cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:51.002413 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37783a9-7879-412e-a67a-f18a3948a2cc None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:51.021789 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 293/593] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 1 03:43:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:51.022763 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37783a9-7879-412e-a67a-f18a3948a2cc None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:51.024320 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e8645-f252-42cc-b618-ed3c6827198f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:51.025290 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e8645-f252-42cc-b618-ed3c6827198f None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:51.025945 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e8645-f252-42cc-b618-ed3c6827198f None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:51.026359 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e8645-f252-42cc-b618-ed3c6827198f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:51.042470 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e8645-f252-42cc-b618-ed3c6827198f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:51.044660 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e8645-f252-42cc-b618-ed3c6827198f None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:51.067869 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-4f2e8645-f252-42cc-b618-ed3c6827198f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:51.067869 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:51.067869 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:51.067869 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:51.067869 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:51.067869 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:51.067869 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:51.067869 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:51.067869 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:51.067869 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:51.067869 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:51.067869 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:51.067869 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:43:51.067869 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:43:51.067869 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:43:51.068947 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:43:51.068947 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:51.068947 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:51.068947 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:51.068947 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:51.068947 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:51.068947 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:51.068947 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:51.068947 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:51.068947 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:51.068947 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:51.068947 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:51.068947 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:51.068947 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:51.068947 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:51.068947 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:51.068947 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:51.070006 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:43:51.070006 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:43:51.070006 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:51.070006 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:51.072368 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 301/594] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:43:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:51.073402 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e8645-f252-42cc-b618-ed3c6827198f None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:51.130067 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:51.130477 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:51.152690 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37783a9-7879-412e-a67a-f18a3948a2cc None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:51.191068 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5b651-0576-4a6c-a7f9-baeb151acb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:51.191781 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5b651-0576-4a6c-a7f9-baeb151acb4d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:51.192065 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5b651-0576-4a6c-a7f9-baeb151acb4d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:51.192342 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5b651-0576-4a6c-a7f9-baeb151acb4d None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:51.193066 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5b651-0576-4a6c-a7f9-baeb151acb4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:51.193377 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5b651-0576-4a6c-a7f9-baeb151acb4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:51.194802 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5b651-0576-4a6c-a7f9-baeb151acb4d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:51.203294 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e8645-f252-42cc-b618-ed3c6827198f None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:51.208745 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 294/595] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:43:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:51.210131 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac3afa-e902-4e40-a1a8-f6d79461c17b None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:51.210420 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac3afa-e902-4e40-a1a8-f6d79461c17b None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:51.210695 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac3afa-e902-4e40-a1a8-f6d79461c17b None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:51.212479 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 295/596] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:43:51.213281 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac3afa-e902-4e40-a1a8-f6d79461c17b None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:51.249610 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b502dc-e809-44c1-b0c1-1cd384273ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:51.250529 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b502dc-e809-44c1-b0c1-1cd384273ca5 None admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:51.250813 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b502dc-e809-44c1-b0c1-1cd384273ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:51.251088 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b502dc-e809-44c1-b0c1-1cd384273ca5 None admin] PATH_INFO: `/v3/projects/da83db15a312499fb627691ae442f233/users/418106a8c3104dcfa40fcc6c68356294/roles/66426d7dd6f64f6ebfcb1cbb8188b0d2` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:51.268708 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b502dc-e809-44c1-b0c1-1cd384273ca5 None admin] RBAC: Authorizing `identity:create_grant(project_id=da83db15a312499fb627691ae442f233, user_id=418106a8c3104dcfa40fcc6c68356294, role_id=66426d7dd6f64f6ebfcb1cbb8188b0d2)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:51.270861 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b502dc-e809-44c1-b0c1-1cd384273ca5 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:51.328173 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac3afa-e902-4e40-a1a8-f6d79461c17b None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:51.351762 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 302/597] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 1 03:43:51 2022] PUT /identity/v3/projects/da83db15a312499fb627691ae442f233/users/418106a8c3104dcfa40fcc6c68356294/roles/66426d7dd6f64f6ebfcb1cbb8188b0d2 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 03:43:51.352803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b502dc-e809-44c1-b0c1-1cd384273ca5 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:51.376925 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04e44e-0ea4-4b26-b2c3-13dbe3396bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:51.378200 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04e44e-0ea4-4b26-b2c3-13dbe3396bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:51.379053 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04e44e-0ea4-4b26-b2c3-13dbe3396bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:51.379339 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04e44e-0ea4-4b26-b2c3-13dbe3396bb0 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:51.380674 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc04e44e-0ea4-4b26-b2c3-13dbe3396bb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:51.381059 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc04e44e-0ea4-4b26-b2c3-13dbe3396bb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:51.382564 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc04e44e-0ea4-4b26-b2c3-13dbe3396bb0 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:51.403636 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 296/598] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:43:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:51.405532 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38c2e9-008e-4d01-9bbe-d9e93af25fa7 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:51.406131 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38c2e9-008e-4d01-9bbe-d9e93af25fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:51.406619 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38c2e9-008e-4d01-9bbe-d9e93af25fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:51.416928 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:51.441676 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-6e38c2e9-008e-4d01-9bbe-d9e93af25fa7 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:43:51.444173 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-6e38c2e9-008e-4d01-9bbe-d9e93af25fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:43:51.522536 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:51.535542 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b502dc-e809-44c1-b0c1-1cd384273ca5 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:51.575409 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f05a1-d24c-4648-bf74-db23cef8226a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:51.576766 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f05a1-d24c-4648-bf74-db23cef8226a None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:51.577246 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f05a1-d24c-4648-bf74-db23cef8226a None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:51.577765 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f05a1-d24c-4648-bf74-db23cef8226a None admin] PATH_INFO: `/v3/users/glance` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:51.578575 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 297/599] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:43:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:43:51.583485 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38c2e9-008e-4d01-9bbe-d9e93af25fa7 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:51.596403 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f05a1-d24c-4648-bf74-db23cef8226a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:51.598383 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f05a1-d24c-4648-bf74-db23cef8226a None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:51.627694 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-231f05a1-d24c-4648-bf74-db23cef8226a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 01 03:43:51.627694 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:51.627694 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:51.627694 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:51.627694 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:51.627694 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:51.627694 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:51.627694 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:51.627694 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:51.627694 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:51.627694 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:51.627694 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:51.627694 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 03:43:51.627694 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 03:43:51.627694 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 03:43:51.627694 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 03:43:51.629244 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:51.629244 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:51.629244 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 03:43:51.629244 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:43:51.629244 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 03:43:51.629244 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:43:51.629244 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:51.629244 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:51.629244 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:51.629244 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:51.629244 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:51.629244 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:51.629244 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:51.629244 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:51.629244 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:51.629244 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:51.629244 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:51.629244 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:51.630262 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:51.630262 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:51.630262 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 03:43:51.630262 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 03:43:51.630262 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 03:43:51.630262 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 03:43:51.630262 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 03:43:51.630262 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 03:43:51.630262 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 01 03:43:51.630262 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:51.632982 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 303/600] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:43:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:51.634063 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f05a1-d24c-4648-bf74-db23cef8226a None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:51.754691 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f05a1-d24c-4648-bf74-db23cef8226a None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:51.772994 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38c2e9-008e-4d01-9bbe-d9e93af25fa7 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:51.793740 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ae6f5-1bb6-4612-9c3f-d1cd01fcc255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:51.794551 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ae6f5-1bb6-4612-9c3f-d1cd01fcc255 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:51.794941 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ae6f5-1bb6-4612-9c3f-d1cd01fcc255 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:51.795224 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ae6f5-1bb6-4612-9c3f-d1cd01fcc255 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:51.807842 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ae6f5-1bb6-4612-9c3f-d1cd01fcc255 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:43:51.816485 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-eb1ae6f5-1bb6-4612-9c3f-d1cd01fcc255 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 03:43:51.816485 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:51.816485 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:51.816485 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:51.816485 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:51.816485 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:51.816485 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:51.816485 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:51.816485 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:51.816485 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:51.816485 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:51.816485 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:51.816485 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:43:51.816485 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:43:51.816485 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:43:51.816485 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:43:51.817479 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:43:51.817479 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:43:51.817479 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:43:51.817479 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:43:51.817479 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:51.817479 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:51.817479 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:51.817479 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:51.817479 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:51.817479 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:51.817479 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:51.817479 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:51.817479 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:51.817479 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:51.817479 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:51.817479 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:51.818307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:51.818307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:51.818307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:51.818307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:51.818307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:43:51.818307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:43:51.818307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:43:51.818307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:43:51.818307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:43:51.818307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:43:51.818307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 03:43:51.818307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:51.822735 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 304/601] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Jul 1 03:43:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:51.823722 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ae6f5-1bb6-4612-9c3f-d1cd01fcc255 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:51.831862 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:51.840212 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0d5cc-ad77-4d03-b3fe-53303140a594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:51.840579 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:51.841549 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0d5cc-ad77-4d03-b3fe-53303140a594 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:51.842030 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0d5cc-ad77-4d03-b3fe-53303140a594 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:51.842542 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0d5cc-ad77-4d03-b3fe-53303140a594 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:51.855661 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c0d5cc-ad77-4d03-b3fe-53303140a594 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:51.858556 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c0d5cc-ad77-4d03-b3fe-53303140a594 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:51.887476 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-54c0d5cc-ad77-4d03-b3fe-53303140a594 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:43:51.887476 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:51.887476 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:51.887476 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:51.887476 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:51.887476 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:51.887476 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:51.887476 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:51.887476 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:51.887476 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:51.887476 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:51.887476 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:51.887476 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 03:43:51.887476 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 03:43:51.887476 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 03:43:51.888587 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 03:43:51.888587 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:51.888587 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:51.888587 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:51.888587 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:51.888587 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:51.888587 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:51.888587 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:51.888587 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:51.888587 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:51.888587 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:51.888587 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:51.888587 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:51.888587 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:51.888587 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:51.888587 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:51.888587 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:51.889767 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 03:43:51.889767 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 03:43:51.889767 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 03:43:51.889767 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 03:43:51.889767 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 03:43:51.889767 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 03:43:51.889767 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:43:51.889767 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:51.895952 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 298/602] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:43:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:51.897583 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0d5cc-ad77-4d03-b3fe-53303140a594 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:51.949743 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ae6f5-1bb6-4612-9c3f-d1cd01fcc255 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:51.989455 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b662f-1241-4b39-8952-cf7638230046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:51.990397 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b662f-1241-4b39-8952-cf7638230046 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:51.990855 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b662f-1241-4b39-8952-cf7638230046 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:51.991279 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b662f-1241-4b39-8952-cf7638230046 None admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:51.992325 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b662f-1241-4b39-8952-cf7638230046 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:51.992784 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b662f-1241-4b39-8952-cf7638230046 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:51.994419 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b662f-1241-4b39-8952-cf7638230046 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:52.014861 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 305/603] 10.222.0.46 () {56 vars in 1137 bytes} [Fri Jul 1 03:43:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:52.016103 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b662f-1241-4b39-8952-cf7638230046 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:52.098388 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:52.098573 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0d5cc-ad77-4d03-b3fe-53303140a594 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:52.129658 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b662f-1241-4b39-8952-cf7638230046 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:52.161128 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22405680-f868-40ac-b903-263952c685b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:52.162284 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22405680-f868-40ac-b903-263952c685b5 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:52.162770 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22405680-f868-40ac-b903-263952c685b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:52.163527 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22405680-f868-40ac-b903-263952c685b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:52.164964 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22405680-f868-40ac-b903-263952c685b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:52.165636 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22405680-f868-40ac-b903-263952c685b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:52.168513 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22405680-f868-40ac-b903-263952c685b5 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:52.171111 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4792169d-6f89-4820-b39b-7e9cfd9936db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:52.172069 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4792169d-6f89-4820-b39b-7e9cfd9936db None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:52.172536 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4792169d-6f89-4820-b39b-7e9cfd9936db None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:52.173095 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4792169d-6f89-4820-b39b-7e9cfd9936db None admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:52.174091 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4792169d-6f89-4820-b39b-7e9cfd9936db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:52.174676 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4792169d-6f89-4820-b39b-7e9cfd9936db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:52.176938 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4792169d-6f89-4820-b39b-7e9cfd9936db None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:52.190939 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 299/604] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Jul 1 03:43:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:52.190939 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22405680-f868-40ac-b903-263952c685b5 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:52.196381 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 306/605] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 1 03:43:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:52.197530 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4792169d-6f89-4820-b39b-7e9cfd9936db None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:52.293826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:52.318259 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4792169d-6f89-4820-b39b-7e9cfd9936db None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:52.350376 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:52.359739 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb88c55-7924-4bbd-b97d-8580fe86c0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:52.360877 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb88c55-7924-4bbd-b97d-8580fe86c0bb None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:52.361326 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb88c55-7924-4bbd-b97d-8580fe86c0bb None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:52.361820 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb88c55-7924-4bbd-b97d-8580fe86c0bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:52.375224 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb88c55-7924-4bbd-b97d-8580fe86c0bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:52.377102 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb88c55-7924-4bbd-b97d-8580fe86c0bb None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:52.392187 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22405680-f868-40ac-b903-263952c685b5 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:52.398292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-5bb88c55-7924-4bbd-b97d-8580fe86c0bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:52.398292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:52.398292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:52.398292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:52.398292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:52.398292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:52.398292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:52.398292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:52.398292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:52.398292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:52.398292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:52.398292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:52.398292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:43:52.398292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:43:52.398292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:43:52.399201 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:43:52.399201 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:52.399201 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:52.399201 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:52.399201 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:52.399201 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:52.399201 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:52.399201 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:52.399201 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:52.399201 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:52.399201 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:52.399201 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:52.399201 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:52.399201 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:52.399201 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:52.399201 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:52.399201 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:52.400112 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:43:52.400112 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:43:52.400112 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:52.400112 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:52.406987 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 307/606] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:43:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:52.408360 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb88c55-7924-4bbd-b97d-8580fe86c0bb None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:52.462063 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e52325-8004-4495-88c4-fafe192809ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:52.463462 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e52325-8004-4495-88c4-fafe192809ca None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:52.464011 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e52325-8004-4495-88c4-fafe192809ca None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:52.464513 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e52325-8004-4495-88c4-fafe192809ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:52.486884 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e52325-8004-4495-88c4-fafe192809ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:52.489937 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e52325-8004-4495-88c4-fafe192809ca None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:52.518015 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-96e52325-8004-4495-88c4-fafe192809ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:52.518015 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:52.518015 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:52.518015 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:52.518015 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:52.518015 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:52.518015 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:52.518015 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:52.518015 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:52.518015 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:52.518015 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:52.518015 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:52.518015 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:43:52.518015 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:43:52.518015 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:43:52.519540 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:43:52.519540 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:52.519540 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:52.519540 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:52.519540 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:52.519540 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:52.519540 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:52.519540 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:52.519540 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:52.519540 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:52.519540 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:52.519540 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:52.519540 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:52.519540 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:52.519540 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:52.519540 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:52.519540 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:52.520427 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:43:52.520427 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:43:52.520427 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:52.520427 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:52.521147 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 300/607] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:43:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:52.521963 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e52325-8004-4495-88c4-fafe192809ca None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:52.536481 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb88c55-7924-4bbd-b97d-8580fe86c0bb None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:52.600190 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db638791-6d65-4849-89f2-51f115d3c53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:52.601172 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db638791-6d65-4849-89f2-51f115d3c53b None admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:52.601737 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db638791-6d65-4849-89f2-51f115d3c53b None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:52.601737 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db638791-6d65-4849-89f2-51f115d3c53b None admin] PATH_INFO: `/v3/projects/da83db15a312499fb627691ae442f233/users/93929b81a23c482ca7ce47e7a94682e4/roles/66426d7dd6f64f6ebfcb1cbb8188b0d2` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:52.623790 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db638791-6d65-4849-89f2-51f115d3c53b None admin] RBAC: Authorizing `identity:create_grant(project_id=da83db15a312499fb627691ae442f233, user_id=93929b81a23c482ca7ce47e7a94682e4, role_id=66426d7dd6f64f6ebfcb1cbb8188b0d2)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:52.626604 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db638791-6d65-4849-89f2-51f115d3c53b None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:52.645705 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e52325-8004-4495-88c4-fafe192809ca None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:52.654100 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:52.684929 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a0e8c-a172-440e-80b0-f13bd90a68bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:52.685729 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a0e8c-a172-440e-80b0-f13bd90a68bc None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:52.686054 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a0e8c-a172-440e-80b0-f13bd90a68bc None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:52.686369 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a0e8c-a172-440e-80b0-f13bd90a68bc None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:52.687210 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a0e8c-a172-440e-80b0-f13bd90a68bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:52.687638 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a0e8c-a172-440e-80b0-f13bd90a68bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:52.689290 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a0e8c-a172-440e-80b0-f13bd90a68bc None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:52.704433 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 301/608] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:43:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:52.706114 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501d938-c315-4dc8-b90d-ed6e5de705cd None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:52.706598 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501d938-c315-4dc8-b90d-ed6e5de705cd None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:52.707006 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501d938-c315-4dc8-b90d-ed6e5de705cd None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:52.713181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 302/609] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:43:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:43:52.713181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501d938-c315-4dc8-b90d-ed6e5de705cd None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:52.739815 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 308/610] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 1 03:43:52 2022] PUT /identity/v3/projects/da83db15a312499fb627691ae442f233/users/93929b81a23c482ca7ce47e7a94682e4/roles/66426d7dd6f64f6ebfcb1cbb8188b0d2 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 03:43:52.741374 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db638791-6d65-4849-89f2-51f115d3c53b None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:52.826911 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:52.939157 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501d938-c315-4dc8-b90d-ed6e5de705cd None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:52.965945 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db638791-6d65-4849-89f2-51f115d3c53b None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:53.021139 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fbc368-929a-4a6c-a501-ba3ce6b3f52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:53.022666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fbc368-929a-4a6c-a501-ba3ce6b3f52d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:53.023374 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fbc368-929a-4a6c-a501-ba3ce6b3f52d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:53.024116 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fbc368-929a-4a6c-a501-ba3ce6b3f52d None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:53.025688 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fbc368-929a-4a6c-a501-ba3ce6b3f52d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:53.026478 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fbc368-929a-4a6c-a501-ba3ce6b3f52d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:53.029373 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fbc368-929a-4a6c-a501-ba3ce6b3f52d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:53.035123 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce89936-af91-4a20-97df-9faaa236b51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:53.036964 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce89936-af91-4a20-97df-9faaa236b51a None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:53.037747 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce89936-af91-4a20-97df-9faaa236b51a None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:53.038727 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce89936-af91-4a20-97df-9faaa236b51a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:53.053757 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 303/611] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:43:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:53.054331 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce89936-af91-4a20-97df-9faaa236b51a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:53.057334 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce89936-af91-4a20-97df-9faaa236b51a None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:53.063395 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259dc34e-1960-4006-8b5a-1322700dd27f None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:53.063938 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259dc34e-1960-4006-8b5a-1322700dd27f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:53.064436 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259dc34e-1960-4006-8b5a-1322700dd27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:53.085719 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-7ce89936-af91-4a20-97df-9faaa236b51a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 01 03:43:53.085719 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:53.085719 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:53.085719 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:53.085719 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:53.085719 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:53.085719 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:53.085719 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:53.085719 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:53.085719 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:53.085719 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:53.085719 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:53.085719 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 03:43:53.085719 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 03:43:53.085719 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 03:43:53.085719 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 03:43:53.098201 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:53.098201 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:53.098201 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 03:43:53.098201 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:43:53.098201 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 03:43:53.098201 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:43:53.098201 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:53.098201 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:53.098201 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:53.098201 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:53.098201 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:53.098201 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:53.098201 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:53.098201 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:53.098201 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:53.098201 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:53.098201 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:53.098201 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:53.101144 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:53.101144 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:53.101144 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 03:43:53.101144 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 03:43:53.101144 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 03:43:53.101144 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 03:43:53.101144 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 03:43:53.101144 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 03:43:53.101144 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 01 03:43:53.101144 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:53.101144 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 309/612] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 1 03:43:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:53.101144 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce89936-af91-4a20-97df-9faaa236b51a None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:53.103695 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-259dc34e-1960-4006-8b5a-1322700dd27f None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:43:53.103695 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-259dc34e-1960-4006-8b5a-1322700dd27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:43:53.139663 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:53.239957 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 304/613] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:43:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:43:53.242058 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259dc34e-1960-4006-8b5a-1322700dd27f None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:53.295341 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:53.312451 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce89936-af91-4a20-97df-9faaa236b51a None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:53.372398 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b98bb-d946-4c66-909b-8e73da461514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:53.373674 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b98bb-d946-4c66-909b-8e73da461514 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:53.374148 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b98bb-d946-4c66-909b-8e73da461514 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:53.374620 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b98bb-d946-4c66-909b-8e73da461514 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:53.387188 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b98bb-d946-4c66-909b-8e73da461514 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:53.391175 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b98bb-d946-4c66-909b-8e73da461514 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:53.418587 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-ed9b98bb-d946-4c66-909b-8e73da461514 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:43:53.418587 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:53.418587 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:53.418587 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:53.418587 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:53.418587 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:53.418587 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:53.418587 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:53.418587 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:53.418587 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:53.418587 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:53.418587 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:53.418587 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 03:43:53.418587 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 03:43:53.418587 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 03:43:53.420350 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 03:43:53.420350 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:53.420350 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:53.420350 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:53.420350 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:53.420350 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:53.420350 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:53.420350 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:53.420350 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:53.420350 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:53.420350 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:53.420350 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:53.420350 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:53.420350 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:53.420350 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:53.420350 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:53.420350 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:53.422869 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 03:43:53.422869 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 03:43:53.422869 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 03:43:53.422869 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 03:43:53.422869 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 03:43:53.422869 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 03:43:53.422869 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:43:53.422869 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:53.422869 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 310/614] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:43:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:53.422869 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b98bb-d946-4c66-909b-8e73da461514 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:53.458211 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259dc34e-1960-4006-8b5a-1322700dd27f None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:53.533859 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41642585-cb2d-406f-ba20-838905505681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:53.535727 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41642585-cb2d-406f-ba20-838905505681 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:53.536546 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41642585-cb2d-406f-ba20-838905505681 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:53.537317 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41642585-cb2d-406f-ba20-838905505681 None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:53.539484 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41642585-cb2d-406f-ba20-838905505681 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:53.540368 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41642585-cb2d-406f-ba20-838905505681 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:53.543271 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41642585-cb2d-406f-ba20-838905505681 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:53.582920 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 305/615] 10.222.0.46 () {56 vars in 1135 bytes} [Fri Jul 1 03:43:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:53.582920 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41642585-cb2d-406f-ba20-838905505681 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:53.602764 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:53.611307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b98bb-d946-4c66-909b-8e73da461514 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:53.667334 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe511a4-42e9-458c-a2ca-4d041c0a3e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:53.668434 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe511a4-42e9-458c-a2ca-4d041c0a3e80 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:53.668806 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe511a4-42e9-458c-a2ca-4d041c0a3e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:53.669146 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe511a4-42e9-458c-a2ca-4d041c0a3e80 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:53.683432 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe511a4-42e9-458c-a2ca-4d041c0a3e80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:43:53.693924 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-8fe511a4-42e9-458c-a2ca-4d041c0a3e80 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 03:43:53.693924 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:53.693924 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:53.693924 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:53.693924 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:53.693924 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:53.693924 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:53.693924 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:53.693924 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:53.693924 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:53.693924 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:53.693924 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:53.693924 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:43:53.693924 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:43:53.693924 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:43:53.693924 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:43:53.695064 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:43:53.695064 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:43:53.695064 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:43:53.695064 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:43:53.695064 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:53.695064 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:53.695064 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:53.695064 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:53.695064 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:53.695064 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:53.695064 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:53.695064 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:53.695064 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:53.695064 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:53.695064 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:53.695064 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:53.696041 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:53.696041 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:53.696041 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:53.696041 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:53.696041 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:43:53.696041 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:43:53.696041 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:43:53.696041 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:43:53.696041 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:43:53.696041 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:43:53.696041 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 03:43:53.696041 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:53.696877 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 311/616] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Jul 1 03:43:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:53.699012 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b0ea6-96ae-42f6-8fed-f4e54344cf6b None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:53.699725 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b0ea6-96ae-42f6-8fed-f4e54344cf6b None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:53.699994 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b0ea6-96ae-42f6-8fed-f4e54344cf6b None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:53.707140 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 312/617] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:43:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:43:53.707140 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b0ea6-96ae-42f6-8fed-f4e54344cf6b None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:53.723158 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:53.740895 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41642585-cb2d-406f-ba20-838905505681 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:53.789127 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb90cd1-d0b7-47e6-bbf6-667804a20170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:53.790072 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb90cd1-d0b7-47e6-bbf6-667804a20170 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:53.790556 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb90cd1-d0b7-47e6-bbf6-667804a20170 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:53.791034 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb90cd1-d0b7-47e6-bbf6-667804a20170 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:53.792393 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb90cd1-d0b7-47e6-bbf6-667804a20170 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:53.792942 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb90cd1-d0b7-47e6-bbf6-667804a20170 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:53.794917 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb90cd1-d0b7-47e6-bbf6-667804a20170 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:53.810641 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 306/618] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 1 03:43:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:53.812478 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb90cd1-d0b7-47e6-bbf6-667804a20170 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:53.873576 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b0ea6-96ae-42f6-8fed-f4e54344cf6b None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:53.919324 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b731a-59f0-4ffe-aba6-aaa403186645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:53.920922 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b731a-59f0-4ffe-aba6-aaa403186645 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:53.921521 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b731a-59f0-4ffe-aba6-aaa403186645 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:53.922117 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b731a-59f0-4ffe-aba6-aaa403186645 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:53.927487 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:53.943683 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b731a-59f0-4ffe-aba6-aaa403186645 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:53.946697 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b731a-59f0-4ffe-aba6-aaa403186645 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:53.956126 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb90cd1-d0b7-47e6-bbf6-667804a20170 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:53.980834 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-8c3b731a-59f0-4ffe-aba6-aaa403186645 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:53.980834 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:53.980834 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:53.980834 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:53.980834 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:53.980834 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:53.980834 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:53.980834 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:53.980834 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:53.980834 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:53.980834 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:53.980834 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:53.980834 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:43:53.980834 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:43:53.980834 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:43:53.981960 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:43:53.981960 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:53.981960 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:53.981960 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:53.981960 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:53.981960 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:53.981960 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:53.981960 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:53.981960 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:53.981960 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:53.981960 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:53.981960 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:53.981960 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:53.981960 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:53.981960 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:53.981960 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:53.981960 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:53.983119 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:43:53.983119 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:43:53.983119 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:53.983119 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:53.983927 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 313/619] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:43:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:53.994504 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f3d99-6458-4252-ac42-59b138c7f580 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:53.995003 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f3d99-6458-4252-ac42-59b138c7f580 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:53.995519 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f3d99-6458-4252-ac42-59b138c7f580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:53.996134 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74686062-6e72-4c54-bc57-e878ebeec86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:53.996916 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74686062-6e72-4c54-bc57-e878ebeec86c None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:53.997267 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74686062-6e72-4c54-bc57-e878ebeec86c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:53.997611 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74686062-6e72-4c54-bc57-e878ebeec86c None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:53.998524 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74686062-6e72-4c54-bc57-e878ebeec86c None admin] RBAC: Adding query filter params (name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:53.998917 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74686062-6e72-4c54-bc57-e878ebeec86c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:54.000413 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74686062-6e72-4c54-bc57-e878ebeec86c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:54.014976 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 307/620] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Jul 1 03:43:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:54.014976 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74686062-6e72-4c54-bc57-e878ebeec86c None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:54.024812 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-779f3d99-6458-4252-ac42-59b138c7f580 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:43:54.026928 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-779f3d99-6458-4252-ac42-59b138c7f580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:43:54.116486 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:54.129297 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 314/621] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:43:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:43:54.130750 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f3d99-6458-4252-ac42-59b138c7f580 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:54.134377 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74686062-6e72-4c54-bc57-e878ebeec86c None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:54.176913 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc2625-c396-4332-8275-72794a516dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:54.178522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc2625-c396-4332-8275-72794a516dc5 None admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:54.179031 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc2625-c396-4332-8275-72794a516dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:54.179695 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc2625-c396-4332-8275-72794a516dc5 None admin] PATH_INFO: `/v3/projects/da83db15a312499fb627691ae442f233/users/ff2e6387d102445d963de072c55833d3/roles/66426d7dd6f64f6ebfcb1cbb8188b0d2` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:54.186906 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:54.208967 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc2625-c396-4332-8275-72794a516dc5 None admin] RBAC: Authorizing `identity:create_grant(project_id=da83db15a312499fb627691ae442f233, user_id=ff2e6387d102445d963de072c55833d3, role_id=66426d7dd6f64f6ebfcb1cbb8188b0d2)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:54.211741 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc2625-c396-4332-8275-72794a516dc5 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:54.257942 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f3d99-6458-4252-ac42-59b138c7f580 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:54.299237 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b424616-1b10-41c3-92d3-d762bcf0adcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:54.300772 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b424616-1b10-41c3-92d3-d762bcf0adcb None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:54.301170 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b424616-1b10-41c3-92d3-d762bcf0adcb None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:54.301616 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b424616-1b10-41c3-92d3-d762bcf0adcb None admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:54.302826 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b424616-1b10-41c3-92d3-d762bcf0adcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:54.303330 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b424616-1b10-41c3-92d3-d762bcf0adcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:54.305618 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b424616-1b10-41c3-92d3-d762bcf0adcb None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:54.323493 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 308/622] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 1 03:43:54 2022] PUT /identity/v3/projects/da83db15a312499fb627691ae442f233/users/ff2e6387d102445d963de072c55833d3/roles/66426d7dd6f64f6ebfcb1cbb8188b0d2 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 03:43:54.323493 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc2625-c396-4332-8275-72794a516dc5 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:54.336739 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 315/623] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:43:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:54.338658 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b424616-1b10-41c3-92d3-d762bcf0adcb None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:54.466668 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:54.532877 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc2625-c396-4332-8275-72794a516dc5 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:54.569083 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b424616-1b10-41c3-92d3-d762bcf0adcb None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:54.601776 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a1ef3-e548-4e3d-ae81-4da321bf28d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:54.603638 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a1ef3-e548-4e3d-ae81-4da321bf28d8 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:54.604399 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a1ef3-e548-4e3d-ae81-4da321bf28d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:54.605181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a1ef3-e548-4e3d-ae81-4da321bf28d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:54.625563 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a1ef3-e548-4e3d-ae81-4da321bf28d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:54.628678 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a1ef3-e548-4e3d-ae81-4da321bf28d8 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:54.639103 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffc424-a702-49de-b984-be36cc1653da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:54.641548 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffc424-a702-49de-b984-be36cc1653da None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:54.642299 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffc424-a702-49de-b984-be36cc1653da None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:54.643008 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffc424-a702-49de-b984-be36cc1653da None admin] PATH_INFO: `/v3/roles/service` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:54.654346 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-059a1ef3-e548-4e3d-ae81-4da321bf28d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:54.654346 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:54.654346 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:54.654346 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:54.654346 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:54.654346 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:54.654346 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:54.654346 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:54.654346 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:54.654346 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:54.654346 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:54.654346 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:54.654346 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:43:54.654346 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:43:54.654346 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:43:54.656538 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:43:54.656538 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:54.656538 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:54.656538 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:54.656538 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:54.656538 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:54.656538 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:54.656538 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:54.656538 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:54.656538 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:54.656538 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:54.656538 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:54.656538 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:54.656538 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:54.656538 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:54.656538 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:54.656538 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:54.658818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:43:54.658818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:43:54.658818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:54.658818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:54.658818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 309/624] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:43:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:54.658818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a1ef3-e548-4e3d-ae81-4da321bf28d8 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:54.670224 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bffc424-a702-49de-b984-be36cc1653da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:43:54.686291 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-2bffc424-a702-49de-b984-be36cc1653da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 03:43:54.686291 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:54.686291 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:54.686291 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:54.686291 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:54.686291 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:54.686291 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:54.686291 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:54.686291 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:54.686291 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:54.686291 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:54.686291 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:54.686291 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:43:54.686291 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:43:54.686291 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:43:54.686291 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:43:54.688410 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:43:54.688410 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:43:54.688410 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:43:54.688410 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:43:54.688410 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:54.688410 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:54.688410 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:54.688410 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:54.688410 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:54.688410 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:54.688410 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:54.688410 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:54.688410 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:54.688410 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:54.688410 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:54.688410 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:54.690292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:54.690292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:54.690292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:54.690292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:54.690292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:43:54.690292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:43:54.690292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:43:54.690292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:43:54.690292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:43:54.690292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:43:54.690292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 03:43:54.690292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:54.699745 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 316/625] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Jul 1 03:43:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:54.701507 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffc424-a702-49de-b984-be36cc1653da None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:54.743962 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:54.826999 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a1ef3-e548-4e3d-ae81-4da321bf28d8 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:54.867148 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffc424-a702-49de-b984-be36cc1653da None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:54.867994 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988adea7-e57e-4057-baaf-4ebf678a7845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:54.869078 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988adea7-e57e-4057-baaf-4ebf678a7845 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:54.869523 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988adea7-e57e-4057-baaf-4ebf678a7845 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:54.870028 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988adea7-e57e-4057-baaf-4ebf678a7845 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:54.878871 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988adea7-e57e-4057-baaf-4ebf678a7845 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:54.880699 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988adea7-e57e-4057-baaf-4ebf678a7845 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:54.883067 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:54.897619 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-988adea7-e57e-4057-baaf-4ebf678a7845 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:43:54.897619 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:54.897619 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:54.897619 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:54.897619 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:54.897619 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:54.897619 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:54.897619 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:54.897619 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:54.897619 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:54.897619 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:54.897619 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:54.897619 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 03:43:54.897619 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 03:43:54.897619 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 03:43:54.898720 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 03:43:54.898720 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:54.898720 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:54.898720 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:54.898720 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:54.898720 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:54.898720 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:54.898720 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:54.898720 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:54.898720 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:54.898720 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:54.898720 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:54.898720 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:54.898720 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:54.898720 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:54.898720 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:54.898720 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:54.899700 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 03:43:54.899700 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 03:43:54.899700 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 03:43:54.899700 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 03:43:54.899700 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 03:43:54.899700 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 03:43:54.899700 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:43:54.899700 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:54.902115 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 310/626] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:43:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:54.903093 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988adea7-e57e-4057-baaf-4ebf678a7845 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:54.907766 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba5210-5353-4865-a3f1-e0470106b941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:54.908126 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba5210-5353-4865-a3f1-e0470106b941 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:54.908407 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba5210-5353-4865-a3f1-e0470106b941 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:54.908685 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba5210-5353-4865-a3f1-e0470106b941 None admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:54.909467 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba5210-5353-4865-a3f1-e0470106b941 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:54.909781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba5210-5353-4865-a3f1-e0470106b941 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:54.911173 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba5210-5353-4865-a3f1-e0470106b941 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:54.931134 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 317/627] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:43:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:54.932285 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba5210-5353-4865-a3f1-e0470106b941 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:55.018282 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:55.022978 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988adea7-e57e-4057-baaf-4ebf678a7845 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:55.057448 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba5210-5353-4865-a3f1-e0470106b941 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:55.063590 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e221203-3bb5-4b12-be59-6ff7244b45e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:55.064633 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e221203-3bb5-4b12-be59-6ff7244b45e5 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:55.065220 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e221203-3bb5-4b12-be59-6ff7244b45e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:55.065960 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e221203-3bb5-4b12-be59-6ff7244b45e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:55.067561 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e221203-3bb5-4b12-be59-6ff7244b45e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:55.068225 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e221203-3bb5-4b12-be59-6ff7244b45e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:55.070666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e221203-3bb5-4b12-be59-6ff7244b45e5 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:55.091513 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 311/628] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Jul 1 03:43:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:55.091513 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e221203-3bb5-4b12-be59-6ff7244b45e5 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:55.111258 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88bef2b-b1a8-4e3d-88ba-b3221dc4af66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:55.113201 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88bef2b-b1a8-4e3d-88ba-b3221dc4af66 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:55.113874 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88bef2b-b1a8-4e3d-88ba-b3221dc4af66 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:55.114384 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88bef2b-b1a8-4e3d-88ba-b3221dc4af66 None admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:55.116219 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88bef2b-b1a8-4e3d-88ba-b3221dc4af66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:55.116758 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88bef2b-b1a8-4e3d-88ba-b3221dc4af66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:55.118500 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88bef2b-b1a8-4e3d-88ba-b3221dc4af66 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:55.139032 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 318/629] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 1 03:43:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:55.139032 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88bef2b-b1a8-4e3d-88ba-b3221dc4af66 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:55.178512 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:55.273370 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e221203-3bb5-4b12-be59-6ff7244b45e5 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:55.284828 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88bef2b-b1a8-4e3d-88ba-b3221dc4af66 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:55.322145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c1638-5429-47e3-b115-8cec9861317e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:55.323381 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c1638-5429-47e3-b115-8cec9861317e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:55.324677 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c1638-5429-47e3-b115-8cec9861317e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:55.325184 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c1638-5429-47e3-b115-8cec9861317e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:55.337006 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c1638-5429-47e3-b115-8cec9861317e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:55.339164 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c1638-5429-47e3-b115-8cec9861317e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:55.350708 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f28ab20-9e80-4a0e-982b-baa761d89507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:55.352358 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28ab20-9e80-4a0e-982b-baa761d89507 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:55.352929 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28ab20-9e80-4a0e-982b-baa761d89507 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:55.353463 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28ab20-9e80-4a0e-982b-baa761d89507 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:55.357967 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-f75c1638-5429-47e3-b115-8cec9861317e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 01 03:43:55.357967 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:55.357967 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:55.357967 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:55.357967 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:55.357967 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:55.357967 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:55.357967 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:55.357967 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:55.357967 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:55.357967 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:55.357967 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:55.357967 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 03:43:55.357967 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 03:43:55.357967 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 03:43:55.357967 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 03:43:55.358944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:55.358944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:55.358944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 03:43:55.358944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:43:55.358944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 03:43:55.358944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:43:55.358944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:55.358944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:55.358944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:55.358944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:55.358944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:55.358944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:55.358944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:55.358944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:55.358944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:55.358944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:55.358944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:55.358944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:55.359924 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:55.359924 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:55.359924 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 03:43:55.359924 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 03:43:55.359924 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 03:43:55.359924 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 03:43:55.359924 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 03:43:55.359924 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 03:43:55.359924 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 01 03:43:55.359924 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:55.363212 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 312/630] 10.222.0.46 () {56 vars in 1093 bytes} [Fri Jul 1 03:43:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:55.364311 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c1638-5429-47e3-b115-8cec9861317e None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:55.383746 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f28ab20-9e80-4a0e-982b-baa761d89507 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:55.386258 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f28ab20-9e80-4a0e-982b-baa761d89507 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:55.390800 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:55.423857 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-8f28ab20-9e80-4a0e-982b-baa761d89507 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:55.423857 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:55.423857 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:55.423857 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:55.423857 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:55.423857 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:55.423857 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:55.423857 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:55.423857 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:55.423857 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:55.423857 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:55.423857 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:55.423857 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:43:55.423857 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:43:55.423857 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:43:55.424858 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:43:55.424858 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:55.424858 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:55.424858 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:55.424858 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:55.424858 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:55.424858 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:55.424858 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:55.424858 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:55.424858 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:55.424858 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:55.424858 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:55.424858 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:55.424858 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:55.424858 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:55.424858 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:55.424858 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:55.425721 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:43:55.425721 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:43:55.425721 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:55.425721 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:55.432025 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 319/631] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:43:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:55.433639 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f28ab20-9e80-4a0e-982b-baa761d89507 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:55.483350 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c1638-5429-47e3-b115-8cec9861317e None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:55.524685 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f66ead-e9e2-4d42-9567-c13df57fd67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:55.525850 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f66ead-e9e2-4d42-9567-c13df57fd67a None admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:55.526334 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f66ead-e9e2-4d42-9567-c13df57fd67a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:55.526821 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f66ead-e9e2-4d42-9567-c13df57fd67a None admin] PATH_INFO: `/v3/projects/da83db15a312499fb627691ae442f233/users/83787880173b459c8975b834bd47a51a/roles/66426d7dd6f64f6ebfcb1cbb8188b0d2` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:55.544241 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f66ead-e9e2-4d42-9567-c13df57fd67a None admin] RBAC: Authorizing `identity:create_grant(project_id=da83db15a312499fb627691ae442f233, user_id=83787880173b459c8975b834bd47a51a, role_id=66426d7dd6f64f6ebfcb1cbb8188b0d2)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:55.546087 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f66ead-e9e2-4d42-9567-c13df57fd67a None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:55.593217 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:55.610193 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f28ab20-9e80-4a0e-982b-baa761d89507 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:55.630264 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 313/632] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 1 03:43:55 2022] PUT /identity/v3/projects/da83db15a312499fb627691ae442f233/users/83787880173b459c8975b834bd47a51a/roles/66426d7dd6f64f6ebfcb1cbb8188b0d2 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 03:43:55.631418 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f66ead-e9e2-4d42-9567-c13df57fd67a None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:55.671485 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c19ec-044b-4473-881d-062df94c9997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:55.672989 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c19ec-044b-4473-881d-062df94c9997 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:55.673382 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c19ec-044b-4473-881d-062df94c9997 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:55.673770 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c19ec-044b-4473-881d-062df94c9997 None admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:55.675060 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c19ec-044b-4473-881d-062df94c9997 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:55.675611 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c19ec-044b-4473-881d-062df94c9997 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:55.678427 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c19ec-044b-4473-881d-062df94c9997 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:55.723486 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 320/633] 10.222.0.46 () {56 vars in 1133 bytes} [Fri Jul 1 03:43:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:55.723486 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26fcc9-e300-4db8-b8be-f0658f62e383 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:55.723486 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26fcc9-e300-4db8-b8be-f0658f62e383 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:55.723486 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26fcc9-e300-4db8-b8be-f0658f62e383 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:55.729137 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 321/634] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:43:55 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:43:55.731864 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a77354-4539-45a0-bc1d-908d5092cfdf None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:55.732508 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a77354-4539-45a0-bc1d-908d5092cfdf None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:55.733082 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a77354-4539-45a0-bc1d-908d5092cfdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:55.763314 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-b3a77354-4539-45a0-bc1d-908d5092cfdf None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:43:55.765784 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-b3a77354-4539-45a0-bc1d-908d5092cfdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:43:55.787521 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:55.860709 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f66ead-e9e2-4d42-9567-c13df57fd67a None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:55.903871 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 322/635] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:43:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 03:43:55.905681 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a77354-4539-45a0-bc1d-908d5092cfdf None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:55.921913 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d7229-e024-4038-a62c-d342c2430f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:55.922583 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d7229-e024-4038-a62c-d342c2430f89 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:55.922869 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d7229-e024-4038-a62c-d342c2430f89 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:55.923146 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d7229-e024-4038-a62c-d342c2430f89 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:55.923941 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d7229-e024-4038-a62c-d342c2430f89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:55.924252 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d7229-e024-4038-a62c-d342c2430f89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:55.925815 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d7229-e024-4038-a62c-d342c2430f89 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:55.949920 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 314/636] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:43:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:55.951077 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d7229-e024-4038-a62c-d342c2430f89 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:56.037114 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:56.065109 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d7229-e024-4038-a62c-d342c2430f89 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:56.081660 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a77354-4539-45a0-bc1d-908d5092cfdf None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:56.099915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:56.108290 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4182aa-40ff-476e-8719-fc2fbcd1c8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:56.109899 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4182aa-40ff-476e-8719-fc2fbcd1c8de None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:56.110376 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4182aa-40ff-476e-8719-fc2fbcd1c8de None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:56.110814 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4182aa-40ff-476e-8719-fc2fbcd1c8de None admin] PATH_INFO: `/v3/roles/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:56.126423 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4182aa-40ff-476e-8719-fc2fbcd1c8de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:43:56.137342 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-fb4182aa-40ff-476e-8719-fc2fbcd1c8de None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 03:43:56.137342 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:56.137342 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:56.137342 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:56.137342 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:56.137342 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:56.137342 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:56.137342 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:56.137342 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:56.137342 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:56.137342 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:56.137342 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:56.137342 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:43:56.137342 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:43:56.137342 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:43:56.137342 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:43:56.138472 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:43:56.138472 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:43:56.138472 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:43:56.138472 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:43:56.138472 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:56.138472 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:56.138472 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:56.138472 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:56.138472 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:56.138472 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:56.138472 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:56.138472 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:56.138472 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:56.138472 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:56.138472 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:56.138472 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:56.139419 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:56.139419 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:56.139419 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:56.139419 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:56.139419 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:43:56.139419 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:43:56.139419 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:43:56.139419 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:43:56.139419 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:43:56.139419 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:43:56.139419 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 03:43:56.139419 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:56.147802 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 315/637] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Jul 1 03:43:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:56.148779 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4182aa-40ff-476e-8719-fc2fbcd1c8de None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:56.156588 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4642486-a81c-4835-8123-1067bcc621aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:56.157659 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4642486-a81c-4835-8123-1067bcc621aa None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:56.158148 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4642486-a81c-4835-8123-1067bcc621aa None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:56.158711 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4642486-a81c-4835-8123-1067bcc621aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:56.282306 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4182aa-40ff-476e-8719-fc2fbcd1c8de None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:56.284019 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4642486-a81c-4835-8123-1067bcc621aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:56.287102 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4642486-a81c-4835-8123-1067bcc621aa None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:56.328226 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab8b4c-38f5-44f2-8f0a-fda2ac444638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:56.329440 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab8b4c-38f5-44f2-8f0a-fda2ac444638 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:56.330254 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab8b4c-38f5-44f2-8f0a-fda2ac444638 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:56.330737 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab8b4c-38f5-44f2-8f0a-fda2ac444638 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:56.342471 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab8b4c-38f5-44f2-8f0a-fda2ac444638 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:56.345350 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab8b4c-38f5-44f2-8f0a-fda2ac444638 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:56.364891 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-39ab8b4c-38f5-44f2-8f0a-fda2ac444638 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 01 03:43:56.364891 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:56.364891 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:56.364891 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:56.364891 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:56.364891 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:56.364891 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:56.364891 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:56.364891 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:56.364891 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:56.364891 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:56.364891 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:56.364891 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 03:43:56.364891 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 03:43:56.364891 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 03:43:56.364891 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 03:43:56.365891 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:56.365891 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:56.365891 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 03:43:56.365891 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:43:56.365891 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 03:43:56.365891 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:43:56.365891 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:56.365891 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:56.365891 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:56.365891 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:56.365891 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:56.365891 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:56.365891 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:56.365891 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:56.365891 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:56.365891 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:56.365891 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:56.365891 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:56.366801 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:56.366801 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:56.366801 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 03:43:56.366801 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 03:43:56.366801 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 03:43:56.366801 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 03:43:56.366801 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 03:43:56.366801 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 03:43:56.366801 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 01 03:43:56.366801 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:56.374667 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 316/638] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:43:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:56.374667 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab8b4c-38f5-44f2-8f0a-fda2ac444638 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:56.411980 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:56.452825 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 323/639] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:43:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 03:43:56.454193 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4642486-a81c-4835-8123-1067bcc621aa None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:56.491872 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:56.569668 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab8b4c-38f5-44f2-8f0a-fda2ac444638 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:56.589556 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4642486-a81c-4835-8123-1067bcc621aa None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:56.629256 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224070bd-d3ff-429c-ba43-9dc891dd200a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:56.630896 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224070bd-d3ff-429c-ba43-9dc891dd200a None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:56.631380 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224070bd-d3ff-429c-ba43-9dc891dd200a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:56.632029 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224070bd-d3ff-429c-ba43-9dc891dd200a None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:56.633069 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224070bd-d3ff-429c-ba43-9dc891dd200a None admin] RBAC: Adding query filter params (name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:56.633421 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f02f1-a83b-4449-8267-2fdd46b256a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:56.633820 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224070bd-d3ff-429c-ba43-9dc891dd200a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:56.634110 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f02f1-a83b-4449-8267-2fdd46b256a4 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:56.634394 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f02f1-a83b-4449-8267-2fdd46b256a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:56.634668 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f02f1-a83b-4449-8267-2fdd46b256a4 None admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:56.635547 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f02f1-a83b-4449-8267-2fdd46b256a4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:56.635864 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f02f1-a83b-4449-8267-2fdd46b256a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:56.636549 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224070bd-d3ff-429c-ba43-9dc891dd200a None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:56.637285 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f02f1-a83b-4449-8267-2fdd46b256a4 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:56.647038 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 317/640] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Jul 1 03:43:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:56.648335 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224070bd-d3ff-429c-ba43-9dc891dd200a None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:56.665610 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 324/641] 10.222.0.46 () {56 vars in 1137 bytes} [Fri Jul 1 03:43:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:56.666779 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f02f1-a83b-4449-8267-2fdd46b256a4 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:56.703851 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:56.816827 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f02f1-a83b-4449-8267-2fdd46b256a4 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:56.817456 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224070bd-d3ff-429c-ba43-9dc891dd200a None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:56.840271 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:56.867745 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe82c0f-dfde-4076-8452-a05621f8b9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:56.868880 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe82c0f-dfde-4076-8452-a05621f8b9b8 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:56.869160 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe82c0f-dfde-4076-8452-a05621f8b9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:56.869522 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe82c0f-dfde-4076-8452-a05621f8b9b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:56.872061 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82830ed1-df17-432e-8da4-6e94161b19ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:56.873570 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82830ed1-df17-432e-8da4-6e94161b19ce None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:56.874072 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82830ed1-df17-432e-8da4-6e94161b19ce None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:56.874571 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82830ed1-df17-432e-8da4-6e94161b19ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:56.883177 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe82c0f-dfde-4076-8452-a05621f8b9b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:56.884694 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe82c0f-dfde-4076-8452-a05621f8b9b8 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:56.896662 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82830ed1-df17-432e-8da4-6e94161b19ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:56.899354 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82830ed1-df17-432e-8da4-6e94161b19ce None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:56.903802 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-0fe82c0f-dfde-4076-8452-a05621f8b9b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:56.903802 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:56.903802 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:56.903802 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:56.903802 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:56.903802 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:56.903802 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:56.903802 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:56.903802 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:56.903802 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:56.903802 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:56.903802 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:56.903802 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:43:56.903802 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:43:56.903802 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:43:56.904818 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:43:56.904818 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:56.904818 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:56.904818 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:56.904818 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:56.904818 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:56.904818 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:56.904818 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:56.904818 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:56.904818 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:56.904818 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:56.904818 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:56.904818 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:56.904818 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:56.904818 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:56.904818 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:56.904818 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:56.914100 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:43:56.914100 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:43:56.914100 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:56.914100 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:56.914100 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 325/642] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:43:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:56.914100 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe82c0f-dfde-4076-8452-a05621f8b9b8 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:56.931510 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-82830ed1-df17-432e-8da4-6e94161b19ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:56.931510 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:56.931510 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:56.931510 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:56.931510 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:56.931510 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:56.931510 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:56.931510 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:56.931510 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:56.931510 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:56.931510 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:56.931510 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:56.931510 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:43:56.931510 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:43:56.931510 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:43:56.933295 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:43:56.933295 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:56.933295 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:56.933295 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:56.933295 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:56.933295 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:56.933295 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:56.933295 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:56.933295 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:56.933295 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:56.933295 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:56.933295 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:56.933295 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:56.933295 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:56.933295 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:56.933295 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:56.933295 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:56.935309 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:43:56.935309 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:43:56.935309 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:56.935309 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:56.935309 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 318/643] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:43:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:56.935309 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25566853-4a0c-4314-a4a0-0e0cc8568efd None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:56.935309 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25566853-4a0c-4314-a4a0-0e0cc8568efd None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:56.935309 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25566853-4a0c-4314-a4a0-0e0cc8568efd None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:56.940226 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 319/644] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:43:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:43:56.941736 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25566853-4a0c-4314-a4a0-0e0cc8568efd None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:57.059146 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:57.086377 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe82c0f-dfde-4076-8452-a05621f8b9b8 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:57.108213 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25566853-4a0c-4314-a4a0-0e0cc8568efd None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:57.129121 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859e339-aac5-4a75-ae81-5d17ac3fae7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:57.132024 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859e339-aac5-4a75-ae81-5d17ac3fae7b None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:57.132024 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859e339-aac5-4a75-ae81-5d17ac3fae7b None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:57.132024 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859e339-aac5-4a75-ae81-5d17ac3fae7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:57.166792 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec25ac-6569-4856-a857-2193530b33e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:57.167475 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec25ac-6569-4856-a857-2193530b33e7 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:57.167780 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec25ac-6569-4856-a857-2193530b33e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:57.168064 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec25ac-6569-4856-a857-2193530b33e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:57.168797 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec25ac-6569-4856-a857-2193530b33e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:57.169108 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec25ac-6569-4856-a857-2193530b33e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:57.170510 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec25ac-6569-4856-a857-2193530b33e7 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:57.191485 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 320/645] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:43:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:57.191485 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d132a2f-09de-4b67-bea5-c0672589cf08 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:57.191485 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d132a2f-09de-4b67-bea5-c0672589cf08 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:57.191485 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d132a2f-09de-4b67-bea5-c0672589cf08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:57.210887 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-9d132a2f-09de-4b67-bea5-c0672589cf08 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:43:57.212244 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9d132a2f-09de-4b67-bea5-c0672589cf08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:43:57.234411 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:57.247611 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e859e339-aac5-4a75-ae81-5d17ac3fae7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:57.250227 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e859e339-aac5-4a75-ae81-5d17ac3fae7b None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:57.297146 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 321/646] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:43:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:43:57.298177 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d132a2f-09de-4b67-bea5-c0672589cf08 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:57.383179 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:57.407943 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 326/647] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:43:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 03:43:57.410016 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859e339-aac5-4a75-ae81-5d17ac3fae7b None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:57.445146 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d132a2f-09de-4b67-bea5-c0672589cf08 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:57.495157 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7c3e2-90d5-40bc-92e0-3b13770d0d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:57.495880 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7c3e2-90d5-40bc-92e0-3b13770d0d7b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:57.496451 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7c3e2-90d5-40bc-92e0-3b13770d0d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:57.496744 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7c3e2-90d5-40bc-92e0-3b13770d0d7b None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:57.497505 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c7c3e2-90d5-40bc-92e0-3b13770d0d7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:57.498279 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c7c3e2-90d5-40bc-92e0-3b13770d0d7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:57.499730 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c7c3e2-90d5-40bc-92e0-3b13770d0d7b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:57.519491 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 322/648] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:57.519491 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7c3e2-90d5-40bc-92e0-3b13770d0d7b None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:57.536178 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:57.588058 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859e339-aac5-4a75-ae81-5d17ac3fae7b None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:57.648477 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3cb22-a837-4f61-9818-f12ba6533f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:57.650123 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3cb22-a837-4f61-9818-f12ba6533f82 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:57.650457 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3cb22-a837-4f61-9818-f12ba6533f82 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:57.650943 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3cb22-a837-4f61-9818-f12ba6533f82 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:57.658301 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7c3e2-90d5-40bc-92e0-3b13770d0d7b None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:57.667877 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe3cb22-a837-4f61-9818-f12ba6533f82 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:57.671299 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe3cb22-a837-4f61-9818-f12ba6533f82 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:57.691553 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-dbe3cb22-a837-4f61-9818-f12ba6533f82 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 01 03:43:57.691553 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:57.691553 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:57.691553 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:57.691553 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:57.691553 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:57.691553 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:57.691553 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:57.691553 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:57.691553 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:57.691553 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:57.691553 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:57.691553 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 03:43:57.691553 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 03:43:57.691553 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 03:43:57.691553 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 03:43:57.692810 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:57.692810 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:57.692810 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 03:43:57.692810 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:43:57.692810 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 03:43:57.692810 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:43:57.692810 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:57.692810 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:57.692810 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:57.692810 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:57.692810 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:57.692810 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:57.692810 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:57.692810 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:57.692810 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:57.692810 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:57.692810 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:57.692810 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:57.694060 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:57.694060 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:57.694060 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 03:43:57.694060 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 03:43:57.694060 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 03:43:57.694060 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 03:43:57.694060 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 03:43:57.694060 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 03:43:57.694060 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 01 03:43:57.694060 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:57.694060 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 327/649] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Jul 1 03:43:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:57.694060 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3cb22-a837-4f61-9818-f12ba6533f82 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:57.703020 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35364647-f881-41b7-9ed4-181b9001ef86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:57.705027 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35364647-f881-41b7-9ed4-181b9001ef86 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:57.705027 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35364647-f881-41b7-9ed4-181b9001ef86 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:57.705027 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35364647-f881-41b7-9ed4-181b9001ef86 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:57.718095 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35364647-f881-41b7-9ed4-181b9001ef86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:43:57.726698 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-35364647-f881-41b7-9ed4-181b9001ef86 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 03:43:57.726698 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:57.726698 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:57.726698 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:57.726698 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:57.726698 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:57.726698 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:57.726698 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:57.726698 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:57.726698 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:57.726698 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:57.726698 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:57.726698 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:43:57.726698 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:43:57.726698 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:43:57.726698 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:43:57.728177 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:43:57.728177 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:43:57.728177 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:43:57.728177 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:43:57.728177 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:57.728177 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:57.728177 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:57.728177 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:57.728177 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:57.728177 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:57.728177 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:57.728177 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:57.728177 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:57.728177 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:57.728177 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:57.728177 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:57.729135 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:57.729135 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:57.729135 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:57.729135 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:57.729135 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:43:57.729135 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:43:57.729135 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:43:57.729135 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:43:57.729135 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:43:57.729135 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:43:57.729135 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 03:43:57.729135 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:57.729135 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 323/650] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Jul 1 03:43:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:57.729135 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35364647-f881-41b7-9ed4-181b9001ef86 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:57.782653 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:57.824942 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:57.862992 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35364647-f881-41b7-9ed4-181b9001ef86 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:57.889071 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3cb22-a837-4f61-9818-f12ba6533f82 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:57.904901 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7534b9-606f-4799-b8d9-2e59aa13d536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:57.906088 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7534b9-606f-4799-b8d9-2e59aa13d536 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:57.906546 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7534b9-606f-4799-b8d9-2e59aa13d536 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:57.907001 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7534b9-606f-4799-b8d9-2e59aa13d536 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:57.919019 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7534b9-606f-4799-b8d9-2e59aa13d536 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:57.921612 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7534b9-606f-4799-b8d9-2e59aa13d536 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:57.944408 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cd385-aedf-40ab-968d-dfca70e56faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:57.945647 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cd385-aedf-40ab-968d-dfca70e56faa None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:57.946045 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-de7534b9-606f-4799-b8d9-2e59aa13d536 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:43:57.946045 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:57.946045 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:57.946045 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:57.946045 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:57.946045 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:57.946045 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:57.946045 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:57.946045 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:57.946045 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:57.946045 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:57.946045 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:57.946045 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 03:43:57.946045 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 03:43:57.946045 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 03:43:57.947096 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 03:43:57.947096 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:57.947096 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:57.947096 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:57.947096 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:57.947096 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:57.947096 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:57.947096 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:57.947096 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:57.947096 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:57.947096 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:57.947096 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:57.947096 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:57.947096 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:57.947096 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:57.947096 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:57.947096 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:57.948376 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 03:43:57.948376 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 03:43:57.948376 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 03:43:57.948376 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 03:43:57.948376 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 03:43:57.948376 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 03:43:57.948376 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:43:57.948376 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:57.948884 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cd385-aedf-40ab-968d-dfca70e56faa None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:57.948884 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cd385-aedf-40ab-968d-dfca70e56faa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:57.949010 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 324/651] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:43:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:57.949911 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7534b9-606f-4799-b8d9-2e59aa13d536 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:57.962661 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9cd385-aedf-40ab-968d-dfca70e56faa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:57.964244 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9cd385-aedf-40ab-968d-dfca70e56faa None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:57.986191 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-ec9cd385-aedf-40ab-968d-dfca70e56faa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:57.986191 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:57.986191 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:57.986191 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:57.986191 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:57.986191 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:57.986191 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:57.986191 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:57.986191 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:57.986191 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:57.986191 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:57.986191 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:57.986191 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:43:57.986191 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:43:57.986191 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:43:57.987407 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:43:57.987407 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:57.987407 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:57.987407 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:57.987407 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:57.987407 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:57.987407 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:57.987407 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:57.987407 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:57.987407 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:57.987407 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:57.987407 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:57.987407 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:57.987407 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:57.987407 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:57.987407 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:57.987407 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:57.989258 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:43:57.989258 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:43:57.989258 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:57.989258 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:57.989258 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 328/652] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:43:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:57.989258 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cd385-aedf-40ab-968d-dfca70e56faa None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:58.074417 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7534b9-606f-4799-b8d9-2e59aa13d536 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:58.098653 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:58.106322 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cd385-aedf-40ab-968d-dfca70e56faa None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:58.118619 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba005f8-f711-470d-a4e3-8e666d4e642f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:58.119676 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba005f8-f711-470d-a4e3-8e666d4e642f None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:58.120155 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba005f8-f711-470d-a4e3-8e666d4e642f None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:58.120542 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba005f8-f711-470d-a4e3-8e666d4e642f None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:58.121455 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba005f8-f711-470d-a4e3-8e666d4e642f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:58.121817 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba005f8-f711-470d-a4e3-8e666d4e642f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:58.123621 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba005f8-f711-470d-a4e3-8e666d4e642f None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:58.125773 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:58.149515 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca5950-211c-4877-8ce3-52b17b89a0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:58.150205 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca5950-211c-4877-8ce3-52b17b89a0ae None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:58.151323 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca5950-211c-4877-8ce3-52b17b89a0ae None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:58.151323 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca5950-211c-4877-8ce3-52b17b89a0ae None admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:58.151712 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dca5950-211c-4877-8ce3-52b17b89a0ae None admin] RBAC: Adding query filter params (name=service) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:58.151866 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dca5950-211c-4877-8ce3-52b17b89a0ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:58.152716 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 325/653] 10.222.0.46 () {56 vars in 1139 bytes} [Fri Jul 1 03:43:57 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:58.153347 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dca5950-211c-4877-8ce3-52b17b89a0ae None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:58.154693 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b12e1b-9e31-4aad-8487-74b7155a1a64 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:58.164347 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b12e1b-9e31-4aad-8487-74b7155a1a64 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:58.164347 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b12e1b-9e31-4aad-8487-74b7155a1a64 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:58.164347 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 326/654] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:43:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:43:58.164347 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b12e1b-9e31-4aad-8487-74b7155a1a64 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:58.164792 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 329/655] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Jul 1 03:43:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:58.164792 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca5950-211c-4877-8ce3-52b17b89a0ae None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:58.280840 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b12e1b-9e31-4aad-8487-74b7155a1a64 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:58.288204 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca5950-211c-4877-8ce3-52b17b89a0ae None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:58.320220 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c15dfbc-81af-461a-a3d1-0b9c9f534d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:58.320890 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15dfbc-81af-461a-a3d1-0b9c9f534d0f None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:58.321170 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15dfbc-81af-461a-a3d1-0b9c9f534d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:58.321441 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15dfbc-81af-461a-a3d1-0b9c9f534d0f None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:58.322327 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c15dfbc-81af-461a-a3d1-0b9c9f534d0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:58.322711 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c15dfbc-81af-461a-a3d1-0b9c9f534d0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:58.324353 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c15dfbc-81af-461a-a3d1-0b9c9f534d0f None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:58.332687 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3bc63-0173-4ddf-b77c-7d500d1a7641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:58.333830 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3bc63-0173-4ddf-b77c-7d500d1a7641 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:58.334325 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3bc63-0173-4ddf-b77c-7d500d1a7641 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:58.334878 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3bc63-0173-4ddf-b77c-7d500d1a7641 None admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:58.336299 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3bc63-0173-4ddf-b77c-7d500d1a7641 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:58.336856 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3bc63-0173-4ddf-b77c-7d500d1a7641 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:58.339061 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 327/656] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 1 03:43:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:58.339483 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3bc63-0173-4ddf-b77c-7d500d1a7641 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:58.340248 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c15dfbc-81af-461a-a3d1-0b9c9f534d0f None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:58.358080 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 330/657] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:43:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:58.359369 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc692cba-7dd3-4a32-836b-b5642da63112 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:58.359704 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc692cba-7dd3-4a32-836b-b5642da63112 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:58.360030 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc692cba-7dd3-4a32-836b-b5642da63112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:58.381025 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-bc692cba-7dd3-4a32-836b-b5642da63112 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:43:58.382718 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-bc692cba-7dd3-4a32-836b-b5642da63112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:43:58.396056 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:58.403975 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:58.458044 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c15dfbc-81af-461a-a3d1-0b9c9f534d0f None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:58.468660 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 331/658] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:43:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:43:58.469814 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc692cba-7dd3-4a32-836b-b5642da63112 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:58.508102 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3557d-bc2a-4532-b291-799da0a73040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:58.509122 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3557d-bc2a-4532-b291-799da0a73040 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:58.509551 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3557d-bc2a-4532-b291-799da0a73040 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:58.509999 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3557d-bc2a-4532-b291-799da0a73040 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:58.594993 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3557d-bc2a-4532-b291-799da0a73040 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:58.596899 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3557d-bc2a-4532-b291-799da0a73040 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:58.600532 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc692cba-7dd3-4a32-836b-b5642da63112 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:58.642258 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aeb70a-66d0-49e0-bf7f-afd7656e18ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:58.643056 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aeb70a-66d0-49e0-bf7f-afd7656e18ea None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:58.643389 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aeb70a-66d0-49e0-bf7f-afd7656e18ea None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:58.643699 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aeb70a-66d0-49e0-bf7f-afd7656e18ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:58.654844 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aeb70a-66d0-49e0-bf7f-afd7656e18ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:58.656356 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aeb70a-66d0-49e0-bf7f-afd7656e18ea None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:58.660645 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:58.664260 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:58.678210 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-a5aeb70a-66d0-49e0-bf7f-afd7656e18ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:58.678210 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:58.678210 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:58.678210 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:58.678210 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:58.678210 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:58.678210 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:58.678210 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:58.678210 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:58.678210 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:58.678210 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:58.678210 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:58.678210 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:43:58.678210 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:43:58.678210 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:43:58.679946 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:43:58.679946 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:58.679946 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:58.679946 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:58.679946 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:58.679946 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:58.679946 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:58.679946 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:58.679946 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:58.679946 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:58.679946 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:58.679946 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:58.679946 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:58.679946 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:58.679946 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:58.679946 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:58.679946 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:58.681654 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:43:58.681654 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:43:58.681654 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:58.681654 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:58.681654 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 332/659] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:43:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:58.681654 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aeb70a-66d0-49e0-bf7f-afd7656e18ea None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:58.743111 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 328/660] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:43:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 03:43:58.743931 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3557d-bc2a-4532-b291-799da0a73040 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:58.794745 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aeb70a-66d0-49e0-bf7f-afd7656e18ea None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:58.837955 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a43590-645b-4249-8426-1961857e4545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:58.839111 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a43590-645b-4249-8426-1961857e4545 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:58.839666 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a43590-645b-4249-8426-1961857e4545 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:58.840066 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a43590-645b-4249-8426-1961857e4545 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:58.841695 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a43590-645b-4249-8426-1961857e4545 None admin] RBAC: Adding query filter params (role.id=66426d7dd6f64f6ebfcb1cbb8188b0d2, scope.project.id=da83db15a312499fb627691ae442f233, user.id=2da466ad31d344898f5c838f77d45181) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:58.842246 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a43590-645b-4249-8426-1961857e4545 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:58.844995 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a43590-645b-4249-8426-1961857e4545 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:58.856781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 333/661] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:43:58 2022] GET /identity/v3/role_assignments?user.id=2da466ad31d344898f5c838f77d45181&scope.project.id=da83db15a312499fb627691ae442f233&role.id=66426d7dd6f64f6ebfcb1cbb8188b0d2 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:58.858138 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a43590-645b-4249-8426-1961857e4545 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:58.872439 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3557d-bc2a-4532-b291-799da0a73040 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:58.927487 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cfcd0a-d666-4967-8fe1-f3f43a71e230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:58.928359 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfcd0a-d666-4967-8fe1-f3f43a71e230 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:58.928699 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfcd0a-d666-4967-8fe1-f3f43a71e230 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:58.930833 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfcd0a-d666-4967-8fe1-f3f43a71e230 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:58.939243 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cfcd0a-d666-4967-8fe1-f3f43a71e230 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:58.940855 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cfcd0a-d666-4967-8fe1-f3f43a71e230 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:58.956520 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-30cfcd0a-d666-4967-8fe1-f3f43a71e230 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:43:58.956520 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:58.956520 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:58.956520 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:58.956520 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:58.956520 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:58.956520 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:58.956520 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:58.956520 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:58.956520 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:58.956520 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:58.956520 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:58.956520 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 03:43:58.956520 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 03:43:58.956520 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 03:43:58.958452 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 03:43:58.958452 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:58.958452 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:58.958452 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:58.958452 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:58.958452 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:58.958452 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:58.958452 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:58.958452 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:58.958452 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:58.958452 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:58.958452 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:58.958452 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:58.958452 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:58.958452 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:58.958452 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:58.958452 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:58.960677 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 03:43:58.960677 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 03:43:58.960677 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 03:43:58.960677 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 03:43:58.960677 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 03:43:58.960677 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 03:43:58.960677 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:43:58.960677 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:58.960677 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 329/662] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:43:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:58.960677 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cfcd0a-d666-4967-8fe1-f3f43a71e230 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:58.978329 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:58.980388 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:59.040815 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a43590-645b-4249-8426-1961857e4545 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:59.095417 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607bec2-bf57-420f-805a-37b17cd9cbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:59.096265 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607bec2-bf57-420f-805a-37b17cd9cbb1 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:59.097175 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607bec2-bf57-420f-805a-37b17cd9cbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:59.097574 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607bec2-bf57-420f-805a-37b17cd9cbb1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:59.117767 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3607bec2-bf57-420f-805a-37b17cd9cbb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:43:59.124125 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cfcd0a-d666-4967-8fe1-f3f43a71e230 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:59.130623 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-3607bec2-bf57-420f-805a-37b17cd9cbb1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 03:43:59.130623 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:59.130623 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:59.130623 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:59.130623 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:59.130623 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:59.130623 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:59.130623 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:59.130623 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:59.130623 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:59.130623 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:59.130623 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:59.130623 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:43:59.130623 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:43:59.130623 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:43:59.130623 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:43:59.131690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:43:59.131690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:43:59.131690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:43:59.131690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:43:59.131690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:59.131690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:59.131690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:59.131690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:59.131690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:59.131690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:59.131690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:59.131690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:59.131690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:59.131690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:59.131690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:59.131690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:59.132604 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:59.132604 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:59.132604 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:59.132604 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:59.132604 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:43:59.132604 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:43:59.132604 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:43:59.132604 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:43:59.132604 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:43:59.132604 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:43:59.132604 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 03:43:59.132604 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:59.133267 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 334/663] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Jul 1 03:43:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:59.134595 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607bec2-bf57-420f-805a-37b17cd9cbb1 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:59.189373 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aeb23e-235a-4c95-a6a0-70fd354d3796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:59.190576 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aeb23e-235a-4c95-a6a0-70fd354d3796 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:59.191067 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aeb23e-235a-4c95-a6a0-70fd354d3796 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:59.191600 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aeb23e-235a-4c95-a6a0-70fd354d3796 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:59.192975 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aeb23e-235a-4c95-a6a0-70fd354d3796 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:59.193539 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aeb23e-235a-4c95-a6a0-70fd354d3796 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:59.196228 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aeb23e-235a-4c95-a6a0-70fd354d3796 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:59.219324 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 330/664] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:43:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:59.220611 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aeb23e-235a-4c95-a6a0-70fd354d3796 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:59.323659 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:59.326693 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607bec2-bf57-420f-805a-37b17cd9cbb1 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:59.360939 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aeb23e-235a-4c95-a6a0-70fd354d3796 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:59.372060 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:59.387877 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb365f7b-0fb7-4da0-bc03-e0b559b36bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:59.388693 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb365f7b-0fb7-4da0-bc03-e0b559b36bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:59.388979 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb365f7b-0fb7-4da0-bc03-e0b559b36bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:59.389258 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb365f7b-0fb7-4da0-bc03-e0b559b36bb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:59.401144 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb365f7b-0fb7-4da0-bc03-e0b559b36bb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:59.402649 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb365f7b-0fb7-4da0-bc03-e0b559b36bb4 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:59.413111 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3cc6be-6b15-4dd2-be35-ee9af0778ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:59.413880 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3cc6be-6b15-4dd2-be35-ee9af0778ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:59.414157 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3cc6be-6b15-4dd2-be35-ee9af0778ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:59.414433 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3cc6be-6b15-4dd2-be35-ee9af0778ec8 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:59.415219 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3cc6be-6b15-4dd2-be35-ee9af0778ec8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:59.415557 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3cc6be-6b15-4dd2-be35-ee9af0778ec8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:59.416996 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3cc6be-6b15-4dd2-be35-ee9af0778ec8 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:59.422888 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-eb365f7b-0fb7-4da0-bc03-e0b559b36bb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:59.422888 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:59.422888 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:59.422888 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:59.422888 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:59.422888 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:59.422888 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:59.422888 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:59.422888 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:59.422888 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:59.422888 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:59.422888 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:59.422888 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:43:59.422888 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:43:59.422888 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:43:59.424907 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:43:59.424907 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:59.424907 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:59.424907 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:59.424907 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:59.424907 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:59.424907 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:59.424907 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:59.424907 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:59.424907 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:59.424907 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:59.424907 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:59.424907 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:59.424907 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:59.424907 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:59.424907 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:59.424907 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:59.426642 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:43:59.426642 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:43:59.426642 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:43:59.426642 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:43:59.428997 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 335/665] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:43:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:59.429839 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb365f7b-0fb7-4da0-bc03-e0b559b36bb4 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:59.443872 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 331/666] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 1 03:43:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:59.445179 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3cc6be-6b15-4dd2-be35-ee9af0778ec8 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:59.584748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3cc6be-6b15-4dd2-be35-ee9af0778ec8 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:59.593023 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb365f7b-0fb7-4da0-bc03-e0b559b36bb4 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:59.630466 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:59.635250 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe3611-3d33-4a24-a416-5ec0bfa6e885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:59.635973 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe3611-3d33-4a24-a416-5ec0bfa6e885 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:59.636247 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe3611-3d33-4a24-a416-5ec0bfa6e885 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:59.636525 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe3611-3d33-4a24-a416-5ec0bfa6e885 None admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:59.637354 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe3611-3d33-4a24-a416-5ec0bfa6e885 None admin] RBAC: Adding query filter params (name=service) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:59.637626 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe3611-3d33-4a24-a416-5ec0bfa6e885 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:59.638984 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe3611-3d33-4a24-a416-5ec0bfa6e885 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:59.639546 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e798c-4a78-4f32-9862-36ba6d0bae89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:59.641318 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e798c-4a78-4f32-9862-36ba6d0bae89 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:59.646687 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e798c-4a78-4f32-9862-36ba6d0bae89 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:59.646687 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e798c-4a78-4f32-9862-36ba6d0bae89 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:59.657093 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 336/667] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Jul 1 03:43:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:59.657093 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe3611-3d33-4a24-a416-5ec0bfa6e885 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:59.658196 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6e798c-4a78-4f32-9862-36ba6d0bae89 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:59.659792 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6e798c-4a78-4f32-9862-36ba6d0bae89 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:59.676944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-8f6e798c-4a78-4f32-9862-36ba6d0bae89 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 01 03:43:59.676944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:43:59.676944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:43:59.676944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:43:59.676944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:43:59.676944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:43:59.676944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:43:59.676944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:43:59.676944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:43:59.676944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:43:59.676944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:43:59.676944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:43:59.676944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 03:43:59.676944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 03:43:59.676944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 03:43:59.676944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 03:43:59.678826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:43:59.678826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:43:59.678826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 03:43:59.678826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:43:59.678826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 03:43:59.678826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:43:59.678826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:43:59.678826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:43:59.678826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:43:59.678826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:43:59.678826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:43:59.678826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:43:59.678826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:43:59.678826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:43:59.678826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:43:59.678826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:43:59.678826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:43:59.678826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:43:59.680686 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:43:59.680686 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:43:59.680686 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 03:43:59.680686 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 03:43:59.680686 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 03:43:59.680686 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 03:43:59.680686 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 03:43:59.680686 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 03:43:59.680686 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 01 03:43:59.680686 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:43:59.683949 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 332/668] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:43:59 2022] GET /identity/v3/users/glance => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:43:59.685611 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e798c-4a78-4f32-9862-36ba6d0bae89 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:59.708993 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:43:59.809869 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe3611-3d33-4a24-a416-5ec0bfa6e885 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:59.833999 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e798c-4a78-4f32-9862-36ba6d0bae89 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:43:59.869356 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f300218-4424-48c7-95f6-7fadf91bb524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:59.870310 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f300218-4424-48c7-95f6-7fadf91bb524 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:59.870740 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f300218-4424-48c7-95f6-7fadf91bb524 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:59.871195 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f300218-4424-48c7-95f6-7fadf91bb524 None admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:59.872258 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f300218-4424-48c7-95f6-7fadf91bb524 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:59.872762 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f300218-4424-48c7-95f6-7fadf91bb524 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:59.875110 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f300218-4424-48c7-95f6-7fadf91bb524 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:59.888522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70239776-a43a-4d2a-a196-bc1f93e1c656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:43:59.889558 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70239776-a43a-4d2a-a196-bc1f93e1c656 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:43:59.890069 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70239776-a43a-4d2a-a196-bc1f93e1c656 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:43:59.890446 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70239776-a43a-4d2a-a196-bc1f93e1c656 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:43:59.891570 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70239776-a43a-4d2a-a196-bc1f93e1c656 None admin] RBAC: Adding query filter params (role.id=66426d7dd6f64f6ebfcb1cbb8188b0d2, scope.project.id=da83db15a312499fb627691ae442f233, user.id=418106a8c3104dcfa40fcc6c68356294) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:43:59.892079 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70239776-a43a-4d2a-a196-bc1f93e1c656 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:43:59.894527 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70239776-a43a-4d2a-a196-bc1f93e1c656 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:43:59.900762 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 337/669] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:43:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:59.900762 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f300218-4424-48c7-95f6-7fadf91bb524 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:59.915709 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 333/670] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:43:59 2022] GET /identity/v3/role_assignments?user.id=418106a8c3104dcfa40fcc6c68356294&scope.project.id=da83db15a312499fb627691ae442f233&role.id=66426d7dd6f64f6ebfcb1cbb8188b0d2 => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:43:59.915709 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70239776-a43a-4d2a-a196-bc1f93e1c656 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:43:59.986563 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:00.054469 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70239776-a43a-4d2a-a196-bc1f93e1c656 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:00.079861 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:00.089017 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f300218-4424-48c7-95f6-7fadf91bb524 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:00.104209 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f4743-7c16-473b-8151-487b3cbb57e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:00.104912 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f4743-7c16-473b-8151-487b3cbb57e5 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:00.105204 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f4743-7c16-473b-8151-487b3cbb57e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:00.105762 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f4743-7c16-473b-8151-487b3cbb57e5 None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:00.107323 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f4743-7c16-473b-8151-487b3cbb57e5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:00.107812 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f4743-7c16-473b-8151-487b3cbb57e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:00.110295 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f4743-7c16-473b-8151-487b3cbb57e5 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:00.136455 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 334/671] 10.222.0.46 () {56 vars in 1137 bytes} [Fri Jul 1 03:43:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:00.137330 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f4743-7c16-473b-8151-487b3cbb57e5 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:00.148310 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7737398c-97fc-4499-bdf6-550b77ee1acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:00.149234 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7737398c-97fc-4499-bdf6-550b77ee1acc None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:00.149583 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7737398c-97fc-4499-bdf6-550b77ee1acc None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:00.149945 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7737398c-97fc-4499-bdf6-550b77ee1acc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:00.163903 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7737398c-97fc-4499-bdf6-550b77ee1acc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:00.165450 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7737398c-97fc-4499-bdf6-550b77ee1acc None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:00.193862 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-7737398c-97fc-4499-bdf6-550b77ee1acc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:00.193862 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:00.193862 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:00.193862 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:00.193862 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:00.193862 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:00.193862 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:00.193862 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:00.193862 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:00.193862 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:00.193862 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:00.193862 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:00.193862 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:44:00.193862 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:44:00.193862 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:44:00.194916 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:44:00.194916 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:00.194916 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:00.194916 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:00.194916 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:00.194916 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:00.194916 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:00.194916 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:00.194916 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:00.194916 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:00.194916 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:00.194916 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:00.194916 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:00.194916 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:00.194916 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:00.194916 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:00.194916 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:00.196098 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:44:00.196098 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:44:00.196098 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:00.196098 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:00.196098 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 338/672] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:43:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:00.196498 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7737398c-97fc-4499-bdf6-550b77ee1acc None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:00.300479 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f4743-7c16-473b-8151-487b3cbb57e5 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:00.328563 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:00.341910 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7737398c-97fc-4499-bdf6-550b77ee1acc None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:00.366905 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c821c1-3b6e-480d-98b6-5341129c7053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:00.368903 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c821c1-3b6e-480d-98b6-5341129c7053 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:00.369729 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c821c1-3b6e-480d-98b6-5341129c7053 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:00.370358 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c821c1-3b6e-480d-98b6-5341129c7053 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:00.385269 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61392b-5ab3-4b40-aa42-be38b6b726ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:00.385838 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c821c1-3b6e-480d-98b6-5341129c7053 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:00.386043 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61392b-5ab3-4b40-aa42-be38b6b726ca None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:00.386297 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61392b-5ab3-4b40-aa42-be38b6b726ca None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:00.386605 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61392b-5ab3-4b40-aa42-be38b6b726ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:00.390020 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c821c1-3b6e-480d-98b6-5341129c7053 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:00.410710 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:00.419318 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-a4c821c1-3b6e-480d-98b6-5341129c7053 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:44:00.419318 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:00.419318 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:00.419318 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:00.419318 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:00.419318 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:00.419318 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:00.419318 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:00.419318 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:00.419318 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:00.419318 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:00.419318 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:00.419318 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 03:44:00.419318 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 03:44:00.419318 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 03:44:00.422818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 03:44:00.422818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:00.422818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:00.422818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:00.422818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:00.422818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:00.422818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:00.422818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:00.422818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:00.422818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:00.422818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:00.422818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:00.422818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:00.422818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:00.422818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:00.422818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:00.422818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:00.423737 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 03:44:00.423737 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 03:44:00.423737 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 03:44:00.423737 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 03:44:00.423737 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 03:44:00.423737 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 03:44:00.423737 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:44:00.423737 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:00.423737 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 335/673] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:44:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:00.424222 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c821c1-3b6e-480d-98b6-5341129c7053 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:00.484979 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f61392b-5ab3-4b40-aa42-be38b6b726ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:00.486583 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f61392b-5ab3-4b40-aa42-be38b6b726ca None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:00.568304 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c821c1-3b6e-480d-98b6-5341129c7053 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:00.617388 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6275bb2-550a-4464-a459-31e2360112b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:00.618508 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6275bb2-550a-4464-a459-31e2360112b2 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:00.618975 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6275bb2-550a-4464-a459-31e2360112b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:00.619441 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6275bb2-550a-4464-a459-31e2360112b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:00.620434 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6275bb2-550a-4464-a459-31e2360112b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:00.620942 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6275bb2-550a-4464-a459-31e2360112b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:00.622543 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6275bb2-550a-4464-a459-31e2360112b2 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:00.623799 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 339/674] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:44:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 03:44:00.625466 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61392b-5ab3-4b40-aa42-be38b6b726ca None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:00.638146 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 336/675] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:44:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:00.639329 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6275bb2-550a-4464-a459-31e2360112b2 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:00.680684 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:00.692296 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:00.754013 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61392b-5ab3-4b40-aa42-be38b6b726ca None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:00.758472 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6275bb2-550a-4464-a459-31e2360112b2 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:00.796561 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cac484-1608-47de-9433-cdf154d6de14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:00.797652 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cac484-1608-47de-9433-cdf154d6de14 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:00.798186 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cac484-1608-47de-9433-cdf154d6de14 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:00.798614 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cac484-1608-47de-9433-cdf154d6de14 None admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:00.799152 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852c087-8404-4d75-a032-170f204ed4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:00.800322 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cac484-1608-47de-9433-cdf154d6de14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:00.800640 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852c087-8404-4d75-a032-170f204ed4a2 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:00.800966 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cac484-1608-47de-9433-cdf154d6de14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:00.801088 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852c087-8404-4d75-a032-170f204ed4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:00.801371 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852c087-8404-4d75-a032-170f204ed4a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:00.802879 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cac484-1608-47de-9433-cdf154d6de14 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:00.813498 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0852c087-8404-4d75-a032-170f204ed4a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:00.815690 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0852c087-8404-4d75-a032-170f204ed4a2 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:00.822542 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 340/676] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 1 03:44:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:00.824271 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cac484-1608-47de-9433-cdf154d6de14 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:00.836298 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-0852c087-8404-4d75-a032-170f204ed4a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:00.836298 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:00.836298 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:00.836298 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:00.836298 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:00.836298 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:00.836298 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:00.836298 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:00.836298 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:00.836298 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:00.836298 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:00.836298 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:00.836298 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:44:00.836298 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:44:00.836298 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:44:00.837477 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:44:00.837477 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:00.837477 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:00.837477 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:00.837477 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:00.837477 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:00.837477 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:00.837477 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:00.837477 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:00.837477 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:00.837477 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:00.837477 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:00.837477 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:00.837477 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:00.837477 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:00.837477 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:00.837477 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:00.838608 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:44:00.838608 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:44:00.838608 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:00.838608 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:00.840274 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 337/677] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:44:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:00.840861 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852c087-8404-4d75-a032-170f204ed4a2 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:00.938474 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:00.947768 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cac484-1608-47de-9433-cdf154d6de14 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:00.956135 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852c087-8404-4d75-a032-170f204ed4a2 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:00.958495 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:00.989103 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b2d87-0e1f-4489-bc6f-431ecd2e3167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:00.989940 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b2d87-0e1f-4489-bc6f-431ecd2e3167 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:00.990375 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b2d87-0e1f-4489-bc6f-431ecd2e3167 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:00.990601 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b2d87-0e1f-4489-bc6f-431ecd2e3167 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:00.996519 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185b576-3167-4858-9354-80ee593ed68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:00.997470 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185b576-3167-4858-9354-80ee593ed68b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:00.997951 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185b576-3167-4858-9354-80ee593ed68b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:00.998427 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185b576-3167-4858-9354-80ee593ed68b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:00.999474 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2185b576-3167-4858-9354-80ee593ed68b None admin] RBAC: Adding query filter params (role.id=66426d7dd6f64f6ebfcb1cbb8188b0d2, scope.project.id=da83db15a312499fb627691ae442f233, user.id=93929b81a23c482ca7ce47e7a94682e4) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:00.999587 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b2d87-0e1f-4489-bc6f-431ecd2e3167 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:01.000256 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2185b576-3167-4858-9354-80ee593ed68b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:01.001098 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b2d87-0e1f-4489-bc6f-431ecd2e3167 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:01.003131 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2185b576-3167-4858-9354-80ee593ed68b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:01.010410 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 338/678] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:44:00 2022] GET /identity/v3/role_assignments?user.id=93929b81a23c482ca7ce47e7a94682e4&scope.project.id=da83db15a312499fb627691ae442f233&role.id=66426d7dd6f64f6ebfcb1cbb8188b0d2 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:01.011545 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185b576-3167-4858-9354-80ee593ed68b None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:01.031289 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-205b2d87-0e1f-4489-bc6f-431ecd2e3167 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 01 03:44:01.031289 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:01.031289 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:01.031289 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:01.031289 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:01.031289 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:01.031289 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:01.031289 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:01.031289 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:01.031289 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:01.031289 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:01.031289 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:01.031289 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 03:44:01.031289 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 03:44:01.031289 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 03:44:01.031289 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 03:44:01.033108 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:01.033108 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:01.033108 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 03:44:01.033108 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:44:01.033108 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 03:44:01.033108 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:44:01.033108 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:01.033108 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:01.033108 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:01.033108 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:01.033108 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:01.033108 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:01.033108 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:01.033108 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:01.033108 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:01.033108 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:01.033108 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:01.033108 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:01.036584 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:01.036584 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:01.036584 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 03:44:01.036584 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 03:44:01.036584 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 03:44:01.036584 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 03:44:01.036584 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 03:44:01.036584 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 03:44:01.036584 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 01 03:44:01.036584 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:01.041465 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 341/679] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 1 03:44:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:01.047502 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b2d87-0e1f-4489-bc6f-431ecd2e3167 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:01.253691 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185b576-3167-4858-9354-80ee593ed68b None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:01.296803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b2d87-0e1f-4489-bc6f-431ecd2e3167 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:01.298523 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daaa401-c677-468a-beb7-26ab7fc8fc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:01.299222 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daaa401-c677-468a-beb7-26ab7fc8fc90 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:01.300101 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daaa401-c677-468a-beb7-26ab7fc8fc90 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:01.300385 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daaa401-c677-468a-beb7-26ab7fc8fc90 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:01.301150 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daaa401-c677-468a-beb7-26ab7fc8fc90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:01.301457 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daaa401-c677-468a-beb7-26ab7fc8fc90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:01.302890 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daaa401-c677-468a-beb7-26ab7fc8fc90 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:01.317232 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 339/680] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:44:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:01.318735 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153c97a-e0b9-4315-95c9-bc30bec6a15a None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:01.319037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153c97a-e0b9-4315-95c9-bc30bec6a15a None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:01.319302 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153c97a-e0b9-4315-95c9-bc30bec6a15a None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:01.321243 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 340/681] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:44:01.322047 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153c97a-e0b9-4315-95c9-bc30bec6a15a None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:01.342836 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:01.359173 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14019a7-ed71-4972-9e48-0c8cfbdfedbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:01.360242 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14019a7-ed71-4972-9e48-0c8cfbdfedbd None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:01.360529 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14019a7-ed71-4972-9e48-0c8cfbdfedbd None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:01.360912 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14019a7-ed71-4972-9e48-0c8cfbdfedbd None admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:01.362868 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14019a7-ed71-4972-9e48-0c8cfbdfedbd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:01.363944 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14019a7-ed71-4972-9e48-0c8cfbdfedbd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:01.366227 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14019a7-ed71-4972-9e48-0c8cfbdfedbd None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:01.396397 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 342/682] 10.222.0.46 () {56 vars in 1135 bytes} [Fri Jul 1 03:44:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:44:01.399190 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65514677-d8c3-4d58-85d9-aad740f6f1ec None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:01.399510 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65514677-d8c3-4d58-85d9-aad740f6f1ec None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:01.399798 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65514677-d8c3-4d58-85d9-aad740f6f1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:01.424181 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-65514677-d8c3-4d58-85d9-aad740f6f1ec None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:44:01.426874 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-65514677-d8c3-4d58-85d9-aad740f6f1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:44:01.461060 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:01.547704 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153c97a-e0b9-4315-95c9-bc30bec6a15a None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:01.558856 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 343/683] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:44:01.560395 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65514677-d8c3-4d58-85d9-aad740f6f1ec None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:01.645541 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ee6d7-e517-48de-8395-d834f8e5268f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:01.646761 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ee6d7-e517-48de-8395-d834f8e5268f None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:01.647267 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ee6d7-e517-48de-8395-d834f8e5268f None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:01.647783 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ee6d7-e517-48de-8395-d834f8e5268f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:01.661364 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ee6d7-e517-48de-8395-d834f8e5268f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:01.664425 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ee6d7-e517-48de-8395-d834f8e5268f None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:01.691490 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-065ee6d7-e517-48de-8395-d834f8e5268f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:44:01.691490 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:01.691490 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:01.691490 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:01.691490 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:01.691490 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:01.691490 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:01.691490 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:01.691490 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:01.691490 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:01.691490 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:01.691490 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:01.691490 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 03:44:01.691490 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 03:44:01.691490 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 03:44:01.692442 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 03:44:01.692442 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:01.692442 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:01.692442 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:01.692442 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:01.692442 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:01.692442 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:01.692442 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:01.692442 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:01.692442 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:01.692442 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:01.692442 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:01.692442 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:01.692442 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:01.692442 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:01.692442 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:01.692442 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:01.693325 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 03:44:01.693325 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 03:44:01.693325 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 03:44:01.693325 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 03:44:01.693325 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 03:44:01.693325 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 03:44:01.693325 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:44:01.693325 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:01.700020 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 341/684] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:44:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:01.701367 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ee6d7-e517-48de-8395-d834f8e5268f None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:01.743110 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65514677-d8c3-4d58-85d9-aad740f6f1ec None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:01.819420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723927c3-a0ed-4e55-9697-dfbfabb89c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:01.820703 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723927c3-a0ed-4e55-9697-dfbfabb89c62 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:01.821219 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723927c3-a0ed-4e55-9697-dfbfabb89c62 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:01.821733 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723927c3-a0ed-4e55-9697-dfbfabb89c62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:01.851611 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:01.876289 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:01.928292 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ee6d7-e517-48de-8395-d834f8e5268f None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:01.969590 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723927c3-a0ed-4e55-9697-dfbfabb89c62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:01.972190 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723927c3-a0ed-4e55-9697-dfbfabb89c62 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:01.999335 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf2e37-e6c0-4440-9a74-f887b809b9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:02.000969 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf2e37-e6c0-4440-9a74-f887b809b9b1 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:02.001595 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf2e37-e6c0-4440-9a74-f887b809b9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:02.002225 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf2e37-e6c0-4440-9a74-f887b809b9b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:02.022366 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf2e37-e6c0-4440-9a74-f887b809b9b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:44:02.037348 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-b3bf2e37-e6c0-4440-9a74-f887b809b9b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:44:02.037348 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:02.037348 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:02.037348 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:02.037348 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:02.037348 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:02.037348 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:02.037348 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:02.037348 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:02.037348 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:02.037348 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:02.037348 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:02.037348 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:44:02.037348 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:44:02.037348 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:44:02.037348 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:44:02.039490 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:44:02.039490 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:44:02.039490 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:44:02.039490 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:44:02.039490 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:02.039490 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:02.039490 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:02.039490 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:02.039490 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:02.039490 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:02.039490 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:02.039490 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:02.039490 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:02.039490 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:02.039490 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:02.039490 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:02.041290 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:02.041290 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:02.041290 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:02.041290 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:02.041290 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:44:02.041290 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:44:02.041290 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:44:02.041290 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:44:02.041290 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:44:02.041290 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:44:02.041290 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:44:02.041290 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:02.047996 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 342/685] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 1 03:44:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:02.049599 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf2e37-e6c0-4440-9a74-f887b809b9b1 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:02.196178 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 344/686] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:44:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 03:44:02.197765 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723927c3-a0ed-4e55-9697-dfbfabb89c62 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:02.253383 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf2e37-e6c0-4440-9a74-f887b809b9b1 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:02.316741 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:02.325214 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:02.329064 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e76c54-a43c-4d53-b538-cdfa6a1069ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:02.330282 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e76c54-a43c-4d53-b538-cdfa6a1069ef None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:02.331377 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e76c54-a43c-4d53-b538-cdfa6a1069ef None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:02.331903 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e76c54-a43c-4d53-b538-cdfa6a1069ef None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:02.333434 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e76c54-a43c-4d53-b538-cdfa6a1069ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:02.334102 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e76c54-a43c-4d53-b538-cdfa6a1069ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:02.336857 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e76c54-a43c-4d53-b538-cdfa6a1069ef None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:02.363525 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 343/687] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 1 03:44:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:02.364170 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e76c54-a43c-4d53-b538-cdfa6a1069ef None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:02.406826 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723927c3-a0ed-4e55-9697-dfbfabb89c62 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:02.464509 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6e76c-a87d-4032-8da2-bd19daeab1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:02.465111 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6e76c-a87d-4032-8da2-bd19daeab1c1 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:02.465396 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6e76c-a87d-4032-8da2-bd19daeab1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:02.465670 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6e76c-a87d-4032-8da2-bd19daeab1c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:02.466445 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6e76c-a87d-4032-8da2-bd19daeab1c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:02.466756 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6e76c-a87d-4032-8da2-bd19daeab1c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:02.468206 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6e76c-a87d-4032-8da2-bd19daeab1c1 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:02.483170 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 345/688] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:44:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:02.483170 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db57ab-93ac-4656-a7ca-67f6774edd72 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:02.483170 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db57ab-93ac-4656-a7ca-67f6774edd72 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:02.483170 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db57ab-93ac-4656-a7ca-67f6774edd72 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:02.486418 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 346/689] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:44:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:44:02.487555 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db57ab-93ac-4656-a7ca-67f6774edd72 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:02.554814 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e76c54-a43c-4d53-b538-cdfa6a1069ef None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:02.599426 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9833395-2e87-4f39-9ebf-4e8508b8a7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:02.600442 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9833395-2e87-4f39-9ebf-4e8508b8a7d6 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:02.600758 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9833395-2e87-4f39-9ebf-4e8508b8a7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:02.601037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9833395-2e87-4f39-9ebf-4e8508b8a7d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:02.614997 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9833395-2e87-4f39-9ebf-4e8508b8a7d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:02.616140 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db57ab-93ac-4656-a7ca-67f6774edd72 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:02.617244 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9833395-2e87-4f39-9ebf-4e8508b8a7d6 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:02.638599 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-e9833395-2e87-4f39-9ebf-4e8508b8a7d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:02.638599 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:02.638599 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:02.638599 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:02.638599 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:02.638599 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:02.638599 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:02.638599 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:02.638599 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:02.638599 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:02.638599 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:02.638599 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:02.638599 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:44:02.638599 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:44:02.638599 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:44:02.639716 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:44:02.639716 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:02.639716 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:02.639716 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:02.639716 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:02.639716 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:02.639716 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:02.639716 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:02.639716 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:02.639716 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:02.639716 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:02.639716 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:02.639716 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:02.639716 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:02.639716 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:02.639716 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:02.639716 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:02.640678 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:44:02.640678 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:44:02.640678 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:02.640678 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:02.640900 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:02.647691 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 344/690] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:44:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:02.649392 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03711e-bddd-4dc6-93aa-32090c9af664 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:02.649878 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03711e-bddd-4dc6-93aa-32090c9af664 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:02.650316 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03711e-bddd-4dc6-93aa-32090c9af664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:02.663688 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3569f-df4d-41bc-aa08-9a0687c4fc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:02.664652 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3569f-df4d-41bc-aa08-9a0687c4fc2a None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:02.665089 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3569f-df4d-41bc-aa08-9a0687c4fc2a None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:02.665752 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3569f-df4d-41bc-aa08-9a0687c4fc2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:02.666771 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3569f-df4d-41bc-aa08-9a0687c4fc2a None admin] RBAC: Adding query filter params (role.id=66426d7dd6f64f6ebfcb1cbb8188b0d2, scope.project.id=da83db15a312499fb627691ae442f233, user.id=ff2e6387d102445d963de072c55833d3) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:02.667242 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3569f-df4d-41bc-aa08-9a0687c4fc2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:02.669038 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3569f-df4d-41bc-aa08-9a0687c4fc2a None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:02.669938 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-ce03711e-bddd-4dc6-93aa-32090c9af664 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:44:02.671255 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ce03711e-bddd-4dc6-93aa-32090c9af664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:44:02.687002 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 347/691] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:44:02 2022] GET /identity/v3/role_assignments?user.id=ff2e6387d102445d963de072c55833d3&scope.project.id=da83db15a312499fb627691ae442f233&role.id=66426d7dd6f64f6ebfcb1cbb8188b0d2 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:02.687002 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3569f-df4d-41bc-aa08-9a0687c4fc2a None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:02.742307 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:02.808141 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 345/692] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:44:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:44:02.809928 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03711e-bddd-4dc6-93aa-32090c9af664 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:02.923216 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3569f-df4d-41bc-aa08-9a0687c4fc2a None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:02.985482 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58df51-4feb-4f3f-8363-94d957cc341e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:02.987267 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58df51-4feb-4f3f-8363-94d957cc341e None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:02.987759 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58df51-4feb-4f3f-8363-94d957cc341e None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:02.988202 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58df51-4feb-4f3f-8363-94d957cc341e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:03.007675 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb58df51-4feb-4f3f-8363-94d957cc341e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:03.010288 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb58df51-4feb-4f3f-8363-94d957cc341e None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:03.013177 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03711e-bddd-4dc6-93aa-32090c9af664 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:03.035073 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-bb58df51-4feb-4f3f-8363-94d957cc341e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:03.035073 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:03.035073 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:03.035073 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:03.035073 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:03.035073 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:03.035073 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:03.035073 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:03.035073 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:03.035073 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:03.035073 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:03.035073 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:03.035073 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:44:03.035073 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:44:03.035073 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:44:03.036209 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:44:03.036209 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:03.036209 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:03.036209 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:03.036209 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:03.036209 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:03.036209 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:03.036209 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:03.036209 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:03.036209 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:03.036209 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:03.036209 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:03.036209 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:03.036209 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:03.036209 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:03.036209 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:03.036209 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:03.037121 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:44:03.037121 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:44:03.037121 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:03.037121 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:03.037343 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 348/693] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:44:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:03.039039 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58df51-4feb-4f3f-8363-94d957cc341e None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:03.072551 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c07c17-f8e3-448f-abb3-86e240f570a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:03.073659 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c07c17-f8e3-448f-abb3-86e240f570a7 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:03.074822 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c07c17-f8e3-448f-abb3-86e240f570a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:03.075548 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c07c17-f8e3-448f-abb3-86e240f570a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:03.076717 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c07c17-f8e3-448f-abb3-86e240f570a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:03.077375 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c07c17-f8e3-448f-abb3-86e240f570a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:03.079332 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c07c17-f8e3-448f-abb3-86e240f570a7 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:03.096161 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 346/694] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:03.096548 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:03.097547 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c07c17-f8e3-448f-abb3-86e240f570a7 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:03.141276 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:03.221885 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58df51-4feb-4f3f-8363-94d957cc341e None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:03.238219 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c07c17-f8e3-448f-abb3-86e240f570a7 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:03.284094 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae52da-f5a9-4399-a65a-a10a392cf6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:03.285426 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae52da-f5a9-4399-a65a-a10a392cf6d1 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:03.285921 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae52da-f5a9-4399-a65a-a10a392cf6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:03.286384 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f6160-7567-4bc3-a490-db9ba330a550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:03.286539 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae52da-f5a9-4399-a65a-a10a392cf6d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:03.287801 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae52da-f5a9-4399-a65a-a10a392cf6d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:03.288145 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f6160-7567-4bc3-a490-db9ba330a550 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:03.288498 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae52da-f5a9-4399-a65a-a10a392cf6d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:03.288804 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f6160-7567-4bc3-a490-db9ba330a550 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:03.289321 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f6160-7567-4bc3-a490-db9ba330a550 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:03.290543 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae52da-f5a9-4399-a65a-a10a392cf6d1 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:03.290656 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f6160-7567-4bc3-a490-db9ba330a550 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:03.293104 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f6160-7567-4bc3-a490-db9ba330a550 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:03.311326 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 347/695] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:44:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:03.311326 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae52da-f5a9-4399-a65a-a10a392cf6d1 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:03.319763 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-328f6160-7567-4bc3-a490-db9ba330a550 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 01 03:44:03.319763 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:03.319763 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 03:44:03.319763 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 03:44:03.319763 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 03:44:03.319763 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 03:44:03.319763 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 03:44:03.319763 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:44:03.319763 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 01 03:44:03.319763 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:03.319763 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 03:44:03.319763 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:03.319763 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:03.319763 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:03.319763 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:03.319763 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:03.320849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:03.320849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:03.320849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:03.320849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:03.320849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:03.320849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:03.320849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:03.320849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 03:44:03.320849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 03:44:03.320849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 03:44:03.320849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 03:44:03.320849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:03.320849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:03.320849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:03.320849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:03.320849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:03.321695 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:03.321695 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:03.321695 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:03.321695 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:03.321695 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:03.321695 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:03.321695 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:03.321695 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:03.321695 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:03.321695 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:03.321695 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:03.321695 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 03:44:03.321695 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:44:03.321695 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 01 03:44:03.321695 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:03.322476 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 349/696] 10.222.0.46 () {56 vars in 1129 bytes} [Fri Jul 1 03:44:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:03.324317 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ce2e6-ceb4-407c-a968-9056daf1a4c2 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:03.324790 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ce2e6-ceb4-407c-a968-9056daf1a4c2 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:03.325243 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ce2e6-ceb4-407c-a968-9056daf1a4c2 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:03.327860 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 350/697] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:44:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:44:03.329543 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8ce2e6-ceb4-407c-a968-9056daf1a4c2 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:03.457148 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:03.467378 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae52da-f5a9-4399-a65a-a10a392cf6d1 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:03.492471 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:03.500333 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8ce2e6-ceb4-407c-a968-9056daf1a4c2 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:03.524812 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1203036c-b5e9-4661-ad83-c48defb1a1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:03.525980 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203036c-b5e9-4661-ad83-c48defb1a1b8 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:03.526374 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203036c-b5e9-4661-ad83-c48defb1a1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:03.526743 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203036c-b5e9-4661-ad83-c48defb1a1b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:03.536615 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1203036c-b5e9-4661-ad83-c48defb1a1b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:03.538415 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1203036c-b5e9-4661-ad83-c48defb1a1b8 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:03.556028 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-1203036c-b5e9-4661-ad83-c48defb1a1b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:44:03.556028 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:03.556028 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:03.556028 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:03.556028 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:03.556028 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:03.556028 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:03.556028 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:03.556028 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:03.556028 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:03.556028 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:03.556028 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:03.556028 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 03:44:03.556028 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 03:44:03.556028 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 03:44:03.557748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 03:44:03.557748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:03.557748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:03.557748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:03.557748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:03.557748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:03.557748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:03.557748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:03.557748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:03.557748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:03.557748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:03.557748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:03.557748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:03.557748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:03.557748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:03.557748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:03.557748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:03.560453 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 03:44:03.560453 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 03:44:03.560453 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 03:44:03.560453 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 03:44:03.560453 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 03:44:03.560453 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 03:44:03.560453 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:44:03.560453 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:03.560453 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 348/698] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:44:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:03.560453 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1203036c-b5e9-4661-ad83-c48defb1a1b8 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:03.573645 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a43fd-f3a1-474a-86ce-47a8f6273dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:03.575013 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a43fd-f3a1-474a-86ce-47a8f6273dfd None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:03.575485 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a43fd-f3a1-474a-86ce-47a8f6273dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:03.575978 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a43fd-f3a1-474a-86ce-47a8f6273dfd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:03.590103 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345a43fd-f3a1-474a-86ce-47a8f6273dfd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:03.592789 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345a43fd-f3a1-474a-86ce-47a8f6273dfd None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:03.620996 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-345a43fd-f3a1-474a-86ce-47a8f6273dfd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 01 03:44:03.620996 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:03.620996 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:03.620996 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:03.620996 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:03.620996 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:03.620996 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:03.620996 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:03.620996 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:03.620996 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:03.620996 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:03.620996 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:03.620996 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 03:44:03.620996 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 03:44:03.620996 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 03:44:03.620996 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 03:44:03.622637 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:03.622637 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:03.622637 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 03:44:03.622637 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:44:03.622637 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 03:44:03.622637 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:44:03.622637 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:03.622637 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:03.622637 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:03.622637 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:03.622637 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:03.622637 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:03.622637 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:03.622637 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:03.622637 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:03.622637 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:03.622637 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:03.622637 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:03.624417 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:03.624417 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:03.624417 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 03:44:03.624417 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 03:44:03.624417 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 03:44:03.624417 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 03:44:03.624417 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 03:44:03.624417 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 03:44:03.624417 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 01 03:44:03.624417 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:03.624417 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 351/699] 10.222.0.46 () {56 vars in 1093 bytes} [Fri Jul 1 03:44:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:03.625560 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7705d-a533-403b-b0a7-4b8fd597e772 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:03.626553 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7705d-a533-403b-b0a7-4b8fd597e772 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:03.626553 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7705d-a533-403b-b0a7-4b8fd597e772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:03.656742 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-fac7705d-a533-403b-b0a7-4b8fd597e772 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:44:03.659332 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-fac7705d-a533-403b-b0a7-4b8fd597e772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:44:03.702134 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1203036c-b5e9-4661-ad83-c48defb1a1b8 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:03.758078 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 352/700] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:44:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:44:03.759673 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7705d-a533-403b-b0a7-4b8fd597e772 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:03.770879 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf4f91-ded4-403c-b4dd-e744c1f2ae45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:03.771946 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf4f91-ded4-403c-b4dd-e744c1f2ae45 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:03.772426 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf4f91-ded4-403c-b4dd-e744c1f2ae45 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:03.772925 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf4f91-ded4-403c-b4dd-e744c1f2ae45 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:03.773944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf4f91-ded4-403c-b4dd-e744c1f2ae45 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:03.774459 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf4f91-ded4-403c-b4dd-e744c1f2ae45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:03.777034 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf4f91-ded4-403c-b4dd-e744c1f2ae45 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:03.784681 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 349/701] 10.222.0.46 () {56 vars in 1124 bytes} [Fri Jul 1 03:44:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:03.786363 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf4f91-ded4-403c-b4dd-e744c1f2ae45 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:03.823233 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:03.903097 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:03.918575 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7705d-a533-403b-b0a7-4b8fd597e772 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:03.958764 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b05fa7-a4d4-446a-9d52-ed8617acaf87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:03.959724 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b05fa7-a4d4-446a-9d52-ed8617acaf87 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:03.959903 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b05fa7-a4d4-446a-9d52-ed8617acaf87 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:03.960029 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b05fa7-a4d4-446a-9d52-ed8617acaf87 None admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:03.960838 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b05fa7-a4d4-446a-9d52-ed8617acaf87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:03.961149 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b05fa7-a4d4-446a-9d52-ed8617acaf87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:03.963233 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b05fa7-a4d4-446a-9d52-ed8617acaf87 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:03.985017 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 353/702] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 1 03:44:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:03.985017 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b05fa7-a4d4-446a-9d52-ed8617acaf87 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:03.993153 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf4f91-ded4-403c-b4dd-e744c1f2ae45 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:04.055772 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba5017-5cdb-4a70-ba59-e2dd6bdd5dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:04.056707 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba5017-5cdb-4a70-ba59-e2dd6bdd5dae None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:04.056831 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba5017-5cdb-4a70-ba59-e2dd6bdd5dae None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:04.057169 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba5017-5cdb-4a70-ba59-e2dd6bdd5dae None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:04.057899 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba5017-5cdb-4a70-ba59-e2dd6bdd5dae None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:04.058213 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba5017-5cdb-4a70-ba59-e2dd6bdd5dae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:04.060450 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba5017-5cdb-4a70-ba59-e2dd6bdd5dae None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:04.090912 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 350/703] 10.222.0.46 () {56 vars in 1133 bytes} [Fri Jul 1 03:44:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:04.090912 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba5017-5cdb-4a70-ba59-e2dd6bdd5dae None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:04.158188 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b05fa7-a4d4-446a-9d52-ed8617acaf87 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:04.194821 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:04.224680 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba5017-5cdb-4a70-ba59-e2dd6bdd5dae None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:04.226322 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005cb33-c328-4642-8a66-0e4332919c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:04.227484 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005cb33-c328-4642-8a66-0e4332919c40 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:04.227966 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005cb33-c328-4642-8a66-0e4332919c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:04.228442 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005cb33-c328-4642-8a66-0e4332919c40 None admin] PATH_INFO: `/v3/services` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:04.229726 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005cb33-c328-4642-8a66-0e4332919c40 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:04.230271 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005cb33-c328-4642-8a66-0e4332919c40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:04.232925 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005cb33-c328-4642-8a66-0e4332919c40 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:04.251510 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 354/704] 10.222.0.46 () {56 vars in 1124 bytes} [Fri Jul 1 03:44:03 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:04.251510 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005cb33-c328-4642-8a66-0e4332919c40 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:04.277222 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:04.282054 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b8124b-29e1-4163-acb2-f027c83e668a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:04.282947 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8124b-29e1-4163-acb2-f027c83e668a None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:04.283240 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8124b-29e1-4163-acb2-f027c83e668a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:04.283600 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8124b-29e1-4163-acb2-f027c83e668a None admin] PATH_INFO: `/v3/services/network` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:04.284364 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b8124b-29e1-4163-acb2-f027c83e668a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:04.290681 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b8124b-29e1-4163-acb2-f027c83e668a None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:04.302037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-12b8124b-29e1-4163-acb2-f027c83e668a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 01 03:44:04.302037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:04.302037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 03:44:04.302037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 03:44:04.302037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 03:44:04.302037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 03:44:04.302037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 03:44:04.302037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:44:04.302037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 01 03:44:04.302037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:04.302037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 03:44:04.302037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:04.302037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:04.302037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:04.302037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:04.302037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:04.302037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:04.303131 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:04.303131 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:04.303131 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:04.303131 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:04.303131 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:04.303131 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:04.303131 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 03:44:04.303131 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 03:44:04.303131 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 03:44:04.303131 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 03:44:04.303131 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:04.303131 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:04.303131 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:04.303131 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:04.303131 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:04.303131 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:04.304024 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:04.304024 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:04.304024 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:04.304024 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:04.304024 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:04.304024 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:04.304024 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:04.304024 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:04.304024 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:04.304024 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:04.304024 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 03:44:04.304024 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:44:04.304024 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 01 03:44:04.304024 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:04.306771 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 351/705] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:44:04 2022] GET /identity/v3/services/network => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:04.308061 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b8124b-29e1-4163-acb2-f027c83e668a None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:04.408562 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005cb33-c328-4642-8a66-0e4332919c40 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:04.453032 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea7cde-5356-4f26-bbf1-35994846e724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:04.453989 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea7cde-5356-4f26-bbf1-35994846e724 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:04.454467 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea7cde-5356-4f26-bbf1-35994846e724 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:04.454897 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea7cde-5356-4f26-bbf1-35994846e724 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:04.456019 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eea7cde-5356-4f26-bbf1-35994846e724 None admin] RBAC: Adding query filter params (role.id=66426d7dd6f64f6ebfcb1cbb8188b0d2, scope.project.id=da83db15a312499fb627691ae442f233, user.id=83787880173b459c8975b834bd47a51a) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:04.456507 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eea7cde-5356-4f26-bbf1-35994846e724 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:04.458198 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eea7cde-5356-4f26-bbf1-35994846e724 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:04.466195 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 355/706] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:44:04 2022] GET /identity/v3/role_assignments?user.id=83787880173b459c8975b834bd47a51a&scope.project.id=da83db15a312499fb627691ae442f233&role.id=66426d7dd6f64f6ebfcb1cbb8188b0d2 => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:04.467322 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea7cde-5356-4f26-bbf1-35994846e724 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:04.533690 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b8124b-29e1-4163-acb2-f027c83e668a None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:04.578761 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14dd44-c8b2-4e03-808b-499dceab8c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:04.579441 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14dd44-c8b2-4e03-808b-499dceab8c81 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:04.579778 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14dd44-c8b2-4e03-808b-499dceab8c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:04.580059 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14dd44-c8b2-4e03-808b-499dceab8c81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:04.590552 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:04.595394 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:04.623896 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea7cde-5356-4f26-bbf1-35994846e724 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:04.663129 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d89c5-18f1-4d4d-b6f1-49c1fb0b4053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:04.663760 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d89c5-18f1-4d4d-b6f1-49c1fb0b4053 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:04.664044 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d89c5-18f1-4d4d-b6f1-49c1fb0b4053 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:04.664324 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d89c5-18f1-4d4d-b6f1-49c1fb0b4053 None admin] PATH_INFO: `/v3/services` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:04.665048 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d89c5-18f1-4d4d-b6f1-49c1fb0b4053 None admin] RBAC: Adding query filter params (name=network) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:04.665362 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d89c5-18f1-4d4d-b6f1-49c1fb0b4053 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:04.667012 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d89c5-18f1-4d4d-b6f1-49c1fb0b4053 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:04.672592 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14dd44-c8b2-4e03-808b-499dceab8c81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:04.673117 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 356/707] 10.222.0.46 () {56 vars in 1112 bytes} [Fri Jul 1 03:44:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:04.675334 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14dd44-c8b2-4e03-808b-499dceab8c81 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:04.679241 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d89c5-18f1-4d4d-b6f1-49c1fb0b4053 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:04.797335 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 352/708] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:44:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 03:44:04.800566 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d89c5-18f1-4d4d-b6f1-49c1fb0b4053 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:04.804492 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14dd44-c8b2-4e03-808b-499dceab8c81 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:04.851622 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb98227-988e-4b15-a49a-a9e403abeaad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:04.852777 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb98227-988e-4b15-a49a-a9e403abeaad None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:04.853273 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb98227-988e-4b15-a49a-a9e403abeaad None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:04.853755 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb98227-988e-4b15-a49a-a9e403abeaad None admin] PATH_INFO: `/v3/services` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:04.854690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb98227-988e-4b15-a49a-a9e403abeaad None admin] RBAC: Adding query filter params (type=network) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:04.855207 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb98227-988e-4b15-a49a-a9e403abeaad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:04.857961 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb98227-988e-4b15-a49a-a9e403abeaad None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:04.862501 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:04.865288 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 357/709] 10.222.0.46 () {56 vars in 1112 bytes} [Fri Jul 1 03:44:04 2022] GET /identity/v3/services?type=network => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:04.947360 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14dd44-c8b2-4e03-808b-499dceab8c81 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:04.990260 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1ef49-689b-44fd-bc15-0f7c6f4873c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:04.991090 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1ef49-689b-44fd-bc15-0f7c6f4873c3 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:04.991379 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1ef49-689b-44fd-bc15-0f7c6f4873c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:04.991695 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1ef49-689b-44fd-bc15-0f7c6f4873c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:05.004362 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be1ef49-689b-44fd-bc15-0f7c6f4873c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:05.005885 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be1ef49-689b-44fd-bc15-0f7c6f4873c3 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:05.026159 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-9be1ef49-689b-44fd-bc15-0f7c6f4873c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:05.026159 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:05.026159 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:05.026159 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:05.026159 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:05.026159 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:05.026159 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:05.026159 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:05.026159 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:05.026159 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:05.026159 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:05.026159 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:05.026159 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:44:05.026159 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:44:05.026159 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:44:05.027181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:44:05.027181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:05.027181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:05.027181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:05.027181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:05.027181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:05.027181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:05.027181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:05.027181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:05.027181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:05.027181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:05.027181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:05.027181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:05.027181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:05.027181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:05.027181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:05.027181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:05.028143 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:44:05.028143 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:44:05.028143 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:05.028143 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:05.028143 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 353/710] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:44:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:05.034102 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb98227-988e-4b15-a49a-a9e403abeaad None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:05.038735 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:05.105036 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3cbca2-052e-4002-8550-7e2761c70513 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:05.105991 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3cbca2-052e-4002-8550-7e2761c70513 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:05.106533 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3cbca2-052e-4002-8550-7e2761c70513 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:05.108567 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 354/711] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:44:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:44:05.115517 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b149cba-1b9b-4c8d-9b5d-af36bcc6d6cf None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:05.116154 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b149cba-1b9b-4c8d-9b5d-af36bcc6d6cf None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:05.116637 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b149cba-1b9b-4c8d-9b5d-af36bcc6d6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:05.137038 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-9b149cba-1b9b-4c8d-9b5d-af36bcc6d6cf None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:44:05.138816 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9b149cba-1b9b-4c8d-9b5d-af36bcc6d6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:44:05.162674 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb98227-988e-4b15-a49a-a9e403abeaad None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:05.201523 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8336931-344f-4858-8a58-135d64a26b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:05.202059 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8336931-344f-4858-8a58-135d64a26b0a None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:05.202347 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8336931-344f-4858-8a58-135d64a26b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:05.202626 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8336931-344f-4858-8a58-135d64a26b0a None admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:05.203358 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8336931-344f-4858-8a58-135d64a26b0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:05.203693 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8336931-344f-4858-8a58-135d64a26b0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:05.205091 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8336931-344f-4858-8a58-135d64a26b0a None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:05.219654 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 358/712] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:44:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:05.225940 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 355/713] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:44:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:44:05.228594 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8336931-344f-4858-8a58-135d64a26b0a None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:05.256189 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b149cba-1b9b-4c8d-9b5d-af36bcc6d6cf None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:05.288646 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:05.327561 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:05.387221 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8336931-344f-4858-8a58-135d64a26b0a None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:05.391540 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b149cba-1b9b-4c8d-9b5d-af36bcc6d6cf None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:05.435050 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e5ca1-5258-4742-b18c-8de648829f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:05.435918 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e5ca1-5258-4742-b18c-8de648829f2b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:05.436198 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e5ca1-5258-4742-b18c-8de648829f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:05.436470 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e5ca1-5258-4742-b18c-8de648829f2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:05.438717 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862024a-0196-497b-8e4f-e871458198c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:05.439614 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862024a-0196-497b-8e4f-e871458198c4 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:05.440389 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862024a-0196-497b-8e4f-e871458198c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:05.440663 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862024a-0196-497b-8e4f-e871458198c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:05.451608 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1862024a-0196-497b-8e4f-e871458198c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:05.452415 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e5ca1-5258-4742-b18c-8de648829f2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:05.453004 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1862024a-0196-497b-8e4f-e871458198c4 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:05.454705 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e5ca1-5258-4742-b18c-8de648829f2b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:05.470134 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-1862024a-0196-497b-8e4f-e871458198c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:44:05.470134 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:05.470134 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:05.470134 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:05.470134 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:05.470134 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:05.470134 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:05.470134 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:05.470134 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:05.470134 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:05.470134 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:05.470134 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:05.470134 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 03:44:05.470134 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 03:44:05.470134 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 03:44:05.471957 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 03:44:05.471957 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:05.471957 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:05.471957 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:05.471957 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:05.471957 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:05.471957 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:05.471957 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:05.471957 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:05.471957 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:05.471957 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:05.471957 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:05.471957 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:05.471957 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:05.471957 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:05.471957 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:05.471957 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:05.472856 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 03:44:05.472856 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 03:44:05.472856 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 03:44:05.472856 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 03:44:05.472856 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 03:44:05.472856 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 03:44:05.472856 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:44:05.472856 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:05.472856 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 359/714] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:44:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:05.477918 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862024a-0196-497b-8e4f-e871458198c4 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:05.479854 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-552e5ca1-5258-4742-b18c-8de648829f2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:05.479854 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:05.479854 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:05.479854 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:05.479854 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:05.479854 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:05.479854 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:05.479854 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:05.479854 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:05.479854 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:05.479854 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:05.479854 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:05.479854 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:44:05.479854 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:44:05.479854 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:44:05.480747 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:44:05.480747 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:05.480747 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:05.480747 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:05.480747 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:05.480747 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:05.480747 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:05.480747 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:05.480747 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:05.480747 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:05.480747 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:05.480747 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:05.480747 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:05.480747 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:05.480747 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:05.480747 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:05.480747 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:05.481706 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:44:05.481706 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:44:05.481706 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:05.481706 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:05.484542 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 356/715] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:44:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:05.493534 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e5ca1-5258-4742-b18c-8de648829f2b None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:05.574556 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:05.607377 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e5ca1-5258-4742-b18c-8de648829f2b None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:05.625638 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862024a-0196-497b-8e4f-e871458198c4 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:05.648127 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53074f-20a8-445e-ad91-593980d63918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:05.649438 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53074f-20a8-445e-ad91-593980d63918 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:05.649958 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53074f-20a8-445e-ad91-593980d63918 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:05.650457 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53074f-20a8-445e-ad91-593980d63918 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:05.651385 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc53074f-20a8-445e-ad91-593980d63918 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:05.651917 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc53074f-20a8-445e-ad91-593980d63918 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:05.653595 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc53074f-20a8-445e-ad91-593980d63918 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:05.656779 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:05.675898 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e01e8-12c2-4df1-8d94-e7a54bda2dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:05.676840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e01e8-12c2-4df1-8d94-e7a54bda2dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:05.677275 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e01e8-12c2-4df1-8d94-e7a54bda2dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:05.677700 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e01e8-12c2-4df1-8d94-e7a54bda2dc0 None admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:05.678653 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e01e8-12c2-4df1-8d94-e7a54bda2dc0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:05.679237 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e01e8-12c2-4df1-8d94-e7a54bda2dc0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:05.681715 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 357/716] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:44:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:05.683556 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e01e8-12c2-4df1-8d94-e7a54bda2dc0 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:05.687863 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53074f-20a8-445e-ad91-593980d63918 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:05.722181 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 360/717] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 1 03:44:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:44:05.732553 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e01e8-12c2-4df1-8d94-e7a54bda2dc0 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:05.875192 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e01e8-12c2-4df1-8d94-e7a54bda2dc0 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:05.915888 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0d6fd-9a3b-4661-ada3-731c4a3eee04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:05.916873 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0d6fd-9a3b-4661-ada3-731c4a3eee04 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:05.917304 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0d6fd-9a3b-4661-ada3-731c4a3eee04 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:05.917764 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0d6fd-9a3b-4661-ada3-731c4a3eee04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:05.918783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d0d6fd-9a3b-4661-ada3-731c4a3eee04 None admin] RBAC: Adding query filter params (role.id=681755518698445fabd9a8accec13c0f, scope.project.id=da83db15a312499fb627691ae442f233, user.id=2da466ad31d344898f5c838f77d45181) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:05.919264 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d0d6fd-9a3b-4661-ada3-731c4a3eee04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:05.921113 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d0d6fd-9a3b-4661-ada3-731c4a3eee04 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:05.928012 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 361/718] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:44:05 2022] GET /identity/v3/role_assignments?user.id=2da466ad31d344898f5c838f77d45181&scope.project.id=da83db15a312499fb627691ae442f233&role.id=681755518698445fabd9a8accec13c0f => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:05.942831 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53074f-20a8-445e-ad91-593980d63918 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:06.043396 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:06.054204 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073fab7-2f88-4b96-b69b-f11b986ab8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:06.061934 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073fab7-2f88-4b96-b69b-f11b986ab8aa None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:06.061934 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073fab7-2f88-4b96-b69b-f11b986ab8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:06.061934 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073fab7-2f88-4b96-b69b-f11b986ab8aa None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:06.061934 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073fab7-2f88-4b96-b69b-f11b986ab8aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:06.061934 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073fab7-2f88-4b96-b69b-f11b986ab8aa None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:06.171609 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 358/719] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Jul 1 03:44:05 2022] POST /identity/v3/users => generated 254 bytes in 483 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 03:44:07.390820 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb440039-7cae-4b4c-95f6-690e6b583915 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:07.391391 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb440039-7cae-4b4c-95f6-690e6b583915 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:07.391391 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb440039-7cae-4b4c-95f6-690e6b583915 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:07.393639 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 362/720] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:44:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:44:07.399125 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f7b6b-b7e1-4197-9bd5-fcbcdf7caf56 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:07.399658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f7b6b-b7e1-4197-9bd5-fcbcdf7caf56 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:07.399751 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f7b6b-b7e1-4197-9bd5-fcbcdf7caf56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:07.422362 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-701f7b6b-b7e1-4197-9bd5-fcbcdf7caf56 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:44:07.423616 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-701f7b6b-b7e1-4197-9bd5-fcbcdf7caf56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:44:07.533886 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 359/721] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:44:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:44:07.575283 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb440039-7cae-4b4c-95f6-690e6b583915 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:07.652893 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:07.717269 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb440039-7cae-4b4c-95f6-690e6b583915 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:07.761142 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca63cf1-fd87-4015-ac0c-0e32b16730e4 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:07.761458 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca63cf1-fd87-4015-ac0c-0e32b16730e4 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:07.761700 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca63cf1-fd87-4015-ac0c-0e32b16730e4 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:07.763490 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 360/722] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:44:07.766794 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8c1af-025a-4942-bd6c-bdc2595c14d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:07.767575 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8c1af-025a-4942-bd6c-bdc2595c14d5 None admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:07.768358 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8c1af-025a-4942-bd6c-bdc2595c14d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:07.768639 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8c1af-025a-4942-bd6c-bdc2595c14d5 None admin] PATH_INFO: `/v3/services` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:07.769403 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8c1af-025a-4942-bd6c-bdc2595c14d5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:07.770993 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8c1af-025a-4942-bd6c-bdc2595c14d5 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:07.776994 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5df593-b4da-4b12-b6bb-2d7f3919fd89 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:07.777278 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5df593-b4da-4b12-b6bb-2d7f3919fd89 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:07.777552 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5df593-b4da-4b12-b6bb-2d7f3919fd89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:07.803147 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-ee5df593-b4da-4b12-b6bb-2d7f3919fd89 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:44:07.804475 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ee5df593-b4da-4b12-b6bb-2d7f3919fd89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:44:07.881182 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 361/723] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:44:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 03:44:07.894516 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 363/724] 10.222.0.46 () {60 vars in 1141 bytes} [Fri Jul 1 03:44:07 2022] POST /identity/v3/services => generated 240 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 03:44:07.906734 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5df593-b4da-4b12-b6bb-2d7f3919fd89 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:07.963960 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:08.023436 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5df593-b4da-4b12-b6bb-2d7f3919fd89 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:08.072984 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3d2a4-7501-4575-8584-384b6d2060be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:08.073702 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3d2a4-7501-4575-8584-384b6d2060be None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:08.073993 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3d2a4-7501-4575-8584-384b6d2060be None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:08.074275 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3d2a4-7501-4575-8584-384b6d2060be None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:08.075041 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c3d2a4-7501-4575-8584-384b6d2060be None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:08.076734 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c3d2a4-7501-4575-8584-384b6d2060be None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:08.152872 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 362/725] 10.222.0.46 () {60 vars in 1141 bytes} [Fri Jul 1 03:44:07 2022] POST /identity/v3/services => generated 251 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 03:44:08.417694 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5bf501-ae9c-4fbb-b799-da7dc7f033e2 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:08.418243 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5bf501-ae9c-4fbb-b799-da7dc7f033e2 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:08.418243 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5bf501-ae9c-4fbb-b799-da7dc7f033e2 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:08.419957 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 364/726] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:44:08.426196 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171a906-a0f1-4595-a9ca-3800e4093f32 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:08.427116 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171a906-a0f1-4595-a9ca-3800e4093f32 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:08.427648 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171a906-a0f1-4595-a9ca-3800e4093f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:08.445862 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-1171a906-a0f1-4595-a9ca-3800e4093f32 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:44:08.447394 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1171a906-a0f1-4595-a9ca-3800e4093f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:44:08.524274 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09cdca-ce95-4afd-8568-2a6e093590da None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:08.524601 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09cdca-ce95-4afd-8568-2a6e093590da None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:08.524847 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09cdca-ce95-4afd-8568-2a6e093590da None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:08.526826 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 365/727] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:44:08.531574 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 363/728] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:44:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:44:08.535121 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b07d7-9921-4472-9462-869e0fa6b779 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:08.535419 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b07d7-9921-4472-9462-869e0fa6b779 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:08.535726 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b07d7-9921-4472-9462-869e0fa6b779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:08.552069 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171a906-a0f1-4595-a9ca-3800e4093f32 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:08.568313 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-325b07d7-9921-4472-9462-869e0fa6b779 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:44:08.570223 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-325b07d7-9921-4472-9462-869e0fa6b779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:44:08.584135 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:08.660229 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171a906-a0f1-4595-a9ca-3800e4093f32 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:08.697839 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228f684-f29a-40dd-99db-9feccf9c854a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:08.698569 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228f684-f29a-40dd-99db-9feccf9c854a None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:08.698851 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228f684-f29a-40dd-99db-9feccf9c854a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:08.699127 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228f684-f29a-40dd-99db-9feccf9c854a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:08.711203 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1228f684-f29a-40dd-99db-9feccf9c854a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:44:08.719229 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-1228f684-f29a-40dd-99db-9feccf9c854a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:44:08.719229 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:08.719229 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:08.719229 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:08.719229 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:08.719229 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:08.719229 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:08.719229 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:08.719229 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:08.719229 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:08.719229 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:08.719229 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:08.719229 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:44:08.719229 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:44:08.719229 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:44:08.719229 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:44:08.720312 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:44:08.720312 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:44:08.720312 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:44:08.720312 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:44:08.720312 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:08.720312 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:08.720312 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:08.720312 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:08.720312 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:08.720312 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:08.720312 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:08.720312 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:08.720312 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:08.720312 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:08.720312 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:08.720312 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:08.721685 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:08.721685 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:08.721685 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:08.721685 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:08.721685 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:44:08.721685 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:44:08.721685 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:44:08.721685 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:44:08.721685 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:44:08.721685 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:44:08.721685 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:44:08.721685 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:08.726058 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 364/729] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 1 03:44:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 03:44:08.727393 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228f684-f29a-40dd-99db-9feccf9c854a None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:08.766247 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 366/730] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:44:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:44:08.824219 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:08.834238 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228f684-f29a-40dd-99db-9feccf9c854a None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:08.836729 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b07d7-9921-4472-9462-869e0fa6b779 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:08.871691 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d8c93-7e0b-43bd-8e16-b622f8890030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:08.872560 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d8c93-7e0b-43bd-8e16-b622f8890030 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:08.872848 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d8c93-7e0b-43bd-8e16-b622f8890030 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:08.873124 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d8c93-7e0b-43bd-8e16-b622f8890030 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:08.873939 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d8c93-7e0b-43bd-8e16-b622f8890030 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:08.874257 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d8c93-7e0b-43bd-8e16-b622f8890030 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:08.875994 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d8c93-7e0b-43bd-8e16-b622f8890030 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:08.891931 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 365/731] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:44:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:08.893906 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d8c93-7e0b-43bd-8e16-b622f8890030 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:08.970322 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:09.023391 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d8c93-7e0b-43bd-8e16-b622f8890030 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:09.063809 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aeb8de-db9e-4935-a9fa-95d398a8c87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:09.065119 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aeb8de-db9e-4935-a9fa-95d398a8c87f None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:09.065612 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aeb8de-db9e-4935-a9fa-95d398a8c87f None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:09.066091 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aeb8de-db9e-4935-a9fa-95d398a8c87f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:09.079334 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aeb8de-db9e-4935-a9fa-95d398a8c87f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:09.081747 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aeb8de-db9e-4935-a9fa-95d398a8c87f None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:09.101717 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-05aeb8de-db9e-4935-a9fa-95d398a8c87f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:09.101717 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:09.101717 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:09.101717 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:09.101717 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:09.101717 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:09.101717 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:09.101717 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:09.101717 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:09.101717 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:09.101717 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:09.101717 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:09.101717 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:44:09.101717 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:44:09.101717 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:44:09.102668 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:44:09.102668 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:09.102668 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:09.102668 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:09.102668 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:09.102668 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:09.102668 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:09.102668 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:09.102668 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:09.102668 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:09.102668 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:09.102668 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:09.102668 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:09.102668 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:09.102668 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:09.102668 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:09.102668 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:09.103586 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:44:09.103586 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:44:09.103586 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:09.103586 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:09.110352 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 366/732] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:44:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:09.112351 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aeb8de-db9e-4935-a9fa-95d398a8c87f None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:09.126882 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:09.225858 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b07d7-9921-4472-9462-869e0fa6b779 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:09.301216 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aeb8de-db9e-4935-a9fa-95d398a8c87f None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:09.332287 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63db57d-1972-40ae-ad43-8773e331fa84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:09.333674 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63db57d-1972-40ae-ad43-8773e331fa84 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:09.334179 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63db57d-1972-40ae-ad43-8773e331fa84 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:09.334673 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63db57d-1972-40ae-ad43-8773e331fa84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:09.366894 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63db57d-1972-40ae-ad43-8773e331fa84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:44:09.381081 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-c63db57d-1972-40ae-ad43-8773e331fa84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:44:09.381081 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:09.381081 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:09.381081 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:09.381081 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:09.381081 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:09.381081 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:09.381081 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:09.381081 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:09.381081 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:09.381081 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:09.381081 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:09.381081 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:44:09.381081 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:44:09.381081 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:44:09.381081 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:44:09.382065 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:44:09.382065 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:44:09.382065 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:44:09.382065 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:44:09.382065 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:09.382065 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:09.382065 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:09.382065 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:09.382065 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:09.382065 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:09.382065 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:09.382065 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:09.382065 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:09.382065 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:09.382065 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:09.382065 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:09.383304 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:09.383304 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:09.383304 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:09.383304 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:09.383304 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:44:09.383304 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:44:09.383304 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:44:09.383304 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:44:09.383304 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:44:09.383304 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:44:09.383304 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:44:09.383304 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:09.383304 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 367/733] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 1 03:44:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 546 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:09.396561 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63db57d-1972-40ae-ad43-8773e331fa84 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:09.417470 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b650a-a44d-4d6a-a663-04c038297105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:09.418638 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b650a-a44d-4d6a-a663-04c038297105 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:09.419143 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b650a-a44d-4d6a-a663-04c038297105 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:09.419684 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b650a-a44d-4d6a-a663-04c038297105 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:09.421059 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b650a-a44d-4d6a-a663-04c038297105 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:09.421621 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b650a-a44d-4d6a-a663-04c038297105 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:09.424348 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b650a-a44d-4d6a-a663-04c038297105 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:09.455799 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 367/734] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:44:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:44:09.462071 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b650a-a44d-4d6a-a663-04c038297105 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:09.560176 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:09.608000 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b650a-a44d-4d6a-a663-04c038297105 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:09.634639 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:09.643764 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63db57d-1972-40ae-ad43-8773e331fa84 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:09.658459 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee498b-732c-45c7-bdcd-1f3844f16d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:09.659338 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee498b-732c-45c7-bdcd-1f3844f16d90 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:09.659680 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee498b-732c-45c7-bdcd-1f3844f16d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:09.659957 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee498b-732c-45c7-bdcd-1f3844f16d90 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:09.670458 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee498b-732c-45c7-bdcd-1f3844f16d90 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:09.671999 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee498b-732c-45c7-bdcd-1f3844f16d90 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:09.693199 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-f1ee498b-732c-45c7-bdcd-1f3844f16d90 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 01 03:44:09.693199 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:09.693199 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:09.693199 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:09.693199 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:09.693199 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:09.693199 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:09.693199 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:09.693199 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:09.693199 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:09.693199 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:09.693199 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:09.693199 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 03:44:09.693199 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 03:44:09.693199 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 03:44:09.693199 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 03:44:09.695037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:09.695037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:09.695037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 03:44:09.695037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:44:09.695037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 03:44:09.695037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:44:09.695037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:09.695037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:09.695037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:09.695037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:09.695037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:09.695037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:09.695037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:09.695037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:09.695037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:09.695037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:09.695037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:09.695037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:09.696926 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:09.696926 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:09.696926 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 03:44:09.696926 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 03:44:09.696926 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 03:44:09.696926 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 03:44:09.696926 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 03:44:09.696926 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 03:44:09.696926 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 01 03:44:09.696926 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:09.696926 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 368/735] 10.222.0.46 () {56 vars in 1093 bytes} [Fri Jul 1 03:44:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 03:44:09.696926 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8f9de-15a0-47f2-bc53-b4451e9660c1 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:09.696926 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8f9de-15a0-47f2-bc53-b4451e9660c1 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:09.698292 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8f9de-15a0-47f2-bc53-b4451e9660c1 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:09.698292 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 369/736] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:44:09.704156 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8f9de-15a0-47f2-bc53-b4451e9660c1 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:09.733610 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e503c190-3604-49b7-b574-3ef4de8873e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:09.735526 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503c190-3604-49b7-b574-3ef4de8873e9 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:09.737056 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503c190-3604-49b7-b574-3ef4de8873e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:09.738432 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503c190-3604-49b7-b574-3ef4de8873e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:09.740740 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e503c190-3604-49b7-b574-3ef4de8873e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:09.742037 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e503c190-3604-49b7-b574-3ef4de8873e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:09.745318 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e503c190-3604-49b7-b574-3ef4de8873e9 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:09.760605 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 368/737] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:44:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:44:09.767658 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd632cd-e981-413b-ac9a-56bd272ec1c6 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:09.767658 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd632cd-e981-413b-ac9a-56bd272ec1c6 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:09.767658 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd632cd-e981-413b-ac9a-56bd272ec1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:09.781108 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-cdd632cd-e981-413b-ac9a-56bd272ec1c6 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:44:09.782416 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-cdd632cd-e981-413b-ac9a-56bd272ec1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:44:09.867895 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 369/738] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:44:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:44:09.867895 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd632cd-e981-413b-ac9a-56bd272ec1c6 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:09.888564 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8f9de-15a0-47f2-bc53-b4451e9660c1 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:09.957851 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:09.971197 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:09.977737 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5c336-009c-4d77-aedb-b3cc924dc56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:09.979265 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5c336-009c-4d77-aedb-b3cc924dc56b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:09.980060 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5c336-009c-4d77-aedb-b3cc924dc56b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:09.980807 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5c336-009c-4d77-aedb-b3cc924dc56b None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:09.981919 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd632cd-e981-413b-ac9a-56bd272ec1c6 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:09.983153 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5c336-009c-4d77-aedb-b3cc924dc56b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:09.984104 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5c336-009c-4d77-aedb-b3cc924dc56b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:09.987683 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5c336-009c-4d77-aedb-b3cc924dc56b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:10.023373 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41f9f1-b1e0-432d-a270-17fd44a82768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:10.024068 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 370/739] 10.222.0.46 () {56 vars in 1133 bytes} [Fri Jul 1 03:44:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:10.024253 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41f9f1-b1e0-432d-a270-17fd44a82768 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:10.024409 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41f9f1-b1e0-432d-a270-17fd44a82768 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:10.024678 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41f9f1-b1e0-432d-a270-17fd44a82768 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:10.026358 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5c336-009c-4d77-aedb-b3cc924dc56b None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:10.039054 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41f9f1-b1e0-432d-a270-17fd44a82768 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:10.040610 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41f9f1-b1e0-432d-a270-17fd44a82768 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:10.061001 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-6a41f9f1-b1e0-432d-a270-17fd44a82768 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:10.061001 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:10.061001 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:10.061001 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:10.061001 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:10.061001 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:10.061001 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:10.061001 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:10.061001 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:10.061001 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:10.061001 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:10.061001 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:10.061001 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:44:10.061001 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:44:10.061001 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:44:10.062746 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:44:10.062746 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:10.062746 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:10.062746 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:10.062746 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:10.062746 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:10.062746 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:10.062746 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:10.062746 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:10.062746 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:10.062746 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:10.062746 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:10.062746 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:10.062746 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:10.062746 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:10.062746 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:10.062746 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:10.071605 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:44:10.071605 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:44:10.071605 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:10.071605 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:10.071605 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 370/740] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:44:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:10.071605 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41f9f1-b1e0-432d-a270-17fd44a82768 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:10.181629 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41f9f1-b1e0-432d-a270-17fd44a82768 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:10.221317 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2322ebe-4718-42da-876f-bf330bd351cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:10.222029 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2322ebe-4718-42da-876f-bf330bd351cf None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:10.222308 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2322ebe-4718-42da-876f-bf330bd351cf None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:10.222587 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2322ebe-4718-42da-876f-bf330bd351cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:10.231333 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5c336-009c-4d77-aedb-b3cc924dc56b None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:10.234660 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2322ebe-4718-42da-876f-bf330bd351cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:10.236856 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2322ebe-4718-42da-876f-bf330bd351cf None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:10.239008 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:10.257420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-d2322ebe-4718-42da-876f-bf330bd351cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:10.257420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:10.257420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:10.257420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:10.257420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:10.257420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:10.257420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:10.257420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:10.257420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:10.257420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:10.257420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:10.257420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:10.257420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:44:10.257420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:44:10.257420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:44:10.262628 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:44:10.262628 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:10.262628 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:10.262628 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:10.262628 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:10.262628 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:10.262628 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:10.262628 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:10.262628 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:10.262628 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:10.262628 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:10.262628 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:10.262628 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:10.262628 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:10.262628 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:10.262628 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:10.262628 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:10.264397 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:44:10.264397 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:44:10.264397 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:10.264397 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:10.264397 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 371/741] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:44:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:10.264397 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2322ebe-4718-42da-876f-bf330bd351cf None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:10.303919 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bed8bb-2b4f-418c-aa35-2d182df35135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:10.305699 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bed8bb-2b4f-418c-aa35-2d182df35135 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:10.306437 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bed8bb-2b4f-418c-aa35-2d182df35135 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:10.307169 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bed8bb-2b4f-418c-aa35-2d182df35135 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:10.328186 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bed8bb-2b4f-418c-aa35-2d182df35135 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:44:10.344989 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-b3bed8bb-2b4f-418c-aa35-2d182df35135 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 03:44:10.344989 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:10.344989 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:10.344989 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:10.344989 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:10.344989 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:10.344989 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:10.344989 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:10.344989 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:10.344989 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:10.344989 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:10.344989 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:10.344989 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:44:10.344989 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:44:10.344989 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:44:10.344989 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:44:10.347325 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:44:10.347325 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:44:10.347325 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:44:10.347325 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:44:10.347325 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:10.347325 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:10.347325 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:10.347325 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:10.347325 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:10.347325 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:10.347325 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:10.347325 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:10.347325 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:10.347325 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:10.347325 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:10.347325 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:10.349372 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:10.349372 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:10.349372 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:10.349372 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:10.349372 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:44:10.349372 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:44:10.349372 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:44:10.349372 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:44:10.349372 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:44:10.349372 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:44:10.349372 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 03:44:10.349372 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:10.359802 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 371/742] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Jul 1 03:44:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:10.362335 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bed8bb-2b4f-418c-aa35-2d182df35135 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:10.379414 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2322ebe-4718-42da-876f-bf330bd351cf None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:10.419865 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4909f-6610-4802-acbd-41a562bed7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:10.420546 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4909f-6610-4802-acbd-41a562bed7a0 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:10.420828 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4909f-6610-4802-acbd-41a562bed7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:10.421108 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4909f-6610-4802-acbd-41a562bed7a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:10.421849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e4909f-6610-4802-acbd-41a562bed7a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:10.422161 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e4909f-6610-4802-acbd-41a562bed7a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:10.423670 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e4909f-6610-4802-acbd-41a562bed7a0 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:10.443481 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 372/743] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:44:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:10.443481 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4909f-6610-4802-acbd-41a562bed7a0 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:10.458071 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:10.509267 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:10.567935 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bed8bb-2b4f-418c-aa35-2d182df35135 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:10.568547 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4909f-6610-4802-acbd-41a562bed7a0 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:10.609711 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665925b8-5d21-4615-b4e3-e490edc022f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:10.610670 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665925b8-5d21-4615-b4e3-e490edc022f8 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:10.611116 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665925b8-5d21-4615-b4e3-e490edc022f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:10.611503 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665925b8-5d21-4615-b4e3-e490edc022f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:10.612866 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665925b8-5d21-4615-b4e3-e490edc022f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:10.613416 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665925b8-5d21-4615-b4e3-e490edc022f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:10.616024 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665925b8-5d21-4615-b4e3-e490edc022f8 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:10.631575 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 373/744] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Jul 1 03:44:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:10.633082 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665925b8-5d21-4615-b4e3-e490edc022f8 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:10.643319 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc4354-434b-424a-9988-634fb47809ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:10.644368 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc4354-434b-424a-9988-634fb47809ed None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:10.644834 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc4354-434b-424a-9988-634fb47809ed None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:10.645323 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc4354-434b-424a-9988-634fb47809ed None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:10.646243 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc4354-434b-424a-9988-634fb47809ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:10.646734 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc4354-434b-424a-9988-634fb47809ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:10.648571 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc4354-434b-424a-9988-634fb47809ed None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:10.671541 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 372/745] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:44:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:10.673607 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f7caf-c317-43a7-b8ba-7aecec88f5d4 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:10.674131 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f7caf-c317-43a7-b8ba-7aecec88f5d4 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:10.674575 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f7caf-c317-43a7-b8ba-7aecec88f5d4 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:10.677313 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 373/746] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:44:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:44:10.678616 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f7caf-c317-43a7-b8ba-7aecec88f5d4 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:10.781185 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665925b8-5d21-4615-b4e3-e490edc022f8 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:10.803958 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:10.827342 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d7ef9b-9fcd-4498-82b3-08a60773fd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:10.828125 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7ef9b-9fcd-4498-82b3-08a60773fd52 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:10.828410 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7ef9b-9fcd-4498-82b3-08a60773fd52 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:10.828683 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7ef9b-9fcd-4498-82b3-08a60773fd52 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:10.839097 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d7ef9b-9fcd-4498-82b3-08a60773fd52 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:10.840916 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d7ef9b-9fcd-4498-82b3-08a60773fd52 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:10.849628 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f7caf-c317-43a7-b8ba-7aecec88f5d4 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:10.852561 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:10.859836 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-c8d7ef9b-9fcd-4498-82b3-08a60773fd52 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 01 03:44:10.859836 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:10.859836 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:10.859836 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:10.859836 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:10.859836 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:10.859836 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:10.859836 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:10.859836 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:10.859836 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:10.859836 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:10.859836 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:10.859836 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 03:44:10.859836 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 03:44:10.859836 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 03:44:10.859836 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 03:44:10.865781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:10.865781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:10.865781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 03:44:10.865781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:44:10.865781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 03:44:10.865781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:44:10.865781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:10.865781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:10.865781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:10.865781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:10.865781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:10.865781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:10.865781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:10.865781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:10.865781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:10.865781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:10.865781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:10.865781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:10.866757 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:10.866757 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:10.866757 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 03:44:10.866757 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 03:44:10.866757 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 03:44:10.866757 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 03:44:10.866757 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 03:44:10.866757 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 03:44:10.866757 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 01 03:44:10.866757 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:10.866757 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 374/747] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 1 03:44:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:10.866757 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d7ef9b-9fcd-4498-82b3-08a60773fd52 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:10.907150 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ea617-5bf0-475d-8ce9-88a19b50a2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:10.908035 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ea617-5bf0-475d-8ce9-88a19b50a2cf None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:10.908553 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ea617-5bf0-475d-8ce9-88a19b50a2cf None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:10.908688 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ea617-5bf0-475d-8ce9-88a19b50a2cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:10.921605 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ea617-5bf0-475d-8ce9-88a19b50a2cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:10.923709 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ea617-5bf0-475d-8ce9-88a19b50a2cf None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:10.958543 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-4b2ea617-5bf0-475d-8ce9-88a19b50a2cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:10.958543 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:10.958543 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:10.958543 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:10.958543 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:10.958543 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:10.958543 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:10.958543 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:10.958543 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:10.958543 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:10.958543 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:10.958543 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:10.958543 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:44:10.958543 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:44:10.958543 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:44:10.960386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:44:10.960386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:10.960386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:10.960386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:10.960386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:10.960386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:10.960386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:10.960386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:10.960386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:10.960386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:10.960386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:10.960386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:10.960386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:10.960386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:10.960386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:10.960386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:10.960386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:10.962174 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:44:10.962174 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:44:10.962174 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:10.962174 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:10.962174 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 374/748] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:44:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:10.962174 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a28522-de05-4863-8779-ae39cb174f19 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:10.962828 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a28522-de05-4863-8779-ae39cb174f19 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:10.962828 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a28522-de05-4863-8779-ae39cb174f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:10.987628 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-81a28522-de05-4863-8779-ae39cb174f19 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:44:10.988897 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-81a28522-de05-4863-8779-ae39cb174f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:44:11.005695 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d7ef9b-9fcd-4498-82b3-08a60773fd52 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:11.081398 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1361e8-5ec8-48fa-9b5d-f7426fe196e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:11.083233 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1361e8-5ec8-48fa-9b5d-f7426fe196e2 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:11.083582 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1361e8-5ec8-48fa-9b5d-f7426fe196e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:11.084067 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1361e8-5ec8-48fa-9b5d-f7426fe196e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:11.099485 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 375/749] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:44:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:44:11.099485 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a28522-de05-4863-8779-ae39cb174f19 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:11.109271 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1361e8-5ec8-48fa-9b5d-f7426fe196e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:11.112708 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1361e8-5ec8-48fa-9b5d-f7426fe196e2 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:11.138702 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-df1361e8-5ec8-48fa-9b5d-f7426fe196e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:44:11.138702 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:11.138702 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:11.138702 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:11.138702 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:11.138702 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:11.138702 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:11.138702 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:11.138702 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:11.138702 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:11.138702 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:11.138702 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:11.138702 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 03:44:11.138702 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 03:44:11.138702 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 03:44:11.140538 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 03:44:11.140538 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:11.140538 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:11.140538 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:11.140538 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:11.140538 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:11.140538 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:11.140538 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:11.140538 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:11.140538 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:11.140538 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:11.140538 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:11.140538 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:11.140538 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:11.140538 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:11.140538 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:11.140538 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:11.142270 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 03:44:11.142270 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 03:44:11.142270 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 03:44:11.142270 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 03:44:11.142270 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 03:44:11.142270 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 03:44:11.142270 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:44:11.142270 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:11.142270 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 375/750] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:44:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:11.142270 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1361e8-5ec8-48fa-9b5d-f7426fe196e2 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:11.220177 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:11.262203 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:11.286616 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a28522-de05-4863-8779-ae39cb174f19 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:11.304275 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1361e8-5ec8-48fa-9b5d-f7426fe196e2 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:11.340744 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7efbd11-496a-4e11-9094-e3ef2708f1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:11.341316 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7efbd11-496a-4e11-9094-e3ef2708f1a9 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:11.341600 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7efbd11-496a-4e11-9094-e3ef2708f1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:11.341879 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7efbd11-496a-4e11-9094-e3ef2708f1a9 None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:11.342737 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7efbd11-496a-4e11-9094-e3ef2708f1a9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:11.343052 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7efbd11-496a-4e11-9094-e3ef2708f1a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:11.344641 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7efbd11-496a-4e11-9094-e3ef2708f1a9 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:11.352992 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed07069-61b3-4657-acfa-8d53e98ff3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:11.353663 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed07069-61b3-4657-acfa-8d53e98ff3bb None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:11.353940 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed07069-61b3-4657-acfa-8d53e98ff3bb None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:11.354212 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed07069-61b3-4657-acfa-8d53e98ff3bb None admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:11.354944 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed07069-61b3-4657-acfa-8d53e98ff3bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:11.355247 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed07069-61b3-4657-acfa-8d53e98ff3bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:11.356679 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed07069-61b3-4657-acfa-8d53e98ff3bb None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:11.364812 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 376/751] 10.222.0.46 () {56 vars in 1135 bytes} [Fri Jul 1 03:44:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:11.365455 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7efbd11-496a-4e11-9094-e3ef2708f1a9 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:11.374405 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 376/752] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:44:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:11.375878 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed07069-61b3-4657-acfa-8d53e98ff3bb None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:11.477411 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7efbd11-496a-4e11-9094-e3ef2708f1a9 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:11.520921 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:11.523689 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4383e7a-2911-4288-9c67-70897847955a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:11.525005 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4383e7a-2911-4288-9c67-70897847955a None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:11.525514 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4383e7a-2911-4288-9c67-70897847955a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:11.526016 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4383e7a-2911-4288-9c67-70897847955a None admin] PATH_INFO: `/v3/services/network` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:11.527309 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4383e7a-2911-4288-9c67-70897847955a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:11.527405 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed07069-61b3-4657-acfa-8d53e98ff3bb None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:11.530039 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4383e7a-2911-4288-9c67-70897847955a None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:11.552338 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-c4383e7a-2911-4288-9c67-70897847955a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 01 03:44:11.552338 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:11.552338 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 03:44:11.552338 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 03:44:11.552338 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 03:44:11.552338 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 03:44:11.552338 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 03:44:11.552338 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:44:11.552338 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 01 03:44:11.552338 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:11.552338 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 03:44:11.552338 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:11.552338 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:11.552338 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:11.552338 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:11.552338 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:11.552338 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:11.553603 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:11.553603 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:11.553603 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:11.553603 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:11.553603 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:11.553603 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:11.553603 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 03:44:11.553603 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 03:44:11.553603 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 03:44:11.553603 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 03:44:11.553603 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:11.553603 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:11.553603 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:11.553603 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:11.553603 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:11.553603 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:11.554451 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:11.554451 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:11.554451 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:11.554451 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:11.554451 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:11.554451 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:11.554451 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:11.554451 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:11.554451 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:11.554451 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:11.554451 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 03:44:11.554451 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:44:11.554451 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 01 03:44:11.554451 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:11.560585 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 377/753] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:44:11 2022] GET /identity/v3/services/network => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:11.560585 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195397a-19f4-4973-b496-2ce872b35134 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:11.560585 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195397a-19f4-4973-b496-2ce872b35134 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:11.560585 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195397a-19f4-4973-b496-2ce872b35134 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:11.561006 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 378/754] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:44:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:44:11.561992 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6195397a-19f4-4973-b496-2ce872b35134 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:11.564537 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df67280-fda2-4513-a82f-fad3969d2d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:11.565348 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df67280-fda2-4513-a82f-fad3969d2d7a None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:11.565753 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df67280-fda2-4513-a82f-fad3969d2d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:11.566097 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df67280-fda2-4513-a82f-fad3969d2d7a None admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:11.566976 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df67280-fda2-4513-a82f-fad3969d2d7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:11.567290 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df67280-fda2-4513-a82f-fad3969d2d7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:11.568870 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df67280-fda2-4513-a82f-fad3969d2d7a None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:11.578299 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:11.584076 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 377/755] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 1 03:44:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:11.584936 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df67280-fda2-4513-a82f-fad3969d2d7a None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:11.694237 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6195397a-19f4-4973-b496-2ce872b35134 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:11.706866 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df67280-fda2-4513-a82f-fad3969d2d7a None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:11.737675 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aeee50-ddab-49e8-bdcd-8c1f304e11f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:11.738844 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aeee50-ddab-49e8-bdcd-8c1f304e11f3 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:11.739345 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aeee50-ddab-49e8-bdcd-8c1f304e11f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:11.739887 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aeee50-ddab-49e8-bdcd-8c1f304e11f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:11.748414 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e014c04e-2bab-4c19-9566-42f15202a0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:11.749264 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014c04e-2bab-4c19-9566-42f15202a0c7 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:11.749547 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014c04e-2bab-4c19-9566-42f15202a0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:11.749824 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014c04e-2bab-4c19-9566-42f15202a0c7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:11.758443 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e014c04e-2bab-4c19-9566-42f15202a0c7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:11.760009 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e014c04e-2bab-4c19-9566-42f15202a0c7 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:11.778242 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-e014c04e-2bab-4c19-9566-42f15202a0c7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 01 03:44:11.778242 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:11.778242 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:11.778242 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:11.778242 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:11.778242 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:11.778242 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:11.778242 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:11.778242 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:11.778242 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:11.778242 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:11.778242 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:11.778242 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 03:44:11.778242 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 03:44:11.778242 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 03:44:11.778242 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 03:44:11.789446 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:11.789446 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:11.789446 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 03:44:11.789446 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:44:11.789446 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 03:44:11.789446 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:44:11.789446 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:11.789446 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:11.789446 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:11.789446 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:11.789446 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:11.789446 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:11.789446 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:11.789446 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:11.789446 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:11.789446 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:11.789446 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:11.789446 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:11.791333 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:11.791333 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:11.791333 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 03:44:11.791333 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 03:44:11.791333 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 03:44:11.791333 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 03:44:11.791333 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 03:44:11.791333 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 03:44:11.791333 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 01 03:44:11.791333 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:11.791333 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 378/756] 10.222.0.46 () {56 vars in 1117 bytes} [Fri Jul 1 03:44:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:11.791333 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e014c04e-2bab-4c19-9566-42f15202a0c7 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:11.802443 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:11.862489 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aeee50-ddab-49e8-bdcd-8c1f304e11f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:11.865675 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aeee50-ddab-49e8-bdcd-8c1f304e11f3 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:11.877098 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:11.901712 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e014c04e-2bab-4c19-9566-42f15202a0c7 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:11.948848 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cced0-c26a-4628-889d-c4ef267a0ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:11.949504 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cced0-c26a-4628-889d-c4ef267a0ded None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:11.949925 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cced0-c26a-4628-889d-c4ef267a0ded None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:11.950248 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cced0-c26a-4628-889d-c4ef267a0ded None admin] PATH_INFO: `/v3/services` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:11.951266 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244cced0-c26a-4628-889d-c4ef267a0ded None admin] RBAC: Adding query filter params (name=network) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:11.951755 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244cced0-c26a-4628-889d-c4ef267a0ded None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:11.953424 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244cced0-c26a-4628-889d-c4ef267a0ded None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:11.959853 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 379/757] 10.222.0.46 () {56 vars in 1112 bytes} [Fri Jul 1 03:44:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:11.961344 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4f5f3-8b4e-45cb-b999-5701ccbc62f3 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:11.961584 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4f5f3-8b4e-45cb-b999-5701ccbc62f3 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:11.961863 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4f5f3-8b4e-45cb-b999-5701ccbc62f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:11.981524 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-dfb4f5f3-8b4e-45cb-b999-5701ccbc62f3 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:44:11.982932 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-dfb4f5f3-8b4e-45cb-b999-5701ccbc62f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:44:11.990793 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 379/758] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:44:11 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 03:44:11.991658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aeee50-ddab-49e8-bdcd-8c1f304e11f3 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:12.065056 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 380/759] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:44:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:44:12.065921 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb4f5f3-8b4e-45cb-b999-5701ccbc62f3 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:12.082051 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:12.128517 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aeee50-ddab-49e8-bdcd-8c1f304e11f3 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:12.168519 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:12.199581 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb4f5f3-8b4e-45cb-b999-5701ccbc62f3 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:12.205875 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685cabe-9d2a-429d-a8ee-d19bd6000cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:12.207543 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685cabe-9d2a-429d-a8ee-d19bd6000cde None admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:12.208034 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685cabe-9d2a-429d-a8ee-d19bd6000cde None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:12.208531 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685cabe-9d2a-429d-a8ee-d19bd6000cde None admin] PATH_INFO: `/v3/projects/da83db15a312499fb627691ae442f233/users/2da466ad31d344898f5c838f77d45181/roles/681755518698445fabd9a8accec13c0f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:12.212082 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685cabe-9d2a-429d-a8ee-d19bd6000cde None admin] RBAC: Authorizing `identity:create_grant(project_id=da83db15a312499fb627691ae442f233, user_id=2da466ad31d344898f5c838f77d45181, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:12.214847 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685cabe-9d2a-429d-a8ee-d19bd6000cde None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:12.237357 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac29e9-b8b9-466c-99a2-4d59ec83d3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:12.238108 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac29e9-b8b9-466c-99a2-4d59ec83d3d2 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:12.238392 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac29e9-b8b9-466c-99a2-4d59ec83d3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:12.238667 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac29e9-b8b9-466c-99a2-4d59ec83d3d2 None admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:12.239582 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac29e9-b8b9-466c-99a2-4d59ec83d3d2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:12.239895 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac29e9-b8b9-466c-99a2-4d59ec83d3d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:12.241418 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac29e9-b8b9-466c-99a2-4d59ec83d3d2 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:12.263645 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 381/760] 10.222.0.46 () {56 vars in 1149 bytes} [Fri Jul 1 03:44:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:12.264513 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac29e9-b8b9-466c-99a2-4d59ec83d3d2 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:12.322236 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 380/761] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 1 03:44:11 2022] PUT /identity/v3/projects/da83db15a312499fb627691ae442f233/users/2da466ad31d344898f5c838f77d45181/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 03:44:12.323644 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685cabe-9d2a-429d-a8ee-d19bd6000cde None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:12.348136 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:12.390194 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac29e9-b8b9-466c-99a2-4d59ec83d3d2 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:12.441033 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7832c5a-e376-4c94-b43c-06531a4b8a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:12.442068 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7832c5a-e376-4c94-b43c-06531a4b8a95 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:12.442508 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7832c5a-e376-4c94-b43c-06531a4b8a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:12.442954 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7832c5a-e376-4c94-b43c-06531a4b8a95 None admin] PATH_INFO: `/v3/services` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:12.443904 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7832c5a-e376-4c94-b43c-06531a4b8a95 None admin] RBAC: Adding query filter params (type=network) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:12.444372 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7832c5a-e376-4c94-b43c-06531a4b8a95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:12.445953 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7832c5a-e376-4c94-b43c-06531a4b8a95 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:12.452873 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 382/762] 10.222.0.46 () {56 vars in 1112 bytes} [Fri Jul 1 03:44:12 2022] GET /identity/v3/services?type=network => generated 350 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:12.454016 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7832c5a-e376-4c94-b43c-06531a4b8a95 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:12.523816 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685cabe-9d2a-429d-a8ee-d19bd6000cde None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:12.590034 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc5df2-c099-460e-86d9-4f00acf94a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:12.591477 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc5df2-c099-460e-86d9-4f00acf94a48 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:12.591957 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc5df2-c099-460e-86d9-4f00acf94a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:12.592418 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc5df2-c099-460e-86d9-4f00acf94a48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:12.612329 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc5df2-c099-460e-86d9-4f00acf94a48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:12.615075 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc5df2-c099-460e-86d9-4f00acf94a48 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:12.624966 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7832c5a-e376-4c94-b43c-06531a4b8a95 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:12.649739 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-5ccc5df2-c099-460e-86d9-4f00acf94a48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:12.649739 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:12.649739 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:12.649739 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:12.649739 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:12.649739 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:12.649739 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:12.649739 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:12.649739 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:12.649739 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:12.649739 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:12.649739 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:12.649739 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:44:12.649739 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:44:12.649739 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:44:12.650784 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:44:12.650784 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:12.650784 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:12.650784 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:12.650784 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:12.650784 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:12.650784 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:12.650784 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:12.650784 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:12.650784 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:12.650784 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:12.650784 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:12.650784 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:12.650784 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:12.650784 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:12.650784 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:12.650784 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:12.651883 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:44:12.651883 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:44:12.651883 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:12.651883 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:12.652349 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 381/763] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:44:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:12.653769 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc5df2-c099-460e-86d9-4f00acf94a48 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:12.670511 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:12.679264 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:12.679700 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f65218c-5343-4506-94e1-5ba0721f3a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:12.680578 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65218c-5343-4506-94e1-5ba0721f3a67 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:12.680999 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65218c-5343-4506-94e1-5ba0721f3a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:12.681371 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65218c-5343-4506-94e1-5ba0721f3a67 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:12.683735 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f65218c-5343-4506-94e1-5ba0721f3a67 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:12.684641 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f65218c-5343-4506-94e1-5ba0721f3a67 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:12.699917 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-4f65218c-5343-4506-94e1-5ba0721f3a67 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 01 03:44:12.699917 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:12.699917 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 03:44:12.699917 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 03:44:12.699917 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 03:44:12.699917 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 03:44:12.699917 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 03:44:12.699917 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:44:12.699917 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 01 03:44:12.699917 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:12.699917 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 03:44:12.699917 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:12.699917 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:12.699917 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:12.699917 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:12.699917 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:12.708027 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:12.708027 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:12.708027 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:12.708027 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:12.708027 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:12.708027 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:12.708027 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:12.708027 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 03:44:12.708027 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 03:44:12.708027 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 03:44:12.708027 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 03:44:12.708027 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:12.708027 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:12.708027 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:12.708027 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:12.708027 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:12.708886 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:12.708886 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:12.708886 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:12.708886 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:12.708886 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:12.708886 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:12.708886 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:12.708886 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:12.708886 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:12.708886 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:12.708886 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:12.708886 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 03:44:12.708886 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:44:12.708886 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 01 03:44:12.708886 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:12.708886 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 383/764] 10.222.0.46 () {56 vars in 1129 bytes} [Fri Jul 1 03:44:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:12.709721 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f65218c-5343-4506-94e1-5ba0721f3a67 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:12.808747 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc5df2-c099-460e-86d9-4f00acf94a48 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:12.841141 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f65218c-5343-4506-94e1-5ba0721f3a67 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:12.848672 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528df032-df14-4788-a3a4-22d751ede23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:12.849328 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528df032-df14-4788-a3a4-22d751ede23c None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:12.849611 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528df032-df14-4788-a3a4-22d751ede23c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:12.849888 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528df032-df14-4788-a3a4-22d751ede23c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:12.901547 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b605d-215e-455c-89e5-d335bc6c7066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:12.903567 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b605d-215e-455c-89e5-d335bc6c7066 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:12.904060 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b605d-215e-455c-89e5-d335bc6c7066 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:12.904743 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b605d-215e-455c-89e5-d335bc6c7066 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:12.906271 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b605d-215e-455c-89e5-d335bc6c7066 None admin] RBAC: Adding query filter params (interface=public, service_id=80f4099bfe404625be999db7c24f615f, region_id=RegionOne) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:12.906835 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b605d-215e-455c-89e5-d335bc6c7066 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:12.909966 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b605d-215e-455c-89e5-d335bc6c7066 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:12.926643 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 384/765] 10.222.0.46 () {56 vars in 1251 bytes} [Fri Jul 1 03:44:12 2022] GET /identity/v3/endpoints?service_id=80f4099bfe404625be999db7c24f615f&interface=public®ion_id=RegionOne => generated 194 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:12.928276 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b605d-215e-455c-89e5-d335bc6c7066 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:12.939434 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528df032-df14-4788-a3a4-22d751ede23c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:12.940947 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528df032-df14-4788-a3a4-22d751ede23c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:12.966892 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:13.039495 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:13.097086 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 382/766] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:44:12 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 03:44:13.097782 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b605d-215e-455c-89e5-d335bc6c7066 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:13.098631 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528df032-df14-4788-a3a4-22d751ede23c None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:13.144264 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434a21b-3c5f-4f66-a131-85f8356891d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:13.144944 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434a21b-3c5f-4f66-a131-85f8356891d4 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:13.145224 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434a21b-3c5f-4f66-a131-85f8356891d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:13.145502 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434a21b-3c5f-4f66-a131-85f8356891d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:13.146233 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434a21b-3c5f-4f66-a131-85f8356891d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:13.146539 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434a21b-3c5f-4f66-a131-85f8356891d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:13.148057 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434a21b-3c5f-4f66-a131-85f8356891d4 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:13.163281 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 385/767] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:44:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:13.164188 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434a21b-3c5f-4f66-a131-85f8356891d4 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:13.235756 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528df032-df14-4788-a3a4-22d751ede23c None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:13.258059 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:13.282448 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c05d13-cc9f-45a5-8145-1e0552327bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:13.283722 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c05d13-cc9f-45a5-8145-1e0552327bd2 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:13.283996 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c05d13-cc9f-45a5-8145-1e0552327bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:13.284271 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c05d13-cc9f-45a5-8145-1e0552327bd2 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:13.285019 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c05d13-cc9f-45a5-8145-1e0552327bd2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:13.285324 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c05d13-cc9f-45a5-8145-1e0552327bd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:13.286723 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c05d13-cc9f-45a5-8145-1e0552327bd2 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:13.293689 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 383/768] 10.222.0.46 () {56 vars in 1124 bytes} [Fri Jul 1 03:44:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:13.294318 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c05d13-cc9f-45a5-8145-1e0552327bd2 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:13.306806 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434a21b-3c5f-4f66-a131-85f8356891d4 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:13.333967 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:13.352957 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec90a9e-150d-412e-bf3d-a878fdbd3106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:13.354017 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec90a9e-150d-412e-bf3d-a878fdbd3106 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:13.354442 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec90a9e-150d-412e-bf3d-a878fdbd3106 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:13.354906 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec90a9e-150d-412e-bf3d-a878fdbd3106 None admin] PATH_INFO: `/v3/services` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:13.355903 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec90a9e-150d-412e-bf3d-a878fdbd3106 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:13.357639 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec90a9e-150d-412e-bf3d-a878fdbd3106 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:13.364811 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 386/769] 10.222.0.46 () {56 vars in 1087 bytes} [Fri Jul 1 03:44:13 2022] GET /identity/v3/services => generated 772 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:13.365785 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec90a9e-150d-412e-bf3d-a878fdbd3106 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:13.499066 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c05d13-cc9f-45a5-8145-1e0552327bd2 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:13.560739 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec90a9e-150d-412e-bf3d-a878fdbd3106 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:13.576620 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b9b9b-61b1-42c8-9303-4e66053c9cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:13.577880 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b9b9b-61b1-42c8-9303-4e66053c9cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:13.578280 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b9b9b-61b1-42c8-9303-4e66053c9cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:13.578738 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b9b9b-61b1-42c8-9303-4e66053c9cc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:13.599412 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b9b9b-61b1-42c8-9303-4e66053c9cc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:13.601274 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b9b9b-61b1-42c8-9303-4e66053c9cc9 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:13.622988 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc080ca-a3f3-4b0e-8bba-43bafe43128b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:13.624912 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc080ca-a3f3-4b0e-8bba-43bafe43128b None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:13.625733 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc080ca-a3f3-4b0e-8bba-43bafe43128b None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:13.626991 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc080ca-a3f3-4b0e-8bba-43bafe43128b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:13.637093 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-897b9b9b-61b1-42c8-9303-4e66053c9cc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:13.637093 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:13.637093 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:13.637093 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:13.637093 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:13.637093 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:13.637093 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:13.637093 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:13.637093 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:13.637093 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:13.637093 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:13.637093 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:13.637093 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:44:13.637093 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:44:13.637093 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:44:13.638902 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:44:13.638902 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:13.638902 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:13.638902 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:13.638902 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:13.638902 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:13.638902 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:13.638902 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:13.638902 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:13.638902 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:13.638902 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:13.638902 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:13.638902 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:13.638902 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:13.638902 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:13.638902 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:13.638902 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:13.640702 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:44:13.640702 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:44:13.640702 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:13.640702 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:13.640702 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 384/770] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:44:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:13.641245 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b9b9b-61b1-42c8-9303-4e66053c9cc9 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:13.646894 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc080ca-a3f3-4b0e-8bba-43bafe43128b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:13.651353 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc080ca-a3f3-4b0e-8bba-43bafe43128b None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:13.684307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-3bc080ca-a3f3-4b0e-8bba-43bafe43128b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:44:13.684307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:13.684307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:13.684307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:13.684307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:13.684307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:13.684307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:13.684307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:13.684307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:13.684307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:13.684307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:13.684307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:13.684307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 03:44:13.684307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 03:44:13.684307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 03:44:13.685448 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 03:44:13.685448 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:13.685448 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:13.685448 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:13.685448 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:13.685448 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:13.685448 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:13.685448 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:13.685448 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:13.685448 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:13.685448 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:13.685448 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:13.685448 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:13.685448 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:13.685448 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:13.685448 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:13.685448 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:13.686336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 03:44:13.686336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 03:44:13.686336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 03:44:13.686336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 03:44:13.686336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 03:44:13.686336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 03:44:13.686336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:44:13.686336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:13.693925 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 387/771] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:44:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:13.693925 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc080ca-a3f3-4b0e-8bba-43bafe43128b None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:13.716270 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:13.763705 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:13.830198 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc080ca-a3f3-4b0e-8bba-43bafe43128b None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:13.837790 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b9b9b-61b1-42c8-9303-4e66053c9cc9 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:13.872656 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b976f-a7e0-45b9-b399-f7128b9128db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:13.874309 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b976f-a7e0-45b9-b399-f7128b9128db None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:13.874828 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b976f-a7e0-45b9-b399-f7128b9128db None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:13.875302 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b976f-a7e0-45b9-b399-f7128b9128db None admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:13.876419 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3b976f-a7e0-45b9-b399-f7128b9128db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:13.877098 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3b976f-a7e0-45b9-b399-f7128b9128db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:13.878843 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3b976f-a7e0-45b9-b399-f7128b9128db None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:13.882250 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2014a23-fbb4-423e-8abe-3fdf8dff33b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:13.882942 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2014a23-fbb4-423e-8abe-3fdf8dff33b2 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:13.883223 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2014a23-fbb4-423e-8abe-3fdf8dff33b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:13.883513 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2014a23-fbb4-423e-8abe-3fdf8dff33b2 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:13.884229 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2014a23-fbb4-423e-8abe-3fdf8dff33b2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:13.884533 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2014a23-fbb4-423e-8abe-3fdf8dff33b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:13.885990 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2014a23-fbb4-423e-8abe-3fdf8dff33b2 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:13.894288 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 388/772] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:44:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:13.895828 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b976f-a7e0-45b9-b399-f7128b9128db None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:13.901181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 385/773] 10.222.0.46 () {56 vars in 1124 bytes} [Fri Jul 1 03:44:13 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:13.902400 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2014a23-fbb4-423e-8abe-3fdf8dff33b2 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:14.031031 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b976f-a7e0-45b9-b399-f7128b9128db None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:14.031630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:14.034651 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:14.037930 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2014a23-fbb4-423e-8abe-3fdf8dff33b2 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:14.068892 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99fa04-806b-4ca3-b93c-10c707146d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:14.069564 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99fa04-806b-4ca3-b93c-10c707146d9b None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:14.069844 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99fa04-806b-4ca3-b93c-10c707146d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:14.070118 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99fa04-806b-4ca3-b93c-10c707146d9b None admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:14.071216 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab99fa04-806b-4ca3-b93c-10c707146d9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:14.071544 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab99fa04-806b-4ca3-b93c-10c707146d9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:14.073338 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab99fa04-806b-4ca3-b93c-10c707146d9b None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:14.077910 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d70b2b-5571-4662-9125-a432a7a50d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:14.079035 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d70b2b-5571-4662-9125-a432a7a50d54 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:14.080033 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d70b2b-5571-4662-9125-a432a7a50d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:14.081123 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d70b2b-5571-4662-9125-a432a7a50d54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:14.091535 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 389/774] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 1 03:44:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:14.091535 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99fa04-806b-4ca3-b93c-10c707146d9b None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:14.094855 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d70b2b-5571-4662-9125-a432a7a50d54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:14.097214 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d70b2b-5571-4662-9125-a432a7a50d54 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:14.113681 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-45d70b2b-5571-4662-9125-a432a7a50d54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:44:14.113681 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:14.113681 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:14.113681 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:14.113681 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:14.113681 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:14.113681 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:14.113681 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:14.113681 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:14.113681 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:14.113681 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:14.113681 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:14.113681 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 03:44:14.113681 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 03:44:14.113681 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 03:44:14.114658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 03:44:14.114658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:14.114658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:14.114658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:14.114658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:14.114658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:14.114658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:14.114658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:14.114658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:14.114658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:14.114658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:14.114658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:14.114658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:14.114658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:14.114658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:14.114658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:14.114658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:14.116026 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 03:44:14.116026 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 03:44:14.116026 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 03:44:14.116026 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 03:44:14.116026 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 03:44:14.116026 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 03:44:14.116026 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:44:14.116026 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:14.118396 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 386/775] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:44:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:14.119538 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d70b2b-5571-4662-9125-a432a7a50d54 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:14.209472 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99fa04-806b-4ca3-b93c-10c707146d9b None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:14.234670 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d70b2b-5571-4662-9125-a432a7a50d54 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:14.247483 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85361b-6e9b-4d54-b59f-16d30c7a42c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:14.248176 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85361b-6e9b-4d54-b59f-16d30c7a42c4 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:14.248456 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85361b-6e9b-4d54-b59f-16d30c7a42c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:14.248781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85361b-6e9b-4d54-b59f-16d30c7a42c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:14.249570 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85361b-6e9b-4d54-b59f-16d30c7a42c4 None admin] RBAC: Adding query filter params (interface=public, service_id=798cdd0726dc43d391ee8df5f3c1f8e3, region_id=RegionOne) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:14.249883 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85361b-6e9b-4d54-b59f-16d30c7a42c4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:14.252097 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85361b-6e9b-4d54-b59f-16d30c7a42c4 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:14.262939 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 390/776] 10.222.0.46 () {56 vars in 1251 bytes} [Fri Jul 1 03:44:14 2022] GET /identity/v3/endpoints?service_id=798cdd0726dc43d391ee8df5f3c1f8e3&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:14.264065 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85361b-6e9b-4d54-b59f-16d30c7a42c4 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:14.275828 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f7271b-1e7a-44f2-85d2-4cf583779f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:14.276877 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7271b-1e7a-44f2-85d2-4cf583779f2d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:14.277391 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7271b-1e7a-44f2-85d2-4cf583779f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:14.277871 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7271b-1e7a-44f2-85d2-4cf583779f2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:14.278915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f7271b-1e7a-44f2-85d2-4cf583779f2d None admin] RBAC: Adding query filter params (role.id=681755518698445fabd9a8accec13c0f, scope.project.id=da83db15a312499fb627691ae442f233, user.id=83787880173b459c8975b834bd47a51a) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:14.279444 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f7271b-1e7a-44f2-85d2-4cf583779f2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:14.281228 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f7271b-1e7a-44f2-85d2-4cf583779f2d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:14.295595 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 387/777] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:44:14 2022] GET /identity/v3/role_assignments?user.id=83787880173b459c8975b834bd47a51a&scope.project.id=da83db15a312499fb627691ae442f233&role.id=681755518698445fabd9a8accec13c0f => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:14.296923 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f7271b-1e7a-44f2-85d2-4cf583779f2d None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:14.297223 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:14.339820 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:14.385617 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85361b-6e9b-4d54-b59f-16d30c7a42c4 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:14.433850 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92012b0-caae-49bb-83ec-1b4af61f1c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:14.434863 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92012b0-caae-49bb-83ec-1b4af61f1c62 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:14.435286 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92012b0-caae-49bb-83ec-1b4af61f1c62 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:14.435757 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92012b0-caae-49bb-83ec-1b4af61f1c62 None admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:14.436861 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92012b0-caae-49bb-83ec-1b4af61f1c62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:14.437466 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92012b0-caae-49bb-83ec-1b4af61f1c62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:14.439821 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92012b0-caae-49bb-83ec-1b4af61f1c62 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:14.455300 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 391/778] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 1 03:44:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:14.461698 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92012b0-caae-49bb-83ec-1b4af61f1c62 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:14.495831 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f7271b-1e7a-44f2-85d2-4cf583779f2d None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:14.575099 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573265a5-45d7-4807-bf64-d2ec7eedaf62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:14.575740 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573265a5-45d7-4807-bf64-d2ec7eedaf62 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:14.576053 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573265a5-45d7-4807-bf64-d2ec7eedaf62 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:14.576397 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573265a5-45d7-4807-bf64-d2ec7eedaf62 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:14.577118 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573265a5-45d7-4807-bf64-d2ec7eedaf62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:14.578549 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573265a5-45d7-4807-bf64-d2ec7eedaf62 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:14.587292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:14.593340 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 388/779] 10.222.0.46 () {56 vars in 1087 bytes} [Fri Jul 1 03:44:14 2022] GET /identity/v3/services => generated 772 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:14.601449 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92012b0-caae-49bb-83ec-1b4af61f1c62 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:14.647028 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e5519-0c6b-4be4-8f00-3a198be4f57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:14.647805 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e5519-0c6b-4be4-8f00-3a198be4f57a None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:14.648135 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e5519-0c6b-4be4-8f00-3a198be4f57a None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:14.648666 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e5519-0c6b-4be4-8f00-3a198be4f57a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:14.649708 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e5519-0c6b-4be4-8f00-3a198be4f57a None admin] RBAC: Adding query filter params (role.id=66426d7dd6f64f6ebfcb1cbb8188b0d2, scope.project.id=da83db15a312499fb627691ae442f233, user.id=dd41221abea04808bed5ef4ac4528c62) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:14.650415 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e5519-0c6b-4be4-8f00-3a198be4f57a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:14.651957 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e5519-0c6b-4be4-8f00-3a198be4f57a None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:14.658958 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 392/780] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:44:14 2022] GET /identity/v3/role_assignments?user.id=dd41221abea04808bed5ef4ac4528c62&scope.project.id=da83db15a312499fb627691ae442f233&role.id=66426d7dd6f64f6ebfcb1cbb8188b0d2 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:14.667629 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bc0eb-8701-4a3e-b674-99ec2b6e666c None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:14.667955 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bc0eb-8701-4a3e-b674-99ec2b6e666c None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:14.668208 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bc0eb-8701-4a3e-b674-99ec2b6e666c None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:14.674934 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 389/781] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:44:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:44:14.676989 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc942b2-a6ce-4d99-a9ff-6de08153db7a None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:14.677286 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc942b2-a6ce-4d99-a9ff-6de08153db7a None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:14.677562 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc942b2-a6ce-4d99-a9ff-6de08153db7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:14.697285 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-7cc942b2-a6ce-4d99-a9ff-6de08153db7a None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:44:14.698572 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-7cc942b2-a6ce-4d99-a9ff-6de08153db7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:44:14.792388 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 393/782] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:44:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:44:14.817452 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4bc0eb-8701-4a3e-b674-99ec2b6e666c None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:14.931795 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:14.951786 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4bc0eb-8701-4a3e-b674-99ec2b6e666c None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:14.996169 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860503d1-1261-4799-8ac9-16fefac6e1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:14.996986 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860503d1-1261-4799-8ac9-16fefac6e1bc None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:14.997265 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860503d1-1261-4799-8ac9-16fefac6e1bc None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:14.997540 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860503d1-1261-4799-8ac9-16fefac6e1bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:15.020566 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860503d1-1261-4799-8ac9-16fefac6e1bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:44:15.028374 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-860503d1-1261-4799-8ac9-16fefac6e1bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:44:15.028374 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:15.028374 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:15.028374 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:15.028374 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:15.028374 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:15.028374 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:15.028374 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:15.028374 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:15.028374 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:15.028374 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:15.028374 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:15.028374 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:44:15.028374 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:44:15.028374 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:44:15.028374 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:44:15.029350 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:44:15.029350 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:44:15.029350 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:44:15.029350 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:44:15.029350 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:15.029350 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:15.029350 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:15.029350 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:15.029350 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:15.029350 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:15.029350 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:15.029350 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:15.029350 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:15.029350 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:15.029350 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:15.029350 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:15.030189 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:15.030189 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:15.030189 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:15.030189 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:15.030189 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:44:15.030189 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:44:15.030189 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:44:15.030189 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:44:15.030189 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:44:15.030189 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:44:15.030189 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:44:15.030189 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:15.030189 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 390/783] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 1 03:44:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:15.036382 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc942b2-a6ce-4d99-a9ff-6de08153db7a None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:15.157228 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:15.184546 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc942b2-a6ce-4d99-a9ff-6de08153db7a None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:15.245306 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f54146-1e83-4f85-9cee-f7d14204f8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:15.245999 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f54146-1e83-4f85-9cee-f7d14204f8df None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:15.246281 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f54146-1e83-4f85-9cee-f7d14204f8df None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:15.246558 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f54146-1e83-4f85-9cee-f7d14204f8df None admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:15.247322 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f54146-1e83-4f85-9cee-f7d14204f8df None admin] RBAC: Adding query filter params (name=admin) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:15.247657 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f54146-1e83-4f85-9cee-f7d14204f8df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:15.249034 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f54146-1e83-4f85-9cee-f7d14204f8df None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:15.270183 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 394/784] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:44:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:15.275682 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860503d1-1261-4799-8ac9-16fefac6e1bc None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:15.428753 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860503d1-1261-4799-8ac9-16fefac6e1bc None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:15.481633 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f666f3-6400-4e83-9c82-0755fef86d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:15.482377 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f666f3-6400-4e83-9c82-0755fef86d2e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:15.482660 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f666f3-6400-4e83-9c82-0755fef86d2e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:15.482937 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f666f3-6400-4e83-9c82-0755fef86d2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:15.504835 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f666f3-6400-4e83-9c82-0755fef86d2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:15.506349 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f666f3-6400-4e83-9c82-0755fef86d2e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:15.523488 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:15.538995 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-a6f666f3-6400-4e83-9c82-0755fef86d2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:15.538995 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:15.538995 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:15.538995 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:15.538995 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:15.538995 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:15.538995 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:15.538995 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:15.538995 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:15.538995 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:15.538995 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:15.538995 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:15.538995 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:44:15.538995 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:44:15.538995 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:44:15.540998 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:44:15.540998 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:15.540998 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:15.540998 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:15.540998 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:15.540998 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:15.540998 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:15.540998 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:15.540998 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:15.540998 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:15.540998 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:15.540998 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:15.540998 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:15.540998 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:15.540998 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:15.540998 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:15.540998 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:15.541887 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:44:15.541887 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:44:15.541887 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:15.541887 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:15.541887 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 391/785] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:44:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:15.547191 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f54146-1e83-4f85-9cee-f7d14204f8df None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:15.772214 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f54146-1e83-4f85-9cee-f7d14204f8df None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:15.830613 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa3aa5-ab16-4260-81d5-ea542765f255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:15.831808 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa3aa5-ab16-4260-81d5-ea542765f255 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:15.832323 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa3aa5-ab16-4260-81d5-ea542765f255 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:15.832819 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa3aa5-ab16-4260-81d5-ea542765f255 None admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:15.834065 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa3aa5-ab16-4260-81d5-ea542765f255 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:15.834515 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa3aa5-ab16-4260-81d5-ea542765f255 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:15.836867 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa3aa5-ab16-4260-81d5-ea542765f255 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:15.857013 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 395/786] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:44:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:15.863915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f666f3-6400-4e83-9c82-0755fef86d2e None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:15.877569 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da611c13-a834-46cb-bbfc-5d81565c763b None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:15.877892 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da611c13-a834-46cb-bbfc-5d81565c763b None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:15.878141 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da611c13-a834-46cb-bbfc-5d81565c763b None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:15.879909 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 396/787] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:44:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 03:44:15.891306 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f909cb-e9cf-4d51-a2e6-bc95c91dbc72 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:15.891753 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f909cb-e9cf-4d51-a2e6-bc95c91dbc72 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:15.892471 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f909cb-e9cf-4d51-a2e6-bc95c91dbc72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:15.908531 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:15.937008 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-72f909cb-e9cf-4d51-a2e6-bc95c91dbc72 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:44:15.938224 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-72f909cb-e9cf-4d51-a2e6-bc95c91dbc72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:44:16.039822 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f666f3-6400-4e83-9c82-0755fef86d2e None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:16.084065 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 397/788] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:44:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 03:44:16.102332 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9b56b-3ba6-4060-a7a9-147d6620cbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:16.103400 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9b56b-3ba6-4060-a7a9-147d6620cbbc None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:16.103879 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9b56b-3ba6-4060-a7a9-147d6620cbbc None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:16.104298 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9b56b-3ba6-4060-a7a9-147d6620cbbc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:16.118838 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9b56b-3ba6-4060-a7a9-147d6620cbbc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:16.120812 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9b56b-3ba6-4060-a7a9-147d6620cbbc None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:16.141632 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-b2a9b56b-3ba6-4060-a7a9-147d6620cbbc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 01 03:44:16.141632 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:16.141632 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:16.141632 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:16.141632 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:16.141632 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:16.141632 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:16.141632 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:16.141632 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:16.141632 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:16.141632 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:16.141632 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:16.141632 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 03:44:16.141632 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 03:44:16.141632 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 03:44:16.141632 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 03:44:16.143368 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:16.143368 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:16.143368 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 03:44:16.143368 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:44:16.143368 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 03:44:16.143368 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:44:16.143368 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:16.143368 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:16.143368 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:16.143368 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:16.143368 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:16.143368 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:16.143368 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:16.143368 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:16.143368 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:16.143368 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:16.143368 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:16.143368 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:16.144595 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:16.144595 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:16.144595 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 03:44:16.144595 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 03:44:16.144595 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 03:44:16.144595 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 03:44:16.144595 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 03:44:16.144595 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 03:44:16.144595 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 01 03:44:16.144595 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:16.147007 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 392/789] 10.222.0.46 () {56 vars in 1093 bytes} [Fri Jul 1 03:44:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:16.153044 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f909cb-e9cf-4d51-a2e6-bc95c91dbc72 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:16.154105 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9b56b-3ba6-4060-a7a9-147d6620cbbc None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:16.219441 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:16.296213 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f909cb-e9cf-4d51-a2e6-bc95c91dbc72 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:16.323173 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9b56b-3ba6-4060-a7a9-147d6620cbbc None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:16.356794 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894b74b-3dcc-4921-a662-4a3ffc3be2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:16.357534 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894b74b-3dcc-4921-a662-4a3ffc3be2e1 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:16.357763 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894b74b-3dcc-4921-a662-4a3ffc3be2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:16.358229 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894b74b-3dcc-4921-a662-4a3ffc3be2e1 None admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:16.359112 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5894b74b-3dcc-4921-a662-4a3ffc3be2e1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:16.359425 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5894b74b-3dcc-4921-a662-4a3ffc3be2e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:16.360944 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5894b74b-3dcc-4921-a662-4a3ffc3be2e1 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:16.362924 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:16.365215 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adda4a5-2be7-43d6-970a-5a9d4bff3e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:16.366282 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adda4a5-2be7-43d6-970a-5a9d4bff3e07 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:16.366774 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adda4a5-2be7-43d6-970a-5a9d4bff3e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:16.367273 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adda4a5-2be7-43d6-970a-5a9d4bff3e07 None admin] PATH_INFO: `/v3/services/network` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:16.368186 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adda4a5-2be7-43d6-970a-5a9d4bff3e07 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:16.369810 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adda4a5-2be7-43d6-970a-5a9d4bff3e07 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:16.383767 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-5adda4a5-2be7-43d6-970a-5a9d4bff3e07 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 01 03:44:16.383767 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:16.383767 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 03:44:16.383767 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 03:44:16.383767 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 03:44:16.383767 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 03:44:16.383767 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 03:44:16.383767 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:44:16.383767 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 01 03:44:16.383767 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:16.383767 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 03:44:16.383767 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:16.383767 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:16.383767 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:16.383767 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:16.383767 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:16.383767 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:16.384838 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:16.384838 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:16.384838 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:16.384838 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:16.384838 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:16.384838 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:16.384838 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 03:44:16.384838 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 03:44:16.384838 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 03:44:16.384838 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 03:44:16.384838 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:16.384838 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:16.384838 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:16.384838 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:16.384838 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:16.384838 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:16.385679 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:16.385679 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:16.385679 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:16.385679 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:16.385679 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:16.385679 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:16.385679 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:16.385679 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:16.385679 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:16.385679 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:16.385679 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 03:44:16.385679 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:44:16.385679 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 01 03:44:16.385679 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:16.388710 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 393/790] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:44:16 2022] GET /identity/v3/services/network => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 03:44:16.396622 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adda4a5-2be7-43d6-970a-5a9d4bff3e07 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:16.403583 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 398/791] 10.222.0.46 () {56 vars in 1133 bytes} [Fri Jul 1 03:44:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:44:16.404525 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894b74b-3dcc-4921-a662-4a3ffc3be2e1 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:16.580611 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894b74b-3dcc-4921-a662-4a3ffc3be2e1 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:16.627238 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adda4a5-2be7-43d6-970a-5a9d4bff3e07 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:16.648668 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f647f3-93e1-4b58-9d14-812c4522cfbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:16.649690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f647f3-93e1-4b58-9d14-812c4522cfbd None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:16.650173 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f647f3-93e1-4b58-9d14-812c4522cfbd None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:16.650672 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f647f3-93e1-4b58-9d14-812c4522cfbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:16.677089 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:16.698156 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff63f3-c6aa-488f-a17a-1a126ef136d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:16.698844 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff63f3-c6aa-488f-a17a-1a126ef136d7 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:16.701030 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff63f3-c6aa-488f-a17a-1a126ef136d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:16.701030 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff63f3-c6aa-488f-a17a-1a126ef136d7 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:16.701030 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ff63f3-c6aa-488f-a17a-1a126ef136d7 None admin] RBAC: Adding query filter params (name=network) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:16.701030 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ff63f3-c6aa-488f-a17a-1a126ef136d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:16.701885 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ff63f3-c6aa-488f-a17a-1a126ef136d7 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:16.707647 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 394/792] 10.222.0.46 () {56 vars in 1112 bytes} [Fri Jul 1 03:44:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:16.713606 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff63f3-c6aa-488f-a17a-1a126ef136d7 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:16.788980 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:16.812061 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f647f3-93e1-4b58-9d14-812c4522cfbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:16.813660 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f647f3-93e1-4b58-9d14-812c4522cfbd None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:16.861872 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff63f3-c6aa-488f-a17a-1a126ef136d7 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:16.976403 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 399/793] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:44:16 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 03:44:16.983509 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f647f3-93e1-4b58-9d14-812c4522cfbd None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:16.993539 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d9e7a-95bd-45e8-96d6-2380d82af426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:16.994233 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d9e7a-95bd-45e8-96d6-2380d82af426 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:16.994519 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d9e7a-95bd-45e8-96d6-2380d82af426 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:16.994793 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d9e7a-95bd-45e8-96d6-2380d82af426 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:16.995535 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900d9e7a-95bd-45e8-96d6-2380d82af426 None admin] RBAC: Adding query filter params (type=network) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:16.995840 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900d9e7a-95bd-45e8-96d6-2380d82af426 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:16.997244 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900d9e7a-95bd-45e8-96d6-2380d82af426 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:17.011550 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 395/794] 10.222.0.46 () {56 vars in 1112 bytes} [Fri Jul 1 03:44:16 2022] GET /identity/v3/services?type=network => generated 350 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:17.016588 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d9e7a-95bd-45e8-96d6-2380d82af426 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:17.127722 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:17.172048 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:17.179803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f647f3-93e1-4b58-9d14-812c4522cfbd None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:17.239575 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d9e7a-95bd-45e8-96d6-2380d82af426 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:17.241652 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb75707-b510-40c0-8346-3044eb9643cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:17.243549 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb75707-b510-40c0-8346-3044eb9643cc None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:17.243840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb75707-b510-40c0-8346-3044eb9643cc None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:17.244135 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb75707-b510-40c0-8346-3044eb9643cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:17.258331 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb75707-b510-40c0-8346-3044eb9643cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:17.260013 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb75707-b510-40c0-8346-3044eb9643cc None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:17.280960 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594755da-180c-4b88-997e-291a948181a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:17.281628 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594755da-180c-4b88-997e-291a948181a7 None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:17.281910 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594755da-180c-4b88-997e-291a948181a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:17.282187 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594755da-180c-4b88-997e-291a948181a7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:17.282984 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594755da-180c-4b88-997e-291a948181a7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:17.283197 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-ceb75707-b510-40c0-8346-3044eb9643cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:17.283197 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:17.283197 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:17.283197 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:17.283197 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:17.283197 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:17.283197 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:17.283197 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:17.283197 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:17.283197 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:17.283197 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:17.283197 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:17.283197 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:44:17.283197 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:44:17.283197 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:44:17.284078 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:44:17.284078 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:17.284078 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:17.284078 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:17.284078 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:17.284078 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:17.284078 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:17.284078 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:17.284078 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:17.284078 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:17.284078 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:17.284078 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:17.284078 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:17.284078 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:17.284078 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:17.284078 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:17.284078 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:17.285395 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:44:17.285395 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:44:17.285395 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:17.285395 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:17.285619 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594755da-180c-4b88-997e-291a948181a7 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:17.285689 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 400/795] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:44:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:17.286497 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772fb72-9459-4abd-92b0-c87c033a68d7 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:17.286497 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772fb72-9459-4abd-92b0-c87c033a68d7 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:17.286685 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772fb72-9459-4abd-92b0-c87c033a68d7 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:17.292486 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 401/796] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:44:17.293470 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772fb72-9459-4abd-92b0-c87c033a68d7 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:17.393581 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 396/797] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 1 03:44:17 2022] POST /identity/v3/endpoints => generated 327 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 03:44:17.396673 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6b8ac-a6d5-4ceb-b118-07ba4311b4bd None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:17.396673 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6b8ac-a6d5-4ceb-b118-07ba4311b4bd None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:17.396673 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6b8ac-a6d5-4ceb-b118-07ba4311b4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:17.432140 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-8ec6b8ac-a6d5-4ceb-b118-07ba4311b4bd None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:44:17.435369 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8ec6b8ac-a6d5-4ceb-b118-07ba4311b4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:44:17.441426 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772fb72-9459-4abd-92b0-c87c033a68d7 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:17.500768 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193c61c-e324-40c5-adcd-199e0fd702ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:17.502619 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193c61c-e324-40c5-adcd-199e0fd702ee None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:17.503652 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193c61c-e324-40c5-adcd-199e0fd702ee None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:17.504190 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193c61c-e324-40c5-adcd-199e0fd702ee None admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:17.505525 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193c61c-e324-40c5-adcd-199e0fd702ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:17.506080 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193c61c-e324-40c5-adcd-199e0fd702ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:17.507782 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193c61c-e324-40c5-adcd-199e0fd702ee None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:17.526768 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:17.532552 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 402/798] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:44:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:17.534482 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f8630-646f-45c2-93e2-4702bba9588f None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:17.535032 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f8630-646f-45c2-93e2-4702bba9588f None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:17.535548 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f8630-646f-45c2-93e2-4702bba9588f None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:17.542031 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 403/799] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:44:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:44:17.543440 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f8630-646f-45c2-93e2-4702bba9588f None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:17.603992 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 397/800] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:44:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:44:17.605333 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29446fc5-5479-4ef6-b946-1f9558622cc3 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:17.605623 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29446fc5-5479-4ef6-b946-1f9558622cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:17.605901 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29446fc5-5479-4ef6-b946-1f9558622cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:17.627346 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-29446fc5-5479-4ef6-b946-1f9558622cc3 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:44:17.628901 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-29446fc5-5479-4ef6-b946-1f9558622cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:44:17.674562 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:17.689891 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f8630-646f-45c2-93e2-4702bba9588f None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:17.722109 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 398/801] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:44:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:44:17.723804 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70d4af-425c-47fb-9226-5a43ce77fcf9 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:17.724179 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70d4af-425c-47fb-9226-5a43ce77fcf9 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:17.724471 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70d4af-425c-47fb-9226-5a43ce77fcf9 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:17.725823 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 399/802] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:44:17.730340 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e70d4af-425c-47fb-9226-5a43ce77fcf9 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:17.732232 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf1deb-0959-4ca1-8067-21b930e9eb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:17.733609 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf1deb-0959-4ca1-8067-21b930e9eb9a None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:17.734113 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf1deb-0959-4ca1-8067-21b930e9eb9a None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:17.734885 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf1deb-0959-4ca1-8067-21b930e9eb9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:17.752202 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf1deb-0959-4ca1-8067-21b930e9eb9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:17.754925 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf1deb-0959-4ca1-8067-21b930e9eb9a None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:17.773806 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-a4bf1deb-0959-4ca1-8067-21b930e9eb9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:44:17.773806 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:17.773806 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:17.773806 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:17.773806 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:17.773806 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:17.773806 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:17.773806 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:17.773806 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:17.773806 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:17.773806 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:17.773806 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:17.773806 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 03:44:17.773806 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 03:44:17.773806 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 03:44:17.774849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 03:44:17.774849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:17.774849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:17.774849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:17.774849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:17.774849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:17.774849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:17.774849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:17.774849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:17.774849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:17.774849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:17.774849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:17.774849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:17.774849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:17.774849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:17.774849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:17.774849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:17.775877 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 03:44:17.775877 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 03:44:17.775877 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 03:44:17.775877 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 03:44:17.775877 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 03:44:17.775877 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 03:44:17.775877 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:44:17.775877 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:17.775877 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 404/803] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:44:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:17.777307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ee21c-4a23-47dc-a18a-21a27082e5a4 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:17.777725 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ee21c-4a23-47dc-a18a-21a27082e5a4 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:17.778125 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ee21c-4a23-47dc-a18a-21a27082e5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:17.796803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-df8ee21c-4a23-47dc-a18a-21a27082e5a4 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:44:17.798557 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-df8ee21c-4a23-47dc-a18a-21a27082e5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:44:17.849996 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e70d4af-425c-47fb-9226-5a43ce77fcf9 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:17.874244 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:17.891818 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 405/804] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:44:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:44:17.892769 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8ee21c-4a23-47dc-a18a-21a27082e5a4 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:17.900185 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9480db4-256b-4028-b400-230256093e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:17.901548 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9480db4-256b-4028-b400-230256093e3c None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:17.902031 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9480db4-256b-4028-b400-230256093e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:17.902455 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9480db4-256b-4028-b400-230256093e3c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:17.922167 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9480db4-256b-4028-b400-230256093e3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:44:17.937511 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-a9480db4-256b-4028-b400-230256093e3c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 03:44:17.937511 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:17.937511 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:17.937511 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:17.937511 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:17.937511 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:17.937511 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:17.937511 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:17.937511 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:17.937511 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:17.937511 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:17.937511 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:17.937511 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:44:17.937511 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:44:17.937511 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:44:17.937511 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:44:17.939080 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:44:17.939080 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:44:17.939080 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:44:17.939080 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:44:17.939080 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:17.939080 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:17.939080 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:17.939080 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:17.939080 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:17.939080 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:17.939080 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:17.939080 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:17.939080 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:17.939080 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:17.939080 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:17.939080 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:17.940630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:17.940630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:17.940630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:17.940630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:17.940630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:44:17.940630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:44:17.940630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:44:17.940630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:44:17.940630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:44:17.940630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:44:17.940630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 03:44:17.940630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:17.943627 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 400/805] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Jul 1 03:44:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:17.945074 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9480db4-256b-4028-b400-230256093e3c None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:17.977735 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:18.025006 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8ee21c-4a23-47dc-a18a-21a27082e5a4 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:18.062761 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434044bc-4ab1-43a5-b291-46bd8729b08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:18.063650 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434044bc-4ab1-43a5-b291-46bd8729b08c None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:18.063932 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434044bc-4ab1-43a5-b291-46bd8729b08c None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:18.064194 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434044bc-4ab1-43a5-b291-46bd8729b08c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:18.064850 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434044bc-4ab1-43a5-b291-46bd8729b08c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:18.066212 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434044bc-4ab1-43a5-b291-46bd8729b08c None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:18.067264 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9480db4-256b-4028-b400-230256093e3c None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:18.078578 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-434044bc-4ab1-43a5-b291-46bd8729b08c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 01 03:44:18.078578 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:18.078578 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 03:44:18.078578 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 03:44:18.078578 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 03:44:18.078578 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 03:44:18.078578 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 03:44:18.078578 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:44:18.078578 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 01 03:44:18.078578 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:18.078578 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 03:44:18.078578 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:18.078578 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:18.078578 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:18.078578 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:18.078578 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:18.079689 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:18.079689 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:18.079689 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:18.079689 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:18.079689 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:18.079689 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:18.079689 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:18.079689 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 03:44:18.079689 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 03:44:18.079689 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 03:44:18.079689 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 03:44:18.079689 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:18.079689 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:18.079689 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:18.079689 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:18.079689 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:18.080509 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:18.080509 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:18.080509 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:18.080509 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:18.080509 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:18.080509 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:18.080509 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:18.080509 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:18.080509 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:18.080509 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:18.080509 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:18.080509 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 03:44:18.080509 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:44:18.080509 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 01 03:44:18.080509 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:18.080509 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 406/806] 10.222.0.46 () {56 vars in 1129 bytes} [Fri Jul 1 03:44:17 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:18.081375 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434044bc-4ab1-43a5-b291-46bd8729b08c None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:18.118741 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7e09c-d565-47bb-b3f4-7a83be0e9a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:18.119410 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7e09c-d565-47bb-b3f4-7a83be0e9a06 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:18.119724 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7e09c-d565-47bb-b3f4-7a83be0e9a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:18.119988 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7e09c-d565-47bb-b3f4-7a83be0e9a06 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:18.120790 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7e09c-d565-47bb-b3f4-7a83be0e9a06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:18.121107 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7e09c-d565-47bb-b3f4-7a83be0e9a06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:18.122611 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7e09c-d565-47bb-b3f4-7a83be0e9a06 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:18.135533 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 401/807] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 1 03:44:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:18.136377 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7e09c-d565-47bb-b3f4-7a83be0e9a06 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:18.144500 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:18.198926 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434044bc-4ab1-43a5-b291-46bd8729b08c None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:18.230633 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:18.237132 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd91668-5847-49c3-bbc6-2c48c99b2b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:18.240172 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd91668-5847-49c3-bbc6-2c48c99b2b1f None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:18.240172 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd91668-5847-49c3-bbc6-2c48c99b2b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:18.240172 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd91668-5847-49c3-bbc6-2c48c99b2b1f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:18.249014 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7e09c-d565-47bb-b3f4-7a83be0e9a06 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:18.250353 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd91668-5847-49c3-bbc6-2c48c99b2b1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:44:18.258608 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-5cd91668-5847-49c3-bbc6-2c48c99b2b1f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:44:18.258608 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:18.258608 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:18.258608 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:18.258608 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:18.258608 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:18.258608 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:18.258608 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:18.258608 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:18.258608 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:18.258608 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:18.258608 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:18.258608 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:44:18.258608 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:44:18.258608 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:44:18.258608 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:44:18.259735 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:44:18.259735 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:44:18.259735 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:44:18.259735 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:44:18.259735 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:18.259735 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:18.259735 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:18.259735 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:18.259735 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:18.259735 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:18.259735 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:18.259735 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:18.259735 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:18.259735 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:18.259735 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:18.259735 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:18.260595 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:18.260595 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:18.260595 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:18.260595 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:18.260595 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:44:18.260595 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:44:18.260595 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:44:18.260595 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:44:18.260595 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:44:18.260595 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:44:18.260595 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:44:18.260595 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:18.260595 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 407/808] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 1 03:44:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:18.261283 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd91668-5847-49c3-bbc6-2c48c99b2b1f None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:18.294805 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9d704-d1dd-46fa-ab20-1643ac1c76f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:18.295509 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9d704-d1dd-46fa-ab20-1643ac1c76f7 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:18.295796 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9d704-d1dd-46fa-ab20-1643ac1c76f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:18.296074 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9d704-d1dd-46fa-ab20-1643ac1c76f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:18.296827 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9d704-d1dd-46fa-ab20-1643ac1c76f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:18.297165 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9d704-d1dd-46fa-ab20-1643ac1c76f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:18.298608 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9d704-d1dd-46fa-ab20-1643ac1c76f7 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:18.307601 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 402/809] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Jul 1 03:44:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:18.308452 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9d704-d1dd-46fa-ab20-1643ac1c76f7 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:18.403269 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd91668-5847-49c3-bbc6-2c48c99b2b1f None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:18.419708 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:18.421747 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9d704-d1dd-46fa-ab20-1643ac1c76f7 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:18.441552 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5afcc-b16d-4cc0-807c-d6615e40e5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:18.442344 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5afcc-b16d-4cc0-807c-d6615e40e5fa None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:18.442708 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5afcc-b16d-4cc0-807c-d6615e40e5fa None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:18.443125 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5afcc-b16d-4cc0-807c-d6615e40e5fa None admin] PATH_INFO: `/v3/services` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:18.444224 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5afcc-b16d-4cc0-807c-d6615e40e5fa None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:18.444640 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5afcc-b16d-4cc0-807c-d6615e40e5fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:18.446337 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5afcc-b16d-4cc0-807c-d6615e40e5fa None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:18.452219 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 408/810] 10.222.0.46 () {56 vars in 1124 bytes} [Fri Jul 1 03:44:18 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:18.453230 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5afcc-b16d-4cc0-807c-d6615e40e5fa None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:18.462019 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e985e4-a53b-4fe4-b07c-7dd7a9fb3d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:18.462707 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e985e4-a53b-4fe4-b07c-7dd7a9fb3d83 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:18.463016 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e985e4-a53b-4fe4-b07c-7dd7a9fb3d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:18.463385 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e985e4-a53b-4fe4-b07c-7dd7a9fb3d83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:18.464495 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e985e4-a53b-4fe4-b07c-7dd7a9fb3d83 None admin] RBAC: Adding query filter params (role.id=681755518698445fabd9a8accec13c0f, scope.project.id=da83db15a312499fb627691ae442f233, user.id=2da466ad31d344898f5c838f77d45181) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:18.464877 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e985e4-a53b-4fe4-b07c-7dd7a9fb3d83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:18.467680 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e985e4-a53b-4fe4-b07c-7dd7a9fb3d83 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:18.476869 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 403/811] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:44:18 2022] GET /identity/v3/role_assignments?user.id=2da466ad31d344898f5c838f77d45181&scope.project.id=da83db15a312499fb627691ae442f233&role.id=681755518698445fabd9a8accec13c0f => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:18.477702 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e985e4-a53b-4fe4-b07c-7dd7a9fb3d83 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:18.496683 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:18.623052 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5afcc-b16d-4cc0-807c-d6615e40e5fa None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:18.624615 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e985e4-a53b-4fe4-b07c-7dd7a9fb3d83 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:18.678047 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0416a4-b83a-4339-a7ea-544c0e71212e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:18.678480 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0416a4-b83a-4339-a7ea-544c0e71212e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:18.678760 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0416a4-b83a-4339-a7ea-544c0e71212e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:18.679032 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0416a4-b83a-4339-a7ea-544c0e71212e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:18.696465 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf7adb0-14b2-4e60-afd7-d00a51bd81ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:18.697150 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7adb0-14b2-4e60-afd7-d00a51bd81ae None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:18.697498 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7adb0-14b2-4e60-afd7-d00a51bd81ae None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:18.697839 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7adb0-14b2-4e60-afd7-d00a51bd81ae None admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:18.698543 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0416a4-b83a-4339-a7ea-544c0e71212e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:18.698696 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf7adb0-14b2-4e60-afd7-d00a51bd81ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:18.698923 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf7adb0-14b2-4e60-afd7-d00a51bd81ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:18.700280 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0416a4-b83a-4339-a7ea-544c0e71212e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:18.700461 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf7adb0-14b2-4e60-afd7-d00a51bd81ae None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:18.711125 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 409/812] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:44:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:18.711761 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf7adb0-14b2-4e60-afd7-d00a51bd81ae None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:18.724657 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-3f0416a4-b83a-4339-a7ea-544c0e71212e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:18.724657 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:18.724657 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:18.724657 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:18.724657 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:18.724657 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:18.724657 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:18.724657 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:18.724657 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:18.724657 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:18.724657 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:18.724657 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:18.724657 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:44:18.724657 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:44:18.724657 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:44:18.725817 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:44:18.725817 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:18.725817 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:18.725817 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:18.725817 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:18.725817 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:18.725817 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:18.725817 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:18.725817 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:18.725817 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:18.725817 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:18.725817 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:18.725817 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:18.725817 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:18.725817 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:18.725817 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:18.725817 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:18.726883 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:44:18.726883 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:44:18.726883 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:18.726883 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:18.726883 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 404/813] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:44:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:18.728164 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0416a4-b83a-4339-a7ea-544c0e71212e None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:18.772936 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:18.822458 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:18.851836 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf7adb0-14b2-4e60-afd7-d00a51bd81ae None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:18.869439 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0416a4-b83a-4339-a7ea-544c0e71212e None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:18.905864 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae828098-07a5-4dfc-ac29-a97aaad6fda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:18.906661 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae828098-07a5-4dfc-ac29-a97aaad6fda8 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:18.907076 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae828098-07a5-4dfc-ac29-a97aaad6fda8 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:18.907474 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae828098-07a5-4dfc-ac29-a97aaad6fda8 None admin] PATH_INFO: `/v3/services` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:18.908302 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae828098-07a5-4dfc-ac29-a97aaad6fda8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:18.908712 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae828098-07a5-4dfc-ac29-a97aaad6fda8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:18.910391 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae828098-07a5-4dfc-ac29-a97aaad6fda8 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:18.910927 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aacabdf-056e-440a-913e-42729e97e18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:18.912307 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacabdf-056e-440a-913e-42729e97e18d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:18.912639 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacabdf-056e-440a-913e-42729e97e18d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:18.912920 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacabdf-056e-440a-913e-42729e97e18d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:18.921880 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 410/814] 10.222.0.46 () {56 vars in 1124 bytes} [Fri Jul 1 03:44:18 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:18.922672 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae828098-07a5-4dfc-ac29-a97aaad6fda8 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:18.925761 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aacabdf-056e-440a-913e-42729e97e18d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:18.927245 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aacabdf-056e-440a-913e-42729e97e18d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:18.946584 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-9aacabdf-056e-440a-913e-42729e97e18d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:18.946584 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:18.946584 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:18.946584 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:18.946584 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:18.946584 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:18.946584 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:18.946584 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:18.946584 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:18.946584 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:18.946584 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:18.946584 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:18.946584 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:44:18.946584 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:44:18.946584 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:44:18.955642 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:44:18.955642 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:18.955642 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:18.955642 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:18.955642 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:18.955642 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:18.955642 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:18.955642 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:18.955642 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:18.955642 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:18.955642 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:18.955642 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:18.955642 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:18.955642 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:18.955642 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:18.955642 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:18.955642 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:18.956764 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:44:18.956764 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:44:18.956764 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:18.956764 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:18.956764 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 405/815] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:44:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:18.956764 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aacabdf-056e-440a-913e-42729e97e18d None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:19.066383 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae828098-07a5-4dfc-ac29-a97aaad6fda8 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:19.070873 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:19.089577 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aacabdf-056e-440a-913e-42729e97e18d None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:19.108487 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e819f85-b92e-4739-b927-16d4b51a3bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:19.109156 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e819f85-b92e-4739-b927-16d4b51a3bd2 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:19.109435 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e819f85-b92e-4739-b927-16d4b51a3bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:19.109710 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e819f85-b92e-4739-b927-16d4b51a3bd2 None admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:19.111054 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e819f85-b92e-4739-b927-16d4b51a3bd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:19.111361 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e819f85-b92e-4739-b927-16d4b51a3bd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:19.112776 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e819f85-b92e-4739-b927-16d4b51a3bd2 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:19.120380 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:19.134058 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 411/816] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:44:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:19.134058 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e819f85-b92e-4739-b927-16d4b51a3bd2 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:19.149917 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dceef42-ebc3-4b04-b802-dd5c402d6c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:19.150757 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dceef42-ebc3-4b04-b802-dd5c402d6c4c None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:19.151051 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dceef42-ebc3-4b04-b802-dd5c402d6c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:19.151480 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dceef42-ebc3-4b04-b802-dd5c402d6c4c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:19.152858 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dceef42-ebc3-4b04-b802-dd5c402d6c4c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:19.155641 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dceef42-ebc3-4b04-b802-dd5c402d6c4c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:19.248363 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e819f85-b92e-4739-b927-16d4b51a3bd2 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:19.274967 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 406/817] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 1 03:44:18 2022] POST /identity/v3/endpoints => generated 346 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 03:44:19.275837 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dceef42-ebc3-4b04-b802-dd5c402d6c4c None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:19.304511 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c585b1e-3104-4186-ad2e-98b8f97b9127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:19.305199 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c585b1e-3104-4186-ad2e-98b8f97b9127 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:19.305481 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c585b1e-3104-4186-ad2e-98b8f97b9127 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:19.305757 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c585b1e-3104-4186-ad2e-98b8f97b9127 None admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:19.306501 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c585b1e-3104-4186-ad2e-98b8f97b9127 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:19.306811 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c585b1e-3104-4186-ad2e-98b8f97b9127 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:19.308335 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c585b1e-3104-4186-ad2e-98b8f97b9127 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:19.328943 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 412/818] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:44:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:19.330535 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c585b1e-3104-4186-ad2e-98b8f97b9127 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:19.365422 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:19.466950 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dceef42-ebc3-4b04-b802-dd5c402d6c4c None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:19.529500 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84450063-7201-4a1f-aead-08e54f859fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:19.530786 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84450063-7201-4a1f-aead-08e54f859fa1 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:19.531285 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84450063-7201-4a1f-aead-08e54f859fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:19.531790 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84450063-7201-4a1f-aead-08e54f859fa1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:19.543542 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c585b1e-3104-4186-ad2e-98b8f97b9127 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:19.544462 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84450063-7201-4a1f-aead-08e54f859fa1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:19.546746 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84450063-7201-4a1f-aead-08e54f859fa1 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:19.567829 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-84450063-7201-4a1f-aead-08e54f859fa1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 01 03:44:19.567829 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:19.567829 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:19.567829 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:19.567829 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:19.567829 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:19.567829 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:19.567829 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:19.567829 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:19.567829 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:19.567829 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:19.567829 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:19.567829 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 03:44:19.567829 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 03:44:19.567829 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 03:44:19.567829 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 03:44:19.568847 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:19.568847 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:19.568847 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 03:44:19.568847 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:44:19.568847 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 03:44:19.568847 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:44:19.568847 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:19.568847 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:19.568847 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:19.568847 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:19.568847 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:19.568847 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:19.568847 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:19.568847 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:19.568847 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:19.568847 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:19.568847 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:19.568847 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:19.569818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:19.569818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:19.569818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 03:44:19.569818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 03:44:19.569818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 03:44:19.569818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 03:44:19.569818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 03:44:19.569818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 03:44:19.569818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 01 03:44:19.569818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:19.569818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 407/819] 10.222.0.46 () {56 vars in 1117 bytes} [Fri Jul 1 03:44:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:19.579637 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84450063-7201-4a1f-aead-08e54f859fa1 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:19.604732 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6d4d2-f191-4e90-a3ff-8b74041ba400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:19.606144 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6d4d2-f191-4e90-a3ff-8b74041ba400 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:19.606650 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6d4d2-f191-4e90-a3ff-8b74041ba400 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:19.607152 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6d4d2-f191-4e90-a3ff-8b74041ba400 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:19.639444 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b6d4d2-f191-4e90-a3ff-8b74041ba400 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:19.639444 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b6d4d2-f191-4e90-a3ff-8b74041ba400 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:19.657875 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-18b6d4d2-f191-4e90-a3ff-8b74041ba400 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 01 03:44:19.657875 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:19.657875 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:19.657875 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:19.657875 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:19.657875 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:19.657875 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:19.657875 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:19.657875 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:19.657875 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:19.657875 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:19.657875 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:19.657875 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 03:44:19.657875 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 03:44:19.657875 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 03:44:19.657875 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 03:44:19.658868 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:19.658868 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:19.658868 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 03:44:19.658868 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:44:19.658868 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 03:44:19.658868 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:44:19.658868 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:19.658868 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:19.658868 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:19.658868 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:19.658868 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:19.658868 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:19.658868 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:19.658868 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:19.658868 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:19.658868 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:19.658868 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:19.658868 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:19.659872 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:19.659872 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:19.659872 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 03:44:19.659872 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 03:44:19.659872 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 03:44:19.659872 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 03:44:19.659872 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 03:44:19.659872 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 03:44:19.659872 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 01 03:44:19.659872 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:19.660398 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 413/820] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 1 03:44:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:19.665416 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6d4d2-f191-4e90-a3ff-8b74041ba400 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:19.695868 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:19.840740 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84450063-7201-4a1f-aead-08e54f859fa1 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:19.925831 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:19.929517 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf75a9e-b5d7-4ac5-84ff-987fe0f3fe36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:19.931377 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf75a9e-b5d7-4ac5-84ff-987fe0f3fe36 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:19.933357 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf75a9e-b5d7-4ac5-84ff-987fe0f3fe36 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:19.934185 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf75a9e-b5d7-4ac5-84ff-987fe0f3fe36 None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:19.938481 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf75a9e-b5d7-4ac5-84ff-987fe0f3fe36 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:19.939826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf75a9e-b5d7-4ac5-84ff-987fe0f3fe36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:19.943703 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf75a9e-b5d7-4ac5-84ff-987fe0f3fe36 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:19.949981 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6d4d2-f191-4e90-a3ff-8b74041ba400 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:19.994152 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9404058-c01e-43b0-91cd-7963e543cd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:19.994880 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9404058-c01e-43b0-91cd-7963e543cd93 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:19.995105 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9404058-c01e-43b0-91cd-7963e543cd93 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:19.995362 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 408/821] 10.222.0.46 () {56 vars in 1149 bytes} [Fri Jul 1 03:44:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:19.995498 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9404058-c01e-43b0-91cd-7963e543cd93 None admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:19.996261 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9404058-c01e-43b0-91cd-7963e543cd93 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:19.996898 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9404058-c01e-43b0-91cd-7963e543cd93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:19.998074 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf75a9e-b5d7-4ac5-84ff-987fe0f3fe36 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:19.998379 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9404058-c01e-43b0-91cd-7963e543cd93 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:20.023509 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 414/822] 10.222.0.46 () {56 vars in 1135 bytes} [Fri Jul 1 03:44:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:20.024518 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9404058-c01e-43b0-91cd-7963e543cd93 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:20.150949 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9404058-c01e-43b0-91cd-7963e543cd93 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:20.193480 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360ce8a-7663-4d8a-8573-d4fe0faff857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:20.194581 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360ce8a-7663-4d8a-8573-d4fe0faff857 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:20.194975 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360ce8a-7663-4d8a-8573-d4fe0faff857 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:20.195321 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360ce8a-7663-4d8a-8573-d4fe0faff857 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:20.210807 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:20.216279 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360ce8a-7663-4d8a-8573-d4fe0faff857 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:20.218145 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360ce8a-7663-4d8a-8573-d4fe0faff857 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:20.284977 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:20.294748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf75a9e-b5d7-4ac5-84ff-987fe0f3fe36 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:20.299175 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-9360ce8a-7663-4d8a-8573-d4fe0faff857 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:20.299175 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:20.299175 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:20.299175 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:20.299175 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:20.299175 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:20.299175 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:20.299175 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:20.299175 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:20.299175 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:20.299175 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:20.299175 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:20.299175 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:44:20.299175 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:44:20.299175 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:44:20.301568 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:44:20.301568 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:20.301568 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:20.301568 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:20.301568 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:20.301568 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:20.301568 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:20.301568 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:20.301568 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:20.301568 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:20.301568 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:20.301568 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:20.301568 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:20.301568 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:20.301568 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:20.301568 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:20.301568 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:20.303349 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:44:20.303349 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:44:20.303349 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:20.303349 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:20.312097 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 415/823] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:44:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:20.318091 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360ce8a-7663-4d8a-8573-d4fe0faff857 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:20.336194 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413263f-c3fb-4a70-9bad-5175d38f0ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:20.337286 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413263f-c3fb-4a70-9bad-5175d38f0ffe None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:20.337402 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413263f-c3fb-4a70-9bad-5175d38f0ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:20.337675 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413263f-c3fb-4a70-9bad-5175d38f0ffe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:20.351881 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3413263f-c3fb-4a70-9bad-5175d38f0ffe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:20.353420 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3413263f-c3fb-4a70-9bad-5175d38f0ffe None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:20.373238 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-3413263f-c3fb-4a70-9bad-5175d38f0ffe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:20.373238 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:20.373238 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:20.373238 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:20.373238 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:20.373238 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:20.373238 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:20.373238 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:20.373238 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:20.373238 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:20.373238 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:20.373238 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:20.373238 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:44:20.373238 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:44:20.373238 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:44:20.375007 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:44:20.375007 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:20.375007 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:20.375007 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:20.375007 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:20.375007 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:20.375007 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:20.375007 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:20.375007 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:20.375007 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:20.375007 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:20.375007 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:20.375007 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:20.375007 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:20.375007 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:20.375007 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:20.375007 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:20.379041 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:44:20.379041 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:44:20.379041 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:20.379041 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:20.379041 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 409/824] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:44:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:20.380804 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413263f-c3fb-4a70-9bad-5175d38f0ffe None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:20.516813 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360ce8a-7663-4d8a-8573-d4fe0faff857 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:20.541611 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413263f-c3fb-4a70-9bad-5175d38f0ffe None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:20.588721 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf87f9-f16b-4b20-8a0c-f1058d3391fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:20.589424 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf87f9-f16b-4b20-8a0c-f1058d3391fc None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:20.589712 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf87f9-f16b-4b20-8a0c-f1058d3391fc None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:20.590293 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf87f9-f16b-4b20-8a0c-f1058d3391fc None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:20.591034 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaf87f9-f16b-4b20-8a0c-f1058d3391fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:20.591348 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaf87f9-f16b-4b20-8a0c-f1058d3391fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:20.593137 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaf87f9-f16b-4b20-8a0c-f1058d3391fc None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:20.609664 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db85e469-0df0-4255-95c8-7eda95657582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:20.610383 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85e469-0df0-4255-95c8-7eda95657582 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:20.610674 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85e469-0df0-4255-95c8-7eda95657582 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:20.610956 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85e469-0df0-4255-95c8-7eda95657582 None admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:20.619607 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 410/825] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:44:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:20.619860 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db85e469-0df0-4255-95c8-7eda95657582 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:20.619860 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db85e469-0df0-4255-95c8-7eda95657582 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:20.619860 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db85e469-0df0-4255-95c8-7eda95657582 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:20.622651 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf87f9-f16b-4b20-8a0c-f1058d3391fc None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:20.626176 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:20.644425 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 416/826] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:44:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:44:20.650267 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db85e469-0df0-4255-95c8-7eda95657582 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:20.748657 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:20.750286 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf87f9-f16b-4b20-8a0c-f1058d3391fc None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:20.809741 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9fe3da-ddb7-4639-b442-ab4ba22f617d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:20.810447 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fe3da-ddb7-4639-b442-ab4ba22f617d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:20.810730 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fe3da-ddb7-4639-b442-ab4ba22f617d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:20.811108 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fe3da-ddb7-4639-b442-ab4ba22f617d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:20.819608 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9fe3da-ddb7-4639-b442-ab4ba22f617d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:20.821092 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9fe3da-ddb7-4639-b442-ab4ba22f617d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:20.822263 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db85e469-0df0-4255-95c8-7eda95657582 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:20.838827 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-9d9fe3da-ddb7-4639-b442-ab4ba22f617d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:44:20.838827 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:20.838827 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:20.838827 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:20.838827 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:20.838827 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:20.838827 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:20.838827 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:20.838827 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:20.838827 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:20.838827 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:20.838827 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:20.838827 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 03:44:20.838827 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 03:44:20.838827 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 03:44:20.847934 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 03:44:20.847934 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:20.847934 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:20.847934 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:20.847934 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:20.847934 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:20.847934 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:20.847934 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:20.847934 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:20.847934 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:20.847934 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:20.847934 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:20.847934 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:20.847934 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:20.847934 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:20.847934 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:20.847934 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:20.849810 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 03:44:20.849810 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 03:44:20.849810 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 03:44:20.849810 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 03:44:20.849810 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 03:44:20.849810 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 03:44:20.849810 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:44:20.849810 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:20.849810 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 411/827] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:44:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 03:44:20.849810 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9997f1b-246e-4591-972c-b42d96d9f273 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:20.849810 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9997f1b-246e-4591-972c-b42d96d9f273 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:20.850420 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9997f1b-246e-4591-972c-b42d96d9f273 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:20.850420 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 412/828] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:44:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:44:20.852637 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770cb6b-9fd8-4ff6-a5e3-7c9247cc9d91 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:20.852914 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770cb6b-9fd8-4ff6-a5e3-7c9247cc9d91 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:20.853200 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770cb6b-9fd8-4ff6-a5e3-7c9247cc9d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:20.879506 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-0770cb6b-9fd8-4ff6-a5e3-7c9247cc9d91 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:44:20.881861 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0770cb6b-9fd8-4ff6-a5e3-7c9247cc9d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:44:20.885745 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ea2f3-94eb-4727-b80e-bf5d7f211ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:20.887487 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ea2f3-94eb-4727-b80e-bf5d7f211ebb None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:20.888134 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ea2f3-94eb-4727-b80e-bf5d7f211ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:20.888246 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ea2f3-94eb-4727-b80e-bf5d7f211ebb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:20.901817 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ea2f3-94eb-4727-b80e-bf5d7f211ebb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:20.904570 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ea2f3-94eb-4727-b80e-bf5d7f211ebb None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:20.931443 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-ad5ea2f3-94eb-4727-b80e-bf5d7f211ebb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:44:20.931443 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:20.931443 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:20.931443 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:20.931443 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:20.931443 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:20.931443 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:20.931443 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:20.931443 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:20.931443 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:20.931443 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:20.931443 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:20.931443 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 03:44:20.931443 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 03:44:20.931443 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 03:44:20.932449 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 03:44:20.932449 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:20.932449 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:20.932449 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:20.932449 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:20.932449 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:20.932449 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:20.932449 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:20.932449 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:20.932449 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:20.932449 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:20.932449 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:20.932449 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:20.932449 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:20.932449 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:20.932449 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:20.932449 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:20.933391 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 03:44:20.933391 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 03:44:20.933391 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 03:44:20.933391 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 03:44:20.933391 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 03:44:20.933391 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 03:44:20.933391 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:44:20.933391 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:20.933908 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 417/829] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:44:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:20.935171 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ea2f3-94eb-4727-b80e-bf5d7f211ebb None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:21.094852 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:21.114532 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 413/830] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:44:20 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:44:21.117156 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0770cb6b-9fd8-4ff6-a5e3-7c9247cc9d91 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:21.130608 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ea2f3-94eb-4727-b80e-bf5d7f211ebb None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:21.146611 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:21.191399 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c1b9a-8e0b-4d01-87e0-b935d5bde04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:21.192363 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c1b9a-8e0b-4d01-87e0-b935d5bde04f None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:21.192709 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c1b9a-8e0b-4d01-87e0-b935d5bde04f None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:21.193202 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c1b9a-8e0b-4d01-87e0-b935d5bde04f None admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:21.194661 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c1b9a-8e0b-4d01-87e0-b935d5bde04f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:21.195204 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c1b9a-8e0b-4d01-87e0-b935d5bde04f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:21.197879 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c1b9a-8e0b-4d01-87e0-b935d5bde04f None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:21.217223 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 418/831] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 1 03:44:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:21.217223 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c1b9a-8e0b-4d01-87e0-b935d5bde04f None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:21.294098 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0770cb6b-9fd8-4ff6-a5e3-7c9247cc9d91 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:21.333754 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130696e-daef-4667-a9b1-f3ee0b997e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:21.334442 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130696e-daef-4667-a9b1-f3ee0b997e38 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:21.334744 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130696e-daef-4667-a9b1-f3ee0b997e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:21.334981 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130696e-daef-4667-a9b1-f3ee0b997e38 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:21.335835 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130696e-daef-4667-a9b1-f3ee0b997e38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:21.336144 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130696e-daef-4667-a9b1-f3ee0b997e38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:21.337701 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130696e-daef-4667-a9b1-f3ee0b997e38 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:21.359675 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 414/832] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 1 03:44:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:21.359675 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130696e-daef-4667-a9b1-f3ee0b997e38 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:21.432798 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:21.497024 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130696e-daef-4667-a9b1-f3ee0b997e38 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:21.541188 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c1b9a-8e0b-4d01-87e0-b935d5bde04f None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:21.553660 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c3a76-7348-4f30-9048-4aabb46a4565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:21.554677 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c3a76-7348-4f30-9048-4aabb46a4565 None admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:21.555019 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c3a76-7348-4f30-9048-4aabb46a4565 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:21.555369 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c3a76-7348-4f30-9048-4aabb46a4565 None admin] PATH_INFO: `/v3/projects/da83db15a312499fb627691ae442f233/users/dd41221abea04808bed5ef4ac4528c62/roles/66426d7dd6f64f6ebfcb1cbb8188b0d2` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:21.574549 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c3a76-7348-4f30-9048-4aabb46a4565 None admin] RBAC: Authorizing `identity:create_grant(project_id=da83db15a312499fb627691ae442f233, user_id=dd41221abea04808bed5ef4ac4528c62, role_id=66426d7dd6f64f6ebfcb1cbb8188b0d2)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:21.576532 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c3a76-7348-4f30-9048-4aabb46a4565 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:21.588654 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b455a70-be7f-4100-8499-fb39a64804ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:21.589493 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b455a70-be7f-4100-8499-fb39a64804ba None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:21.589777 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b455a70-be7f-4100-8499-fb39a64804ba None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:21.590050 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b455a70-be7f-4100-8499-fb39a64804ba None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:21.590744 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b455a70-be7f-4100-8499-fb39a64804ba None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:21.592233 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b455a70-be7f-4100-8499-fb39a64804ba None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:21.606555 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-3b455a70-be7f-4100-8499-fb39a64804ba None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 01 03:44:21.606555 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:21.606555 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 03:44:21.606555 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 03:44:21.606555 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 03:44:21.606555 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 03:44:21.606555 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 03:44:21.606555 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:44:21.606555 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 01 03:44:21.606555 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:21.606555 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 03:44:21.606555 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:21.606555 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:21.606555 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:21.606555 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:21.606555 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:21.608613 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:21.608613 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:21.608613 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:21.608613 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:21.608613 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:21.608613 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:21.608613 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:21.608613 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 03:44:21.608613 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 03:44:21.608613 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 03:44:21.608613 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 03:44:21.608613 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:21.608613 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:21.608613 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:21.608613 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:21.608613 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:21.610336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:21.610336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:21.610336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:21.610336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:21.610336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:21.610336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:21.610336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:21.610336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:21.610336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:21.610336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:21.610336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:21.610336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 03:44:21.610336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:44:21.610336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 01 03:44:21.610336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:21.610336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 419/833] 10.222.0.46 () {56 vars in 1132 bytes} [Fri Jul 1 03:44:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:21.611943 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b455a70-be7f-4100-8499-fb39a64804ba None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:21.651644 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:21.670503 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 415/834] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 1 03:44:21 2022] PUT /identity/v3/projects/da83db15a312499fb627691ae442f233/users/dd41221abea04808bed5ef4ac4528c62/roles/66426d7dd6f64f6ebfcb1cbb8188b0d2 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 03:44:21.673006 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575876e-cff4-4a4d-98e3-c25e21cab153 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:21.673503 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575876e-cff4-4a4d-98e3-c25e21cab153 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:21.673951 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575876e-cff4-4a4d-98e3-c25e21cab153 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:21.677077 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 416/835] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:44:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:44:21.678552 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575876e-cff4-4a4d-98e3-c25e21cab153 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:21.774430 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b455a70-be7f-4100-8499-fb39a64804ba None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:21.842570 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777030de-f564-4a82-b5d5-1c3e059f4c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:21.844157 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777030de-f564-4a82-b5d5-1c3e059f4c91 None admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:21.844936 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777030de-f564-4a82-b5d5-1c3e059f4c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:21.846140 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777030de-f564-4a82-b5d5-1c3e059f4c91 None admin] PATH_INFO: `/v3/projects/da83db15a312499fb627691ae442f233/users/83787880173b459c8975b834bd47a51a/roles/681755518698445fabd9a8accec13c0f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:21.850603 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777030de-f564-4a82-b5d5-1c3e059f4c91 None admin] RBAC: Authorizing `identity:create_grant(project_id=da83db15a312499fb627691ae442f233, user_id=83787880173b459c8975b834bd47a51a, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:21.853680 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777030de-f564-4a82-b5d5-1c3e059f4c91 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:21.862131 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575876e-cff4-4a4d-98e3-c25e21cab153 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:21.864308 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:21.902917 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfaf0c8-af0f-45fb-b5c2-394ba10f090a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:21.903796 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfaf0c8-af0f-45fb-b5c2-394ba10f090a None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:21.904151 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfaf0c8-af0f-45fb-b5c2-394ba10f090a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:21.904564 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfaf0c8-af0f-45fb-b5c2-394ba10f090a None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:21.905350 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfaf0c8-af0f-45fb-b5c2-394ba10f090a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:21.905722 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfaf0c8-af0f-45fb-b5c2-394ba10f090a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:21.907290 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfaf0c8-af0f-45fb-b5c2-394ba10f090a None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:21.913106 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 417/836] 10.222.0.46 () {56 vars in 1126 bytes} [Fri Jul 1 03:44:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:21.914433 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc5add-ca0b-4732-87ce-1d7836504bbd None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:21.914783 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc5add-ca0b-4732-87ce-1d7836504bbd None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:21.915079 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc5add-ca0b-4732-87ce-1d7836504bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:21.937439 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-42cc5add-ca0b-4732-87ce-1d7836504bbd None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:44:21.940007 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-42cc5add-ca0b-4732-87ce-1d7836504bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:44:21.947523 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 420/837] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 1 03:44:21 2022] PUT /identity/v3/projects/da83db15a312499fb627691ae442f233/users/83787880173b459c8975b834bd47a51a/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 03:44:21.947523 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777030de-f564-4a82-b5d5-1c3e059f4c91 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:22.089235 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 418/838] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:44:21 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:44:22.128492 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc5add-ca0b-4732-87ce-1d7836504bbd None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:22.151938 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:22.165655 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777030de-f564-4a82-b5d5-1c3e059f4c91 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:22.244061 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2b439-5b29-430d-a512-abe0c044ab3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:22.245275 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2b439-5b29-430d-a512-abe0c044ab3c None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:22.245837 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2b439-5b29-430d-a512-abe0c044ab3c None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:22.247284 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2b439-5b29-430d-a512-abe0c044ab3c None admin] PATH_INFO: `/v3/services` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:22.249335 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc2b439-5b29-430d-a512-abe0c044ab3c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:22.249977 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc2b439-5b29-430d-a512-abe0c044ab3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:22.253447 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc2b439-5b29-430d-a512-abe0c044ab3c None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:22.265273 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 421/839] 10.222.0.46 () {56 vars in 1126 bytes} [Fri Jul 1 03:44:21 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:22.338173 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:22.351906 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc5add-ca0b-4732-87ce-1d7836504bbd None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:22.419699 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f1b62c-0f0d-4ef2-92cf-4fa0ef3c8313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:22.420967 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1b62c-0f0d-4ef2-92cf-4fa0ef3c8313 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:22.421439 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1b62c-0f0d-4ef2-92cf-4fa0ef3c8313 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:22.421907 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1b62c-0f0d-4ef2-92cf-4fa0ef3c8313 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:22.423167 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f1b62c-0f0d-4ef2-92cf-4fa0ef3c8313 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:22.425769 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f1b62c-0f0d-4ef2-92cf-4fa0ef3c8313 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:22.449718 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-03f1b62c-0f0d-4ef2-92cf-4fa0ef3c8313 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 01 03:44:22.449718 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:22.449718 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 03:44:22.449718 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 03:44:22.449718 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 03:44:22.449718 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 03:44:22.449718 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 03:44:22.449718 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:44:22.449718 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 01 03:44:22.449718 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:22.449718 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 03:44:22.449718 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:22.449718 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:22.449718 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:22.449718 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:22.449718 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:22.449718 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:22.451960 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:22.451960 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:22.451960 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:22.451960 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:22.451960 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:22.451960 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:22.451960 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 03:44:22.451960 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 03:44:22.451960 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 03:44:22.451960 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 03:44:22.451960 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:22.451960 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:22.451960 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:22.451960 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:22.451960 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:22.451960 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:22.454358 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:22.454358 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:22.454358 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:22.454358 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:22.454358 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:22.454358 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:22.454358 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:22.454358 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:22.454358 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:22.454358 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:22.454358 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 03:44:22.454358 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:44:22.454358 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 01 03:44:22.454358 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:22.454358 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 419/840] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Jul 1 03:44:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 03:44:22.465779 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2b439-5b29-430d-a512-abe0c044ab3c None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:22.676863 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2b439-5b29-430d-a512-abe0c044ab3c None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:22.745800 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba7492-04c6-486c-a8a5-879718ccb988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:22.746933 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba7492-04c6-486c-a8a5-879718ccb988 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:22.747397 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba7492-04c6-486c-a8a5-879718ccb988 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:22.747895 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba7492-04c6-486c-a8a5-879718ccb988 None admin] PATH_INFO: `/v3/services` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:22.749252 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba7492-04c6-486c-a8a5-879718ccb988 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:22.749799 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba7492-04c6-486c-a8a5-879718ccb988 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:22.753103 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba7492-04c6-486c-a8a5-879718ccb988 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:22.762808 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 422/841] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Jul 1 03:44:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:22.772141 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f1b62c-0f0d-4ef2-92cf-4fa0ef3c8313 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:22.974176 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f1b62c-0f0d-4ef2-92cf-4fa0ef3c8313 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:23.040787 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e33859-0fcd-49e8-9c32-7e2908406ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:23.042210 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e33859-0fcd-49e8-9c32-7e2908406ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:23.042855 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e33859-0fcd-49e8-9c32-7e2908406ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:23.043557 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e33859-0fcd-49e8-9c32-7e2908406ae7 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:23.045259 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e33859-0fcd-49e8-9c32-7e2908406ae7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:23.046150 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e33859-0fcd-49e8-9c32-7e2908406ae7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:23.049436 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e33859-0fcd-49e8-9c32-7e2908406ae7 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:23.063603 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 420/842] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Jul 1 03:44:22 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:24.991967 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bdf35-0b9c-4a9d-ad90-c68a95f6dd6d None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:24.992734 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bdf35-0b9c-4a9d-ad90-c68a95f6dd6d None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:24.992734 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bdf35-0b9c-4a9d-ad90-c68a95f6dd6d None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:24.994055 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 423/843] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:44:25.000137 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041c005-294a-4c0e-98d9-26c508fc13a5 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:25.000998 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041c005-294a-4c0e-98d9-26c508fc13a5 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:25.000998 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041c005-294a-4c0e-98d9-26c508fc13a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:25.027541 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-6041c005-294a-4c0e-98d9-26c508fc13a5 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:44:25.030050 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-6041c005-294a-4c0e-98d9-26c508fc13a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:44:25.067074 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986be89c-f1f7-4749-99fc-1daaf2f515b5 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:25.067558 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986be89c-f1f7-4749-99fc-1daaf2f515b5 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:25.068009 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986be89c-f1f7-4749-99fc-1daaf2f515b5 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:25.069744 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:25.071219 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 424/844] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:44:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:44:25.080833 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464d67f-829f-44a5-a5d7-db68d6fc294e None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:25.081282 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464d67f-829f-44a5-a5d7-db68d6fc294e None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:25.081950 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464d67f-829f-44a5-a5d7-db68d6fc294e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:25.112836 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-7464d67f-829f-44a5-a5d7-db68d6fc294e None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:44:25.114753 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-7464d67f-829f-44a5-a5d7-db68d6fc294e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:44:25.152132 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:25.162767 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 421/845] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:44:24 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 03:44:25.203284 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041c005-294a-4c0e-98d9-26c508fc13a5 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:25.216779 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 425/846] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:44:25 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 03:44:25.246155 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7464d67f-829f-44a5-a5d7-db68d6fc294e None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:25.399554 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041c005-294a-4c0e-98d9-26c508fc13a5 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:25.413820 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7464d67f-829f-44a5-a5d7-db68d6fc294e None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:25.458111 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94b272-eb29-440f-bcd3-a06c87321d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:25.459371 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94b272-eb29-440f-bcd3-a06c87321d05 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:25.459886 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94b272-eb29-440f-bcd3-a06c87321d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:25.460332 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94b272-eb29-440f-bcd3-a06c87321d05 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:25.473737 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a72dbb-693f-490a-a278-ea359d6d1fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:25.474972 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a72dbb-693f-490a-a278-ea359d6d1fba None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:25.475421 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a72dbb-693f-490a-a278-ea359d6d1fba None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:25.475895 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a72dbb-693f-490a-a278-ea359d6d1fba None admin] PATH_INFO: `/v3/roles/service` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:25.478286 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c94b272-eb29-440f-bcd3-a06c87321d05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:44:25.492310 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-6c94b272-eb29-440f-bcd3-a06c87321d05 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:44:25.492310 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:25.492310 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:25.492310 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:25.492310 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:25.492310 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:25.492310 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:25.492310 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:25.492310 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:25.492310 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:25.492310 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:25.492310 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:25.492310 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:44:25.492310 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:44:25.492310 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:44:25.492310 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:44:25.493296 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:44:25.493296 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:44:25.493296 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:44:25.493296 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:44:25.493296 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:25.493296 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:25.493296 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:25.493296 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:25.493296 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:25.493296 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:25.493296 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:25.493296 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:25.493296 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:25.493296 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:25.493296 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:25.493296 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:25.494157 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:25.494157 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:25.494157 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:25.494157 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:25.494157 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:44:25.494157 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:44:25.494157 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:44:25.494157 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:44:25.494157 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:44:25.494157 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:44:25.494157 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:44:25.494157 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:25.494157 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 422/847] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 1 03:44:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 03:44:25.496355 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0039c9b-1c9a-413f-b04e-e5ac3bffd7b5 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:25.496778 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0039c9b-1c9a-413f-b04e-e5ac3bffd7b5 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:25.497263 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0039c9b-1c9a-413f-b04e-e5ac3bffd7b5 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:25.503897 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 423/848] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:44:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:44:25.503897 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0039c9b-1c9a-413f-b04e-e5ac3bffd7b5 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:25.509277 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a72dbb-693f-490a-a278-ea359d6d1fba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:44:25.522520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-11a72dbb-693f-490a-a278-ea359d6d1fba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 03:44:25.522520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:25.522520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:25.522520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:25.522520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:25.522520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:25.522520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:25.522520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:25.522520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:25.522520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:25.522520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:25.522520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:25.522520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:44:25.522520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:44:25.522520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:44:25.522520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:44:25.523743 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:44:25.523743 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:44:25.523743 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:44:25.523743 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:44:25.523743 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:25.523743 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:25.523743 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:25.523743 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:25.523743 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:25.523743 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:25.523743 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:25.523743 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:25.523743 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:25.523743 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:25.523743 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:25.523743 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:25.524783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:25.524783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:25.524783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:25.524783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:25.524783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:44:25.524783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:44:25.524783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:44:25.524783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:44:25.524783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:44:25.524783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:44:25.524783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 03:44:25.524783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:25.524783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 426/849] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Jul 1 03:44:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 03:44:25.526691 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb244ab7-361f-4fea-b5ab-57a11a88065d None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:25.527138 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb244ab7-361f-4fea-b5ab-57a11a88065d None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:25.532555 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb244ab7-361f-4fea-b5ab-57a11a88065d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:25.537289 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:25.559184 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-eb244ab7-361f-4fea-b5ab-57a11a88065d None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:44:25.561252 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-eb244ab7-361f-4fea-b5ab-57a11a88065d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:44:25.574671 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:25.654949 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 427/850] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:44:25 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:44:25.657357 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb244ab7-361f-4fea-b5ab-57a11a88065d None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:25.718749 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0039c9b-1c9a-413f-b04e-e5ac3bffd7b5 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:25.783913 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43b95c-fca4-4b93-9792-074120652103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:25.785012 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43b95c-fca4-4b93-9792-074120652103 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:25.785502 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43b95c-fca4-4b93-9792-074120652103 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:25.785972 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43b95c-fca4-4b93-9792-074120652103 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:25.787530 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43b95c-fca4-4b93-9792-074120652103 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:25.788061 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43b95c-fca4-4b93-9792-074120652103 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:25.790615 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43b95c-fca4-4b93-9792-074120652103 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:25.801723 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb244ab7-361f-4fea-b5ab-57a11a88065d None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:25.812485 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 424/851] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:44:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:25.812485 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43b95c-fca4-4b93-9792-074120652103 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:25.847211 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33caac-47ab-4482-ae0b-8d96b6823e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:25.847941 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33caac-47ab-4482-ae0b-8d96b6823e24 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:25.848221 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33caac-47ab-4482-ae0b-8d96b6823e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:25.848504 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33caac-47ab-4482-ae0b-8d96b6823e24 None admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:25.849270 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f33caac-47ab-4482-ae0b-8d96b6823e24 None admin] RBAC: Adding query filter params (name=service) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:25.849582 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f33caac-47ab-4482-ae0b-8d96b6823e24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:25.851089 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f33caac-47ab-4482-ae0b-8d96b6823e24 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:25.867295 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 428/852] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Jul 1 03:44:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:25.867295 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33caac-47ab-4482-ae0b-8d96b6823e24 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:25.874571 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:25.954076 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:25.997249 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43b95c-fca4-4b93-9792-074120652103 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:26.050862 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d356442-6ed7-42c7-b29f-1d2142c79595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:26.051858 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d356442-6ed7-42c7-b29f-1d2142c79595 None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:26.051858 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d356442-6ed7-42c7-b29f-1d2142c79595 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:26.052128 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d356442-6ed7-42c7-b29f-1d2142c79595 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:26.052764 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d356442-6ed7-42c7-b29f-1d2142c79595 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:26.054173 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d356442-6ed7-42c7-b29f-1d2142c79595 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:26.066630 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33caac-47ab-4482-ae0b-8d96b6823e24 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:26.105182 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e4735-b0fa-4375-bc4a-01e59e9bfe20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:26.106029 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e4735-b0fa-4375-bc4a-01e59e9bfe20 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:26.106448 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e4735-b0fa-4375-bc4a-01e59e9bfe20 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:26.106591 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e4735-b0fa-4375-bc4a-01e59e9bfe20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:26.118347 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80e4735-b0fa-4375-bc4a-01e59e9bfe20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:26.119842 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80e4735-b0fa-4375-bc4a-01e59e9bfe20 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:26.138716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-e80e4735-b0fa-4375-bc4a-01e59e9bfe20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:26.138716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:26.138716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:26.138716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:26.138716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:26.138716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:26.138716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:26.138716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:26.138716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:26.138716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:26.138716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:26.138716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:26.138716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:44:26.138716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:44:26.138716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:44:26.146997 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:44:26.146997 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:26.146997 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:26.146997 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:26.146997 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:26.146997 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:26.146997 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:26.146997 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:26.146997 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:26.146997 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:26.146997 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:26.146997 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:26.146997 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:26.146997 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:26.146997 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:26.146997 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:26.146997 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:26.148720 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:44:26.148720 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:44:26.148720 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:26.148720 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:26.148720 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 429/853] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:44:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:26.148720 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e4735-b0fa-4375-bc4a-01e59e9bfe20 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:26.201213 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:26.210240 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 425/854] 10.222.0.46 () {60 vars in 1141 bytes} [Fri Jul 1 03:44:25 2022] POST /identity/v3/services => generated 269 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 03:44:26.211644 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1fdbc-b271-4009-a898-952b9cc8b852 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:26.211931 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1fdbc-b271-4009-a898-952b9cc8b852 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:26.212206 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1fdbc-b271-4009-a898-952b9cc8b852 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:26.213867 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 426/855] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:44:26.214305 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1fdbc-b271-4009-a898-952b9cc8b852 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:26.268164 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e4735-b0fa-4375-bc4a-01e59e9bfe20 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:26.341456 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed91dde-18b2-4c53-b408-a218062af419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:26.342653 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed91dde-18b2-4c53-b408-a218062af419 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:26.343004 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed91dde-18b2-4c53-b408-a218062af419 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:26.343370 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed91dde-18b2-4c53-b408-a218062af419 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:26.362886 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed91dde-18b2-4c53-b408-a218062af419 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:26.364270 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed91dde-18b2-4c53-b408-a218062af419 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:26.367571 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1fdbc-b271-4009-a898-952b9cc8b852 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:26.400050 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-0ed91dde-18b2-4c53-b408-a218062af419 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:26.400050 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:26.400050 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:26.400050 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:26.400050 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:26.400050 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:26.400050 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:26.400050 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:26.400050 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:26.400050 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:26.400050 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:26.400050 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:26.400050 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:44:26.400050 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:44:26.400050 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:44:26.401306 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:44:26.401306 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:26.401306 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:26.401306 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:26.401306 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:26.401306 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:26.401306 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:26.401306 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:26.401306 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:26.401306 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:26.401306 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:26.401306 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:26.401306 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:26.401306 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:26.401306 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:26.401306 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:26.401306 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:26.402183 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:44:26.402183 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:44:26.402183 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:26.402183 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:26.402606 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 430/856] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:44:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:26.405554 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f88d2-cb75-456e-90dd-e2bd2aab2d48 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:26.405554 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f88d2-cb75-456e-90dd-e2bd2aab2d48 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:26.405954 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f88d2-cb75-456e-90dd-e2bd2aab2d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:26.428972 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-013f88d2-cb75-456e-90dd-e2bd2aab2d48 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:44:26.430087 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb794d0-1720-4cbf-b7b8-a72c502ef516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:26.430219 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-013f88d2-cb75-456e-90dd-e2bd2aab2d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:44:26.431179 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb794d0-1720-4cbf-b7b8-a72c502ef516 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:26.431701 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb794d0-1720-4cbf-b7b8-a72c502ef516 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:26.432133 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb794d0-1720-4cbf-b7b8-a72c502ef516 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:26.434788 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb794d0-1720-4cbf-b7b8-a72c502ef516 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:26.435309 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb794d0-1720-4cbf-b7b8-a72c502ef516 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:26.438708 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb794d0-1720-4cbf-b7b8-a72c502ef516 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:26.446017 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:26.464974 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 427/857] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:44:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:26.467546 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb794d0-1720-4cbf-b7b8-a72c502ef516 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:26.543193 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 431/858] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:44:26 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:44:26.543193 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f88d2-cb75-456e-90dd-e2bd2aab2d48 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:26.597635 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:26.658140 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb794d0-1720-4cbf-b7b8-a72c502ef516 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:26.703697 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4bbc2-1737-43b0-b486-661ef5526225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:26.704398 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4bbc2-1737-43b0-b486-661ef5526225 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:26.704683 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4bbc2-1737-43b0-b486-661ef5526225 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:26.704951 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4bbc2-1737-43b0-b486-661ef5526225 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:26.705687 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4bbc2-1737-43b0-b486-661ef5526225 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:26.706002 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4bbc2-1737-43b0-b486-661ef5526225 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:26.707423 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4bbc2-1737-43b0-b486-661ef5526225 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:26.716453 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f88d2-cb75-456e-90dd-e2bd2aab2d48 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:26.721050 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 428/859] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:44:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:26.721896 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4bbc2-1737-43b0-b486-661ef5526225 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:26.788074 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a0535-3f5b-4838-ae38-8a4a9f06e71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:26.789744 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a0535-3f5b-4838-ae38-8a4a9f06e71f None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:26.790408 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a0535-3f5b-4838-ae38-8a4a9f06e71f None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:26.791041 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a0535-3f5b-4838-ae38-8a4a9f06e71f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:26.805143 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a0535-3f5b-4838-ae38-8a4a9f06e71f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:26.807759 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a0535-3f5b-4838-ae38-8a4a9f06e71f None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:26.817212 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:26.833128 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-1a2a0535-3f5b-4838-ae38-8a4a9f06e71f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 01 03:44:26.833128 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:26.833128 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:26.833128 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:26.833128 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:26.833128 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:26.833128 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:26.833128 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:26.833128 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:26.833128 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:26.833128 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:26.833128 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:26.833128 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 03:44:26.833128 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 03:44:26.833128 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 03:44:26.833128 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 03:44:26.835037 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:26.835037 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:26.835037 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 03:44:26.835037 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:44:26.835037 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 03:44:26.835037 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:44:26.835037 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:26.835037 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:26.835037 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:26.835037 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:26.835037 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:26.835037 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:26.835037 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:26.835037 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:26.835037 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:26.835037 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:26.835037 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:26.835037 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:26.837510 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:26.837510 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:26.837510 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 03:44:26.837510 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 03:44:26.837510 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 03:44:26.837510 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 03:44:26.837510 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 03:44:26.837510 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 03:44:26.837510 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 01 03:44:26.837510 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:26.837510 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 432/860] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 1 03:44:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:26.837510 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a0535-3f5b-4838-ae38-8a4a9f06e71f None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:26.901329 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4bbc2-1737-43b0-b486-661ef5526225 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:26.960211 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16657a81-27f8-46b6-b2dc-e1ec68b1c6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:26.961267 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16657a81-27f8-46b6-b2dc-e1ec68b1c6c1 None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:26.961725 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16657a81-27f8-46b6-b2dc-e1ec68b1c6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:26.962182 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16657a81-27f8-46b6-b2dc-e1ec68b1c6c1 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:26.963402 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16657a81-27f8-46b6-b2dc-e1ec68b1c6c1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:26.965532 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16657a81-27f8-46b6-b2dc-e1ec68b1c6c1 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:26.991643 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:27.002691 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a0535-3f5b-4838-ae38-8a4a9f06e71f None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:27.064696 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c5638-c12f-4703-9deb-75a8cf6afd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:27.066181 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c5638-c12f-4703-9deb-75a8cf6afd6a None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:27.066551 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c5638-c12f-4703-9deb-75a8cf6afd6a None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:27.067040 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c5638-c12f-4703-9deb-75a8cf6afd6a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:27.068455 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 429/861] 10.222.0.46 () {60 vars in 1141 bytes} [Fri Jul 1 03:44:26 2022] POST /identity/v3/services => generated 251 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 03:44:27.069883 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16657a81-27f8-46b6-b2dc-e1ec68b1c6c1 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:27.092755 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c5638-c12f-4703-9deb-75a8cf6afd6a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:27.096901 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c5638-c12f-4703-9deb-75a8cf6afd6a None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:27.136438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-736c5638-c12f-4703-9deb-75a8cf6afd6a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 01 03:44:27.136438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:27.136438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:27.136438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:27.136438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:27.136438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:27.136438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:27.136438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:27.136438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:27.136438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:27.136438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:27.136438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:27.136438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 03:44:27.136438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 03:44:27.136438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 03:44:27.136438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 03:44:27.138341 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:27.138341 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:27.138341 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 03:44:27.138341 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:44:27.138341 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 03:44:27.138341 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:44:27.138341 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:27.138341 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:27.138341 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:27.138341 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:27.138341 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:27.138341 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:27.138341 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:27.138341 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:27.138341 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:27.138341 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:27.138341 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:27.138341 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:27.140291 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:27.140291 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:27.140291 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 03:44:27.140291 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 03:44:27.140291 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 03:44:27.140291 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 03:44:27.140291 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 03:44:27.140291 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 03:44:27.140291 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 01 03:44:27.140291 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:27.143700 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 433/862] 10.222.0.46 () {56 vars in 1117 bytes} [Fri Jul 1 03:44:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:27.156210 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c5638-c12f-4703-9deb-75a8cf6afd6a None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:27.293046 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16657a81-27f8-46b6-b2dc-e1ec68b1c6c1 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:27.317779 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:27.366124 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ef6c2-fd61-4608-81a2-436d987428d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:27.367594 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ef6c2-fd61-4608-81a2-436d987428d7 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:27.368606 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ef6c2-fd61-4608-81a2-436d987428d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:27.369065 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ef6c2-fd61-4608-81a2-436d987428d7 None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:27.370950 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ef6c2-fd61-4608-81a2-436d987428d7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:27.371510 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ef6c2-fd61-4608-81a2-436d987428d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:27.375176 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ef6c2-fd61-4608-81a2-436d987428d7 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:27.384096 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c5638-c12f-4703-9deb-75a8cf6afd6a None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:27.415880 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 430/863] 10.222.0.46 () {56 vars in 1135 bytes} [Fri Jul 1 03:44:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:27.423317 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ef6c2-fd61-4608-81a2-436d987428d7 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:27.452096 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35408cf9-d2d5-4fdc-80fc-0f2dae4a3a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:27.453636 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35408cf9-d2d5-4fdc-80fc-0f2dae4a3a5d None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:27.454111 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35408cf9-d2d5-4fdc-80fc-0f2dae4a3a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:27.454629 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35408cf9-d2d5-4fdc-80fc-0f2dae4a3a5d None admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:27.456202 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35408cf9-d2d5-4fdc-80fc-0f2dae4a3a5d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:27.456685 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35408cf9-d2d5-4fdc-80fc-0f2dae4a3a5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:27.458985 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35408cf9-d2d5-4fdc-80fc-0f2dae4a3a5d None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:27.491736 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 434/864] 10.222.0.46 () {56 vars in 1149 bytes} [Fri Jul 1 03:44:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:44:27.505536 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35408cf9-d2d5-4fdc-80fc-0f2dae4a3a5d None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:27.542497 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:27.649648 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ef6c2-fd61-4608-81a2-436d987428d7 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:27.714365 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35408cf9-d2d5-4fdc-80fc-0f2dae4a3a5d None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:27.720544 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a18813-7d26-465f-93c6-e9125a77bdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:27.722122 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a18813-7d26-465f-93c6-e9125a77bdf5 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:27.722920 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a18813-7d26-465f-93c6-e9125a77bdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:27.723701 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a18813-7d26-465f-93c6-e9125a77bdf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:27.783359 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918ef78-27da-456a-8ae7-3a9fe416898f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:27.784553 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918ef78-27da-456a-8ae7-3a9fe416898f None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:27.785060 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918ef78-27da-456a-8ae7-3a9fe416898f None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:27.785541 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918ef78-27da-456a-8ae7-3a9fe416898f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:27.805773 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:27.862194 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a18813-7d26-465f-93c6-e9125a77bdf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:27.865158 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a18813-7d26-465f-93c6-e9125a77bdf5 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:27.928728 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c918ef78-27da-456a-8ae7-3a9fe416898f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:27.932257 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c918ef78-27da-456a-8ae7-3a9fe416898f None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:27.960896 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:28.065559 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 431/865] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:44:27 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 644 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 03:44:28.073525 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a18813-7d26-465f-93c6-e9125a77bdf5 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:28.143961 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 435/866] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:44:27 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 634 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 03:44:28.149130 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918ef78-27da-456a-8ae7-3a9fe416898f None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:28.214282 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:28.276868 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a18813-7d26-465f-93c6-e9125a77bdf5 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:28.348891 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed416f36-c2b2-4818-8571-4440fdb85bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:28.350564 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed416f36-c2b2-4818-8571-4440fdb85bdb None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:28.351211 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed416f36-c2b2-4818-8571-4440fdb85bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:28.351877 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed416f36-c2b2-4818-8571-4440fdb85bdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:28.354988 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918ef78-27da-456a-8ae7-3a9fe416898f None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:28.373345 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed416f36-c2b2-4818-8571-4440fdb85bdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:28.377245 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed416f36-c2b2-4818-8571-4440fdb85bdb None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:28.384366 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:28.411360 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f5683-3e13-4101-8517-901063497da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:28.412733 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f5683-3e13-4101-8517-901063497da5 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:28.413197 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f5683-3e13-4101-8517-901063497da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:28.413616 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f5683-3e13-4101-8517-901063497da5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:28.418524 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-ed416f36-c2b2-4818-8571-4440fdb85bdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:28.418524 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:28.418524 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:28.418524 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:28.418524 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:28.418524 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:28.418524 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:28.418524 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:28.418524 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:28.418524 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:28.418524 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:28.418524 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:28.418524 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:44:28.418524 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:44:28.418524 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:44:28.419686 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:44:28.419686 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:28.419686 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:28.419686 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:28.419686 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:28.419686 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:28.419686 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:28.419686 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:28.419686 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:28.419686 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:28.419686 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:28.419686 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:28.419686 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:28.419686 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:28.419686 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:28.419686 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:28.419686 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:28.420592 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:44:28.420592 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:44:28.420592 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:28.420592 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:28.422539 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 432/867] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:44:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:28.429445 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f5683-3e13-4101-8517-901063497da5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:28.430624 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed416f36-c2b2-4818-8571-4440fdb85bdb None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:28.431499 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f5683-3e13-4101-8517-901063497da5 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:28.451837 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-ba6f5683-3e13-4101-8517-901063497da5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:28.451837 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:28.451837 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:28.451837 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:28.451837 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:28.451837 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:28.451837 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:28.451837 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:28.451837 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:28.451837 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:28.451837 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:28.451837 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:28.451837 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:44:28.451837 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:44:28.451837 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:44:28.453523 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:44:28.453523 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:28.453523 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:28.453523 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:28.453523 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:28.453523 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:28.453523 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:28.453523 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:28.453523 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:28.453523 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:28.453523 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:28.453523 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:28.453523 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:28.453523 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:28.453523 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:28.453523 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:28.453523 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:28.455263 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:44:28.455263 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:44:28.455263 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:28.455263 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:28.457943 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 436/868] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:44:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 03:44:28.459411 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f5683-3e13-4101-8517-901063497da5 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:28.635617 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f5683-3e13-4101-8517-901063497da5 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:28.668107 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed416f36-c2b2-4818-8571-4440fdb85bdb None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:28.701493 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2b133-53ad-4725-9cc0-688949da2059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:28.702662 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2b133-53ad-4725-9cc0-688949da2059 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:28.703777 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2b133-53ad-4725-9cc0-688949da2059 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:28.704285 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2b133-53ad-4725-9cc0-688949da2059 None admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:28.705665 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc2b133-53ad-4725-9cc0-688949da2059 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:28.706230 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc2b133-53ad-4725-9cc0-688949da2059 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:28.708883 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc2b133-53ad-4725-9cc0-688949da2059 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:28.719702 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:28.733669 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 437/869] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:44:28.742314 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d615a-b76a-4ab4-90ef-a2e3a023fd98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:28.742532 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2b133-53ad-4725-9cc0-688949da2059 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:28.744174 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d615a-b76a-4ab4-90ef-a2e3a023fd98 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:28.744930 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d615a-b76a-4ab4-90ef-a2e3a023fd98 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:28.745714 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d615a-b76a-4ab4-90ef-a2e3a023fd98 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:28.747576 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36d615a-b76a-4ab4-90ef-a2e3a023fd98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:28.748554 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36d615a-b76a-4ab4-90ef-a2e3a023fd98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:28.752027 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36d615a-b76a-4ab4-90ef-a2e3a023fd98 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:28.775711 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 433/870] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:28.782077 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d615a-b76a-4ab4-90ef-a2e3a023fd98 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:28.797527 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:28.975600 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d615a-b76a-4ab4-90ef-a2e3a023fd98 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:28.978004 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2b133-53ad-4725-9cc0-688949da2059 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:29.021331 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f8e7a-279b-4679-9ba7-8f9061632a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:29.022510 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f8e7a-279b-4679-9ba7-8f9061632a4c None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:29.022797 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f8e7a-279b-4679-9ba7-8f9061632a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:29.023338 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f8e7a-279b-4679-9ba7-8f9061632a4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:29.032960 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27f8e7a-279b-4679-9ba7-8f9061632a4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:29.034530 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27f8e7a-279b-4679-9ba7-8f9061632a4c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:29.040854 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e253c0-5ffb-41eb-96c8-9f3d480e867b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:29.042418 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e253c0-5ffb-41eb-96c8-9f3d480e867b None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:29.042920 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e253c0-5ffb-41eb-96c8-9f3d480e867b None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:29.043418 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e253c0-5ffb-41eb-96c8-9f3d480e867b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:29.050130 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-e27f8e7a-279b-4679-9ba7-8f9061632a4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:44:29.050130 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:29.050130 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:29.050130 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:29.050130 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:29.050130 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:29.050130 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:29.050130 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:29.050130 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:29.050130 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:29.050130 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:29.050130 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:29.050130 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 03:44:29.050130 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 03:44:29.050130 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 03:44:29.051084 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 03:44:29.051084 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:29.051084 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:29.051084 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:29.051084 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:29.051084 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:29.051084 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:29.051084 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:29.051084 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:29.051084 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:29.051084 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:29.051084 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:29.051084 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:29.051084 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:29.051084 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:29.051084 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:29.051084 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:29.052065 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 03:44:29.052065 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 03:44:29.052065 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 03:44:29.052065 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 03:44:29.052065 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 03:44:29.052065 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 03:44:29.052065 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:44:29.052065 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:29.055762 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 434/871] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:44:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 03:44:29.056787 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e253c0-5ffb-41eb-96c8-9f3d480e867b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:29.057644 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ad3ce-c533-4256-be0f-451f77e78525 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:29.057644 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ad3ce-c533-4256-be0f-451f77e78525 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:29.057644 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ad3ce-c533-4256-be0f-451f77e78525 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:29.063717 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e253c0-5ffb-41eb-96c8-9f3d480e867b None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:29.063883 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 435/872] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:44:29.063883 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ad3ce-c533-4256-be0f-451f77e78525 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:29.089839 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-33e253c0-5ffb-41eb-96c8-9f3d480e867b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:44:29.089839 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:29.089839 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:29.089839 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:29.089839 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:29.089839 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:29.089839 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:29.089839 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:29.089839 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:29.089839 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:29.089839 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:29.089839 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:29.089839 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 03:44:29.089839 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 03:44:29.089839 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 03:44:29.098143 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 03:44:29.098143 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:29.098143 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:29.098143 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:29.098143 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:29.098143 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:29.098143 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:29.098143 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:29.098143 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:29.098143 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:29.098143 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:29.098143 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:29.098143 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:29.098143 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:29.098143 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:29.098143 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:29.098143 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:29.099016 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 03:44:29.099016 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 03:44:29.099016 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 03:44:29.099016 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 03:44:29.099016 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 03:44:29.099016 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 03:44:29.099016 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:44:29.099016 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:29.099016 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 438/873] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:44:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:29.099016 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6841c-c88c-49c8-a956-d01a74210c77 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:29.099016 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6841c-c88c-49c8-a956-d01a74210c77 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:29.099641 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6841c-c88c-49c8-a956-d01a74210c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:29.122839 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:29.128635 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-32b6841c-c88c-49c8-a956-d01a74210c77 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:44:29.130731 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-32b6841c-c88c-49c8-a956-d01a74210c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:44:29.197722 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ad3ce-c533-4256-be0f-451f77e78525 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:29.243539 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7bf4f-dc1f-4578-b227-f9d6e12108e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:29.244128 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7bf4f-dc1f-4578-b227-f9d6e12108e0 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:29.244418 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7bf4f-dc1f-4578-b227-f9d6e12108e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:29.244684 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7bf4f-dc1f-4578-b227-f9d6e12108e0 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:29.245489 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7bf4f-dc1f-4578-b227-f9d6e12108e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:29.245800 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7bf4f-dc1f-4578-b227-f9d6e12108e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:29.247289 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7bf4f-dc1f-4578-b227-f9d6e12108e0 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:29.270608 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 436/874] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 1 03:44:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:29.270608 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7bf4f-dc1f-4578-b227-f9d6e12108e0 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:29.271003 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 439/875] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:44:29 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:44:29.273821 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b6841c-c88c-49c8-a956-d01a74210c77 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:29.293260 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:29.401931 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b6841c-c88c-49c8-a956-d01a74210c77 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:29.402369 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7bf4f-dc1f-4578-b227-f9d6e12108e0 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:29.404781 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:29.441164 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2d643-10ed-4509-aae7-f86f672d683e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:29.441824 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2d643-10ed-4509-aae7-f86f672d683e None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:29.442100 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2d643-10ed-4509-aae7-f86f672d683e None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:29.442373 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2d643-10ed-4509-aae7-f86f672d683e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:29.442633 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a445d7-a1c2-4dae-9787-671b4c74f404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:29.443205 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2d643-10ed-4509-aae7-f86f672d683e None admin] RBAC: Adding query filter params (role.id=681755518698445fabd9a8accec13c0f, scope.project.id=da83db15a312499fb627691ae442f233, user.id=83787880173b459c8975b834bd47a51a) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:29.443501 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a445d7-a1c2-4dae-9787-671b4c74f404 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:29.443689 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2d643-10ed-4509-aae7-f86f672d683e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:29.443953 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a445d7-a1c2-4dae-9787-671b4c74f404 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:29.444321 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a445d7-a1c2-4dae-9787-671b4c74f404 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:29.444965 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2d643-10ed-4509-aae7-f86f672d683e None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:29.445290 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a445d7-a1c2-4dae-9787-671b4c74f404 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:29.445691 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a445d7-a1c2-4dae-9787-671b4c74f404 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:29.447370 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a445d7-a1c2-4dae-9787-671b4c74f404 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:29.451789 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 440/876] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:44:29 2022] GET /identity/v3/role_assignments?user.id=83787880173b459c8975b834bd47a51a&scope.project.id=da83db15a312499fb627691ae442f233&role.id=681755518698445fabd9a8accec13c0f => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:44:29.452615 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2d643-10ed-4509-aae7-f86f672d683e None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:29.478379 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 437/877] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 1 03:44:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:29.478379 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b4c2b-8327-4102-9c41-aa84151f39b2 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:29.478379 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b4c2b-8327-4102-9c41-aa84151f39b2 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:29.478379 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b4c2b-8327-4102-9c41-aa84151f39b2 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:29.478379 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 438/878] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:44:29.479554 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b4c2b-8327-4102-9c41-aa84151f39b2 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:29.581161 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:29.620758 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2d643-10ed-4509-aae7-f86f672d683e None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:29.639708 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b4c2b-8327-4102-9c41-aa84151f39b2 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:29.677331 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a63140-a4e8-402d-97e4-785e360081e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:29.678173 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a63140-a4e8-402d-97e4-785e360081e7 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:29.678456 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a63140-a4e8-402d-97e4-785e360081e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:29.679238 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a63140-a4e8-402d-97e4-785e360081e7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:29.679426 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a63140-a4e8-402d-97e4-785e360081e7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:29.680845 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a63140-a4e8-402d-97e4-785e360081e7 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:29.694652 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-92a63140-a4e8-402d-97e4-785e360081e7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 01 03:44:29.694652 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:29.694652 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 03:44:29.694652 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 03:44:29.694652 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 03:44:29.694652 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 03:44:29.694652 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 03:44:29.694652 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:44:29.694652 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 01 03:44:29.694652 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:29.694652 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 03:44:29.694652 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:29.694652 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:29.694652 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:29.694652 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:29.694652 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:29.695803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:29.695803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:29.695803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:29.695803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:29.695803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:29.695803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:29.695803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:29.695803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 03:44:29.695803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 03:44:29.695803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 03:44:29.695803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 03:44:29.695803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:29.695803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:29.695803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:29.695803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:29.695803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:29.696705 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:29.696705 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:29.696705 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:29.696705 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:29.696705 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:29.696705 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:29.696705 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:29.696705 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:29.696705 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:29.696705 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:29.696705 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:29.696705 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 03:44:29.696705 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:44:29.696705 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 01 03:44:29.696705 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:29.696705 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 441/879] 10.222.0.46 () {56 vars in 1132 bytes} [Fri Jul 1 03:44:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:29.697614 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f66c27-8112-4523-bdae-4f832c0715ba None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:29.697614 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f66c27-8112-4523-bdae-4f832c0715ba None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:29.697756 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f66c27-8112-4523-bdae-4f832c0715ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:29.705098 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb854206-d409-4299-bb3f-3bdbcbfde227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:29.706043 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb854206-d409-4299-bb3f-3bdbcbfde227 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:29.706541 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb854206-d409-4299-bb3f-3bdbcbfde227 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:29.706972 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb854206-d409-4299-bb3f-3bdbcbfde227 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:29.708115 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb854206-d409-4299-bb3f-3bdbcbfde227 None admin] RBAC: Adding query filter params (role.id=66426d7dd6f64f6ebfcb1cbb8188b0d2, scope.project.id=da83db15a312499fb627691ae442f233, user.id=dd41221abea04808bed5ef4ac4528c62) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:29.708594 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb854206-d409-4299-bb3f-3bdbcbfde227 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:29.710318 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb854206-d409-4299-bb3f-3bdbcbfde227 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:29.715103 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-85f66c27-8112-4523-bdae-4f832c0715ba None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:44:29.716357 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-85f66c27-8112-4523-bdae-4f832c0715ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:44:29.718398 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 439/880] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:44:29 2022] GET /identity/v3/role_assignments?user.id=dd41221abea04808bed5ef4ac4528c62&scope.project.id=da83db15a312499fb627691ae442f233&role.id=66426d7dd6f64f6ebfcb1cbb8188b0d2 => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:29.719340 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb854206-d409-4299-bb3f-3bdbcbfde227 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:29.765913 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:29.808805 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 442/881] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:44:29 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:44:29.842189 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f66c27-8112-4523-bdae-4f832c0715ba None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:29.887247 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb854206-d409-4299-bb3f-3bdbcbfde227 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:29.924278 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:29.939242 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce018369-6bc3-4a45-9755-cdfd798a642f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:29.944770 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce018369-6bc3-4a45-9755-cdfd798a642f None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:29.944770 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce018369-6bc3-4a45-9755-cdfd798a642f None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:29.944770 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce018369-6bc3-4a45-9755-cdfd798a642f None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:29.944770 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce018369-6bc3-4a45-9755-cdfd798a642f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:29.944770 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce018369-6bc3-4a45-9755-cdfd798a642f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:29.944770 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce018369-6bc3-4a45-9755-cdfd798a642f None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:29.949557 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 440/882] 10.222.0.46 () {56 vars in 1126 bytes} [Fri Jul 1 03:44:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:29.958881 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce018369-6bc3-4a45-9755-cdfd798a642f None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:29.963684 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f66c27-8112-4523-bdae-4f832c0715ba None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:30.021697 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf35896-8856-4482-a2e8-4cd4311f16f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:30.023071 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf35896-8856-4482-a2e8-4cd4311f16f9 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:30.023602 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf35896-8856-4482-a2e8-4cd4311f16f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:30.024111 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf35896-8856-4482-a2e8-4cd4311f16f9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:30.025349 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf35896-8856-4482-a2e8-4cd4311f16f9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:30.029126 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf35896-8856-4482-a2e8-4cd4311f16f9 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:30.055288 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-eaf35896-8856-4482-a2e8-4cd4311f16f9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 01 03:44:30.055288 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:30.055288 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 03:44:30.055288 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 03:44:30.055288 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 03:44:30.055288 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 03:44:30.055288 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 03:44:30.055288 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:44:30.055288 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 01 03:44:30.055288 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:30.055288 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 03:44:30.055288 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:30.055288 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:30.055288 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:30.055288 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:30.055288 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:30.055288 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:30.056600 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:30.056600 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:30.056600 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:30.056600 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:30.056600 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:30.056600 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:30.056600 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 03:44:30.056600 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 03:44:30.056600 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 03:44:30.056600 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 03:44:30.056600 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:30.056600 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:30.056600 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:30.056600 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:30.056600 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:30.056600 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:30.057631 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:30.057631 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:30.057631 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:30.057631 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:30.057631 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:30.057631 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:30.057631 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:30.057631 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:30.057631 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:30.057631 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:30.057631 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 03:44:30.057631 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:44:30.057631 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 01 03:44:30.057631 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:30.059159 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 443/883] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Jul 1 03:44:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 03:44:30.065996 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf35896-8856-4482-a2e8-4cd4311f16f9 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:30.090504 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:30.107940 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce018369-6bc3-4a45-9755-cdfd798a642f None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:30.185064 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f6a9e-ce42-446e-8b35-69cbc7002f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:30.186359 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f6a9e-ce42-446e-8b35-69cbc7002f3c None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:30.186832 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f6a9e-ce42-446e-8b35-69cbc7002f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:30.187355 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f6a9e-ce42-446e-8b35-69cbc7002f3c None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:30.189372 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f6a9e-ce42-446e-8b35-69cbc7002f3c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:30.189918 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f6a9e-ce42-446e-8b35-69cbc7002f3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:30.193415 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f6a9e-ce42-446e-8b35-69cbc7002f3c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:30.203482 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 441/884] 10.222.0.46 () {56 vars in 1126 bytes} [Fri Jul 1 03:44:29 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:30.213313 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f6a9e-ce42-446e-8b35-69cbc7002f3c None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:30.225786 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf35896-8856-4482-a2e8-4cd4311f16f9 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:30.264168 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea36a2b-16f6-4e51-89eb-9d92114c8fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:30.265247 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea36a2b-16f6-4e51-89eb-9d92114c8fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:30.266316 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea36a2b-16f6-4e51-89eb-9d92114c8fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:30.266801 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea36a2b-16f6-4e51-89eb-9d92114c8fd9 None admin] PATH_INFO: `/v3/services` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:30.267805 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea36a2b-16f6-4e51-89eb-9d92114c8fd9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:30.268362 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea36a2b-16f6-4e51-89eb-9d92114c8fd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:30.269975 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea36a2b-16f6-4e51-89eb-9d92114c8fd9 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:30.272479 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:30.278191 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 444/885] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Jul 1 03:44:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:30.284880 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea36a2b-16f6-4e51-89eb-9d92114c8fd9 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:30.362705 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f6a9e-ce42-446e-8b35-69cbc7002f3c None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:30.399109 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb08fd-9dd0-4787-96ff-868a024571b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:30.399804 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb08fd-9dd0-4787-96ff-868a024571b5 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:30.400085 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb08fd-9dd0-4787-96ff-868a024571b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:30.400372 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb08fd-9dd0-4787-96ff-868a024571b5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:30.400526 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea36a2b-16f6-4e51-89eb-9d92114c8fd9 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:30.401151 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb08fd-9dd0-4787-96ff-868a024571b5 None admin] RBAC: Adding query filter params (interface=public, service_id=b257dee6113c4da7a965e2be0729106f, region_id=RegionOne) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:30.401464 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb08fd-9dd0-4787-96ff-868a024571b5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:30.402859 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb08fd-9dd0-4787-96ff-868a024571b5 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:30.416476 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 442/886] 10.222.0.46 () {56 vars in 1251 bytes} [Fri Jul 1 03:44:30 2022] GET /identity/v3/endpoints?service_id=b257dee6113c4da7a965e2be0729106f&interface=public®ion_id=RegionOne => generated 194 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:30.417858 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb08fd-9dd0-4787-96ff-868a024571b5 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:30.438591 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56efdd20-1c9d-4ead-a471-67104b95419f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:30.439278 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efdd20-1c9d-4ead-a471-67104b95419f None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:30.439593 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efdd20-1c9d-4ead-a471-67104b95419f None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:30.439854 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efdd20-1c9d-4ead-a471-67104b95419f None admin] PATH_INFO: `/v3/services` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:30.440588 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56efdd20-1c9d-4ead-a471-67104b95419f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:30.440876 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56efdd20-1c9d-4ead-a471-67104b95419f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:30.442276 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56efdd20-1c9d-4ead-a471-67104b95419f None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:30.448494 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 445/887] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Jul 1 03:44:30 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:30.449036 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:30.460968 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56efdd20-1c9d-4ead-a471-67104b95419f None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:30.532509 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb08fd-9dd0-4787-96ff-868a024571b5 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:30.572071 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1121c92-e777-4f39-9f74-a532f0bce0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:30.572854 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1121c92-e777-4f39-9f74-a532f0bce0ed None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:30.573137 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1121c92-e777-4f39-9f74-a532f0bce0ed None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:30.573457 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1121c92-e777-4f39-9f74-a532f0bce0ed None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:30.574170 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1121c92-e777-4f39-9f74-a532f0bce0ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:30.575656 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1121c92-e777-4f39-9f74-a532f0bce0ed None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:30.587739 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 443/888] 10.222.0.46 () {56 vars in 1087 bytes} [Fri Jul 1 03:44:30 2022] GET /identity/v3/services => generated 1268 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 03:44:30.600419 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:30.678210 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56efdd20-1c9d-4ead-a471-67104b95419f None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:30.745744 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e9179-e389-4249-9302-c5b8937047b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:30.746868 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e9179-e389-4249-9302-c5b8937047b5 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:30.747337 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e9179-e389-4249-9302-c5b8937047b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:30.747883 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e9179-e389-4249-9302-c5b8937047b5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:30.748962 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1e9179-e389-4249-9302-c5b8937047b5 None admin] RBAC: Adding query filter params (interface=public, service_id=b62a0f42ac58426e994b546ff51b64c3, region_id=RegionOne) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:30.749537 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1e9179-e389-4249-9302-c5b8937047b5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:30.752419 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1e9179-e389-4249-9302-c5b8937047b5 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:30.768105 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 446/889] 10.222.0.46 () {56 vars in 1251 bytes} [Fri Jul 1 03:44:30 2022] GET /identity/v3/endpoints?service_id=b62a0f42ac58426e994b546ff51b64c3&interface=public®ion_id=RegionOne => generated 194 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:30.771076 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1121c92-e777-4f39-9f74-a532f0bce0ed None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:30.917153 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:30.940973 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1121c92-e777-4f39-9f74-a532f0bce0ed None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:30.977387 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae2fac-7fc5-4efc-b278-18327dbce0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:30.978070 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae2fac-7fc5-4efc-b278-18327dbce0a7 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:30.978348 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae2fac-7fc5-4efc-b278-18327dbce0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:30.978623 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae2fac-7fc5-4efc-b278-18327dbce0a7 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:30.979308 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae2fac-7fc5-4efc-b278-18327dbce0a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:30.980742 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae2fac-7fc5-4efc-b278-18327dbce0a7 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:30.988258 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 444/890] 10.222.0.46 () {56 vars in 1087 bytes} [Fri Jul 1 03:44:30 2022] GET /identity/v3/services => generated 1268 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 03:44:32.061515 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91a8bf-b5ae-4b79-88c2-0b0d3fe9a1bb None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:32.062390 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91a8bf-b5ae-4b79-88c2-0b0d3fe9a1bb None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:32.062541 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91a8bf-b5ae-4b79-88c2-0b0d3fe9a1bb None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:32.065344 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 447/891] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:44:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:44:32.074161 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74a203-41b1-4ee8-b2b1-5f8d8948e20a None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:32.074955 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74a203-41b1-4ee8-b2b1-5f8d8948e20a None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:32.075117 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74a203-41b1-4ee8-b2b1-5f8d8948e20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:32.103592 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-1f74a203-41b1-4ee8-b2b1-5f8d8948e20a None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:44:32.105552 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1f74a203-41b1-4ee8-b2b1-5f8d8948e20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:44:32.170291 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c8d81-9dec-4715-aaf8-1ae7e8ad3247 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:32.170696 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c8d81-9dec-4715-aaf8-1ae7e8ad3247 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:32.171131 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c8d81-9dec-4715-aaf8-1ae7e8ad3247 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:32.173448 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 448/892] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:44:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 03:44:32.179767 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578fefb1-2067-40a8-b51e-6948a269362a None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:32.180243 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578fefb1-2067-40a8-b51e-6948a269362a None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:32.180719 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578fefb1-2067-40a8-b51e-6948a269362a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:32.207765 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-578fefb1-2067-40a8-b51e-6948a269362a None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:44:32.209891 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-578fefb1-2067-40a8-b51e-6948a269362a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:44:32.210108 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 445/893] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:44:32 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:44:32.234861 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f74a203-41b1-4ee8-b2b1-5f8d8948e20a None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:32.336805 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:32.343936 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 449/894] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:44:32 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:44:32.379155 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f74a203-41b1-4ee8-b2b1-5f8d8948e20a None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:32.387805 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578fefb1-2067-40a8-b51e-6948a269362a None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:32.447896 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590c86c-b8c0-4a92-a662-f0dfe3b91585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:32.449152 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590c86c-b8c0-4a92-a662-f0dfe3b91585 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:32.449570 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590c86c-b8c0-4a92-a662-f0dfe3b91585 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:32.450005 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590c86c-b8c0-4a92-a662-f0dfe3b91585 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:32.451102 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590c86c-b8c0-4a92-a662-f0dfe3b91585 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:32.453578 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590c86c-b8c0-4a92-a662-f0dfe3b91585 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:32.475203 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:32.476196 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-a590c86c-b8c0-4a92-a662-f0dfe3b91585 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 03:44:32.476196 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:32.476196 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 03:44:32.476196 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 03:44:32.476196 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 03:44:32.476196 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 03:44:32.476196 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 03:44:32.476196 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:44:32.476196 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 03:44:32.476196 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:32.476196 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 03:44:32.476196 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:32.476196 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:32.476196 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:32.476196 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:32.476196 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:32.476196 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:32.477207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:32.477207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:32.477207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:32.477207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:32.477207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:32.477207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:32.477207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 03:44:32.477207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 03:44:32.477207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 03:44:32.477207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 03:44:32.477207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:32.477207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:32.477207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:32.477207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:32.477207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:32.477207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:32.478056 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:32.478056 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:32.478056 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:32.478056 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:32.478056 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:32.478056 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:32.478056 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:32.478056 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:32.478056 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:32.478056 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:32.478056 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 03:44:32.478056 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:44:32.478056 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 03:44:32.478056 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:32.491184 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 446/895] 10.222.0.46 () {56 vars in 1126 bytes} [Fri Jul 1 03:44:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 03:44:32.492790 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590c86c-b8c0-4a92-a662-f0dfe3b91585 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:32.556621 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578fefb1-2067-40a8-b51e-6948a269362a None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:32.618206 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e0e6f-bdb6-42cd-8e35-9bf4ef20f363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:32.618703 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e0e6f-bdb6-42cd-8e35-9bf4ef20f363 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:32.619176 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e0e6f-bdb6-42cd-8e35-9bf4ef20f363 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:32.619725 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e0e6f-bdb6-42cd-8e35-9bf4ef20f363 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:32.638007 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e0e6f-bdb6-42cd-8e35-9bf4ef20f363 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:44:32.653840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-6c6e0e6f-bdb6-42cd-8e35-9bf4ef20f363 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 01 03:44:32.653840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:32.653840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:32.653840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:32.653840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:32.653840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:32.653840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:32.653840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:32.653840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:32.653840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:32.653840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:32.653840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:32.653840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:44:32.653840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:44:32.653840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:44:32.653840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:44:32.655679 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:44:32.655679 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:44:32.655679 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:44:32.655679 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:44:32.655679 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:32.655679 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:32.655679 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:32.655679 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:32.655679 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:32.655679 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:32.655679 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:32.655679 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:32.655679 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:32.655679 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:32.655679 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:32.655679 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:32.657998 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:32.657998 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:32.657998 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:32.657998 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:32.657998 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:44:32.657998 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:44:32.657998 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:44:32.657998 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:44:32.657998 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:44:32.657998 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:44:32.657998 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 01 03:44:32.657998 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:32.657998 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 450/896] 10.222.0.46 () {56 vars in 1120 bytes} [Fri Jul 1 03:44:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 03:44:32.664167 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e0e6f-bdb6-42cd-8e35-9bf4ef20f363 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:32.684770 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590c86c-b8c0-4a92-a662-f0dfe3b91585 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:32.744246 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff999da-b7d4-4040-95c8-5598108d872b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:32.745797 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff999da-b7d4-4040-95c8-5598108d872b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:32.746468 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff999da-b7d4-4040-95c8-5598108d872b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:32.747108 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff999da-b7d4-4040-95c8-5598108d872b None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:32.749054 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff999da-b7d4-4040-95c8-5598108d872b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:32.750102 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff999da-b7d4-4040-95c8-5598108d872b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:32.753057 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff999da-b7d4-4040-95c8-5598108d872b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:32.763339 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 447/897] 10.222.0.46 () {56 vars in 1122 bytes} [Fri Jul 1 03:44:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:32.770435 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff999da-b7d4-4040-95c8-5598108d872b None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:32.778059 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:32.854639 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e0e6f-bdb6-42cd-8e35-9bf4ef20f363 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:32.881916 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:32.908376 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da4b48-d411-4b15-8c38-a19fb31128b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:32.909410 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da4b48-d411-4b15-8c38-a19fb31128b1 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:32.909855 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da4b48-d411-4b15-8c38-a19fb31128b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:32.910295 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da4b48-d411-4b15-8c38-a19fb31128b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:32.911988 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3da4b48-d411-4b15-8c38-a19fb31128b1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:32.912482 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3da4b48-d411-4b15-8c38-a19fb31128b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:32.914824 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3da4b48-d411-4b15-8c38-a19fb31128b1 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:32.931388 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 451/898] 10.222.0.46 () {56 vars in 1115 bytes} [Fri Jul 1 03:44:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:44:32.932934 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a005a5-f194-437d-bf40-371b1e6e8f62 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:32.933328 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a005a5-f194-437d-bf40-371b1e6e8f62 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:32.933707 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a005a5-f194-437d-bf40-371b1e6e8f62 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:32.935277 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 452/899] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:44:32.943654 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a005a5-f194-437d-bf40-371b1e6e8f62 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:32.962496 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff999da-b7d4-4040-95c8-5598108d872b None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:33.009324 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d044c-ccdc-477f-9788-8bfda2ce7f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:33.010039 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d044c-ccdc-477f-9788-8bfda2ce7f90 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:33.010319 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d044c-ccdc-477f-9788-8bfda2ce7f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:33.010644 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d044c-ccdc-477f-9788-8bfda2ce7f90 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:33.011723 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d044c-ccdc-477f-9788-8bfda2ce7f90 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:33.012053 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d044c-ccdc-477f-9788-8bfda2ce7f90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:33.013529 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d044c-ccdc-477f-9788-8bfda2ce7f90 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:33.020631 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 448/900] 10.222.0.46 () {56 vars in 1122 bytes} [Fri Jul 1 03:44:32 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:33.022936 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323f2aa-6d3f-471a-a114-a1d1f764e243 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:33.023481 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323f2aa-6d3f-471a-a114-a1d1f764e243 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:33.023922 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323f2aa-6d3f-471a-a114-a1d1f764e243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:33.051800 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-e323f2aa-6d3f-471a-a114-a1d1f764e243 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:44:33.053753 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e323f2aa-6d3f-471a-a114-a1d1f764e243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:44:33.129741 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a005a5-f194-437d-bf40-371b1e6e8f62 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:33.157872 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:33.171370 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 449/901] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:44:33 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:44:33.193209 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f02718-a66d-455c-840b-74632b8d6bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:33.194991 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f02718-a66d-455c-840b-74632b8d6bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:33.195713 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f02718-a66d-455c-840b-74632b8d6bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:33.196331 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f02718-a66d-455c-840b-74632b8d6bb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:33.210132 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323f2aa-6d3f-471a-a114-a1d1f764e243 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:33.219039 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f02718-a66d-455c-840b-74632b8d6bb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:33.221906 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f02718-a66d-455c-840b-74632b8d6bb9 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:33.245460 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-54f02718-a66d-455c-840b-74632b8d6bb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:33.245460 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:33.245460 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:33.245460 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:33.245460 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:33.245460 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:33.245460 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:33.245460 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:33.245460 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:33.245460 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:33.245460 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:33.245460 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:33.245460 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:44:33.245460 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:44:33.245460 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:44:33.246690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:44:33.246690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:33.246690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:33.246690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:33.246690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:33.246690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:33.246690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:33.246690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:33.246690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:33.246690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:33.246690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:33.246690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:33.246690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:33.246690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:33.246690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:33.246690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:33.246690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:33.248989 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:44:33.248989 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:44:33.248989 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:33.248989 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:33.248989 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 453/902] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:44:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:33.255980 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f02718-a66d-455c-840b-74632b8d6bb9 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:33.299683 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:33.397865 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f02718-a66d-455c-840b-74632b8d6bb9 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:33.399970 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323f2aa-6d3f-471a-a114-a1d1f764e243 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:33.464741 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7668868e-5ea9-496a-bd55-4f9092be912b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:33.465438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f5069-a329-4d55-a22d-fce8ee6a3469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:33.465624 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668868e-5ea9-496a-bd55-4f9092be912b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:33.465792 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668868e-5ea9-496a-bd55-4f9092be912b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:33.466072 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668868e-5ea9-496a-bd55-4f9092be912b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:33.466552 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f5069-a329-4d55-a22d-fce8ee6a3469 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:33.466715 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7668868e-5ea9-496a-bd55-4f9092be912b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:33.467030 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f5069-a329-4d55-a22d-fce8ee6a3469 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:33.467521 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f5069-a329-4d55-a22d-fce8ee6a3469 None admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:33.468149 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7668868e-5ea9-496a-bd55-4f9092be912b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:33.469371 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f5069-a329-4d55-a22d-fce8ee6a3469 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:33.469891 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f5069-a329-4d55-a22d-fce8ee6a3469 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:33.472350 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f5069-a329-4d55-a22d-fce8ee6a3469 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:33.483697 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-7668868e-5ea9-496a-bd55-4f9092be912b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 01 03:44:33.483697 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:33.483697 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 03:44:33.483697 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 03:44:33.483697 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 03:44:33.483697 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 03:44:33.483697 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 03:44:33.483697 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:44:33.483697 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 01 03:44:33.483697 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:33.483697 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 03:44:33.483697 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:33.483697 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:33.483697 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:33.483697 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:33.483697 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:33.485452 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:33.485452 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:33.485452 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:33.485452 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:33.485452 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:33.485452 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:33.485452 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:33.485452 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 03:44:33.485452 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 03:44:33.485452 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 03:44:33.485452 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 03:44:33.485452 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:33.485452 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:33.485452 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:33.485452 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:33.485452 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:33.486283 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:33.486283 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:33.486283 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:33.486283 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:33.486283 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:33.486283 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:33.486283 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:33.486283 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:33.486283 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:33.486283 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:33.486283 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:33.486283 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 03:44:33.486283 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:44:33.486283 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 01 03:44:33.486283 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:33.495076 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 450/903] 10.222.0.46 () {56 vars in 1132 bytes} [Fri Jul 1 03:44:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:33.495076 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51bd9f-664f-44ab-a967-df6885b6569c None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:33.495076 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51bd9f-664f-44ab-a967-df6885b6569c None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:33.495076 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51bd9f-664f-44ab-a967-df6885b6569c None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:33.496870 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 451/904] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:44:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:44:33.499522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51bd9f-664f-44ab-a967-df6885b6569c None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:33.507144 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 454/905] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:44:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:33.509536 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0358d2-c2af-44b0-b25b-f13507c7c943 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:33.509988 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0358d2-c2af-44b0-b25b-f13507c7c943 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:33.510444 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0358d2-c2af-44b0-b25b-f13507c7c943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:33.544602 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-ef0358d2-c2af-44b0-b25b-f13507c7c943 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:44:33.546732 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-ef0358d2-c2af-44b0-b25b-f13507c7c943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:44:33.597093 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:33.652447 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51bd9f-664f-44ab-a967-df6885b6569c None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:33.678152 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 455/906] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:44:33 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:44:33.679771 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0358d2-c2af-44b0-b25b-f13507c7c943 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:33.712639 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79adf40d-f1cd-4d5b-9809-853346531c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:33.713775 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adf40d-f1cd-4d5b-9809-853346531c16 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:33.714260 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adf40d-f1cd-4d5b-9809-853346531c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:33.714720 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adf40d-f1cd-4d5b-9809-853346531c16 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:33.716133 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79adf40d-f1cd-4d5b-9809-853346531c16 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:33.716255 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:33.716626 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79adf40d-f1cd-4d5b-9809-853346531c16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:33.719771 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79adf40d-f1cd-4d5b-9809-853346531c16 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:33.735107 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 452/907] 10.222.0.46 () {56 vars in 1126 bytes} [Fri Jul 1 03:44:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:33.735107 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79adf40d-f1cd-4d5b-9809-853346531c16 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:33.814962 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0358d2-c2af-44b0-b25b-f13507c7c943 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:33.864518 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e957e-cf8e-41a1-87b0-da44eda76e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:33.865635 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e957e-cf8e-41a1-87b0-da44eda76e4b None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:33.866076 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e957e-cf8e-41a1-87b0-da44eda76e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:33.866344 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e957e-cf8e-41a1-87b0-da44eda76e4b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:33.874744 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7e957e-cf8e-41a1-87b0-da44eda76e4b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:33.876317 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7e957e-cf8e-41a1-87b0-da44eda76e4b None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:33.892368 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-bc7e957e-cf8e-41a1-87b0-da44eda76e4b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 01 03:44:33.892368 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:33.892368 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:33.892368 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:33.892368 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:33.892368 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:33.892368 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:33.892368 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:33.892368 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:33.892368 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:33.892368 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:33.892368 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:33.892368 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 03:44:33.892368 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 03:44:33.892368 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 03:44:33.892368 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 03:44:33.893464 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:33.893464 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:33.893464 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 03:44:33.893464 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:44:33.893464 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 03:44:33.893464 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:44:33.893464 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:33.893464 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:33.893464 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:33.893464 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:33.893464 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:33.893464 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:33.893464 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:33.893464 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:33.893464 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:33.893464 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:33.893464 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:33.893464 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:33.894402 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:33.894402 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:33.894402 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 03:44:33.894402 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 03:44:33.894402 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 03:44:33.894402 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 03:44:33.894402 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 03:44:33.894402 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 03:44:33.894402 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 01 03:44:33.894402 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:33.894402 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 456/908] 10.222.0.46 () {56 vars in 1117 bytes} [Fri Jul 1 03:44:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:33.894402 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e957e-cf8e-41a1-87b0-da44eda76e4b None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:33.913661 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79adf40d-f1cd-4d5b-9809-853346531c16 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:33.962459 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:33.978525 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8149a-0fbe-42e9-8e04-875e3bb9b58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:33.980136 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8149a-0fbe-42e9-8e04-875e3bb9b58d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:33.980608 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8149a-0fbe-42e9-8e04-875e3bb9b58d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:33.981119 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8149a-0fbe-42e9-8e04-875e3bb9b58d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:33.982367 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d8149a-0fbe-42e9-8e04-875e3bb9b58d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:33.985572 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d8149a-0fbe-42e9-8e04-875e3bb9b58d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:34.002094 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:34.009039 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-87d8149a-0fbe-42e9-8e04-875e3bb9b58d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 01 03:44:34.009039 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:34.009039 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 03:44:34.009039 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 03:44:34.009039 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 03:44:34.009039 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 03:44:34.009039 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 03:44:34.009039 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:44:34.009039 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 01 03:44:34.009039 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:34.009039 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 03:44:34.009039 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:34.009039 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:34.009039 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:34.009039 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:34.009039 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:34.009039 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:34.018774 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:34.018774 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:34.018774 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:34.018774 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:34.018774 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:34.018774 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:34.018774 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 03:44:34.018774 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 03:44:34.018774 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 03:44:34.018774 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 03:44:34.018774 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:34.018774 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:34.018774 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:34.018774 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:34.018774 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:34.018774 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:34.020488 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:34.020488 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:34.020488 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:34.020488 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:34.020488 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:34.020488 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:34.020488 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:34.020488 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:34.020488 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:34.020488 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:34.020488 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 03:44:34.020488 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:44:34.020488 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 01 03:44:34.020488 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:34.020488 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 453/909] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Jul 1 03:44:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:34.022094 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8149a-0fbe-42e9-8e04-875e3bb9b58d None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:34.030137 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e957e-cf8e-41a1-87b0-da44eda76e4b None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:34.074076 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2134b8-cf8c-4f3e-ac01-c3d770e6b918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:34.075024 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2134b8-cf8c-4f3e-ac01-c3d770e6b918 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:34.075438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2134b8-cf8c-4f3e-ac01-c3d770e6b918 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:34.075756 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2134b8-cf8c-4f3e-ac01-c3d770e6b918 None admin] PATH_INFO: `/v3/services` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:34.076666 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2134b8-cf8c-4f3e-ac01-c3d770e6b918 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:34.076980 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2134b8-cf8c-4f3e-ac01-c3d770e6b918 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:34.079303 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2134b8-cf8c-4f3e-ac01-c3d770e6b918 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:34.092598 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 457/910] 10.222.0.46 () {56 vars in 1126 bytes} [Fri Jul 1 03:44:33 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:34.092598 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2134b8-cf8c-4f3e-ac01-c3d770e6b918 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:34.160070 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8149a-0fbe-42e9-8e04-875e3bb9b58d None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:34.201421 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03885a46-d555-4a53-bbad-7d0f992d741f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:34.202165 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03885a46-d555-4a53-bbad-7d0f992d741f None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:34.202445 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03885a46-d555-4a53-bbad-7d0f992d741f None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:34.203237 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03885a46-d555-4a53-bbad-7d0f992d741f None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:34.204128 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03885a46-d555-4a53-bbad-7d0f992d741f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:34.204466 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03885a46-d555-4a53-bbad-7d0f992d741f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:34.206181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03885a46-d555-4a53-bbad-7d0f992d741f None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:34.235630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 454/911] 10.222.0.46 () {56 vars in 1149 bytes} [Fri Jul 1 03:44:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:34.235630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03885a46-d555-4a53-bbad-7d0f992d741f None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:34.260928 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2134b8-cf8c-4f3e-ac01-c3d770e6b918 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:34.304196 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dddf65-f54e-4d02-8c80-de500750a357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:34.305035 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dddf65-f54e-4d02-8c80-de500750a357 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:34.305322 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dddf65-f54e-4d02-8c80-de500750a357 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:34.305596 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dddf65-f54e-4d02-8c80-de500750a357 None admin] PATH_INFO: `/v3/services` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:34.306309 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dddf65-f54e-4d02-8c80-de500750a357 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:34.307070 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dddf65-f54e-4d02-8c80-de500750a357 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:34.308504 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dddf65-f54e-4d02-8c80-de500750a357 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:34.310488 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:34.318698 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 458/912] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Jul 1 03:44:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:34.320222 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dddf65-f54e-4d02-8c80-de500750a357 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:34.343811 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:34.380715 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03885a46-d555-4a53-bbad-7d0f992d741f None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:34.422647 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a6e81-9955-4fab-8524-5b64f4f7ce86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:34.423383 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a6e81-9955-4fab-8524-5b64f4f7ce86 None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:34.423695 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a6e81-9955-4fab-8524-5b64f4f7ce86 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:34.423966 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a6e81-9955-4fab-8524-5b64f4f7ce86 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:34.424743 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806a6e81-9955-4fab-8524-5b64f4f7ce86 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:34.426206 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806a6e81-9955-4fab-8524-5b64f4f7ce86 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:34.494433 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dddf65-f54e-4d02-8c80-de500750a357 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:34.535740 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 455/913] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 1 03:44:34 2022] POST /identity/v3/endpoints => generated 347 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 03:44:34.536994 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a6e81-9955-4fab-8524-5b64f4f7ce86 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:34.556818 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba33c7-bf2b-4507-b7b0-e611d6fca432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:34.557538 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba33c7-bf2b-4507-b7b0-e611d6fca432 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:34.557854 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba33c7-bf2b-4507-b7b0-e611d6fca432 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:34.558165 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba33c7-bf2b-4507-b7b0-e611d6fca432 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:34.696577 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fba33c7-bf2b-4507-b7b0-e611d6fca432 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:34.699574 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fba33c7-bf2b-4507-b7b0-e611d6fca432 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:34.704279 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a6e81-9955-4fab-8524-5b64f4f7ce86 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:34.707240 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:34.716380 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:34.758556 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af784ce0-d7f6-413b-987c-2476bf202a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:34.759947 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af784ce0-d7f6-413b-987c-2476bf202a1c None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:34.760552 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af784ce0-d7f6-413b-987c-2476bf202a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:34.761130 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af784ce0-d7f6-413b-987c-2476bf202a1c None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:34.762411 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af784ce0-d7f6-413b-987c-2476bf202a1c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:34.762928 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af784ce0-d7f6-413b-987c-2476bf202a1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:34.765529 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af784ce0-d7f6-413b-987c-2476bf202a1c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:34.776639 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 456/914] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Jul 1 03:44:34 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:34.784007 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af784ce0-d7f6-413b-987c-2476bf202a1c None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:34.869387 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 459/915] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:44:34 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 03:44:34.881310 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba33c7-bf2b-4507-b7b0-e611d6fca432 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:34.980908 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af784ce0-d7f6-413b-987c-2476bf202a1c None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:35.056124 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493923d-5ceb-44e1-ba8c-00450069db61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:35.057274 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493923d-5ceb-44e1-ba8c-00450069db61 None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:35.057708 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493923d-5ceb-44e1-ba8c-00450069db61 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:35.058356 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493923d-5ceb-44e1-ba8c-00450069db61 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:35.059923 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d493923d-5ceb-44e1-ba8c-00450069db61 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:35.062984 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d493923d-5ceb-44e1-ba8c-00450069db61 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:35.105529 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba33c7-bf2b-4507-b7b0-e611d6fca432 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:35.120990 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:35.159041 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c900d-6a68-4294-91d2-b194beef3e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:35.159945 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c900d-6a68-4294-91d2-b194beef3e16 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:35.160226 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c900d-6a68-4294-91d2-b194beef3e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:35.160523 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c900d-6a68-4294-91d2-b194beef3e16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:35.176121 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c900d-6a68-4294-91d2-b194beef3e16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:35.178873 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c900d-6a68-4294-91d2-b194beef3e16 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:35.193384 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 457/916] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 1 03:44:34 2022] POST /identity/v3/endpoints => generated 346 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 03:44:35.205140 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-a19c900d-6a68-4294-91d2-b194beef3e16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:35.205140 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:35.205140 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:35.205140 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:35.205140 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:35.205140 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:35.205140 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:35.205140 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:35.205140 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:35.205140 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:35.205140 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:35.205140 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:35.205140 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:44:35.205140 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:44:35.205140 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:44:35.206606 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:44:35.206606 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:35.206606 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:35.206606 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:35.206606 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:35.206606 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:35.206606 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:35.206606 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:35.206606 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:35.206606 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:35.206606 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:35.206606 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:35.206606 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:35.206606 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:35.206606 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:35.206606 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:35.206606 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:35.207559 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:44:35.207559 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:44:35.207559 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:35.207559 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:35.209665 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 460/917] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:44:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:35.216026 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493923d-5ceb-44e1-ba8c-00450069db61 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:35.274490 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:35.336775 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78c677-d426-4df1-baf6-3cd386a39b96 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:35.337295 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78c677-d426-4df1-baf6-3cd386a39b96 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:35.337295 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78c677-d426-4df1-baf6-3cd386a39b96 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:35.338847 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 461/918] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 03:44:35.345234 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8efa3-53f6-4c02-8b66-7ad45cd49dc4 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:35.345615 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8efa3-53f6-4c02-8b66-7ad45cd49dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:35.345782 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8efa3-53f6-4c02-8b66-7ad45cd49dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:35.358782 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493923d-5ceb-44e1-ba8c-00450069db61 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:35.368003 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-7fe8efa3-53f6-4c02-8b66-7ad45cd49dc4 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:44:35.369617 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-7fe8efa3-53f6-4c02-8b66-7ad45cd49dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:44:35.401543 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f6ed5-c95f-409a-8847-0b4523eea3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:35.402898 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f6ed5-c95f-409a-8847-0b4523eea3c1 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:35.402898 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f6ed5-c95f-409a-8847-0b4523eea3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:35.403108 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f6ed5-c95f-409a-8847-0b4523eea3c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:35.403958 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f6ed5-c95f-409a-8847-0b4523eea3c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:35.404338 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f6ed5-c95f-409a-8847-0b4523eea3c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:35.406391 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f6ed5-c95f-409a-8847-0b4523eea3c1 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:35.421046 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 458/919] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:44:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:35.433080 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f6ed5-c95f-409a-8847-0b4523eea3c1 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:35.479873 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 462/920] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:44:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:44:35.513564 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe8efa3-53f6-4c02-8b66-7ad45cd49dc4 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:35.602908 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:35.635520 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f6ed5-c95f-409a-8847-0b4523eea3c1 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:35.686852 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfd676-93da-49ee-8360-bad32c6549a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:35.687399 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:35.687950 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfd676-93da-49ee-8360-bad32c6549a7 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:35.688734 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfd676-93da-49ee-8360-bad32c6549a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:35.688734 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfd676-93da-49ee-8360-bad32c6549a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:35.698594 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dfd676-93da-49ee-8360-bad32c6549a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:35.700568 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dfd676-93da-49ee-8360-bad32c6549a7 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:35.716600 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe8efa3-53f6-4c02-8b66-7ad45cd49dc4 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:35.717587 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-c9dfd676-93da-49ee-8360-bad32c6549a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:44:35.717587 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:35.717587 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:35.717587 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:35.717587 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:35.717587 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:35.717587 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:35.717587 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:35.717587 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:35.717587 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:35.717587 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:35.717587 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:35.717587 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 03:44:35.717587 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 03:44:35.717587 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 03:44:35.720010 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 03:44:35.720010 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:35.720010 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:35.720010 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:35.720010 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:35.720010 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:35.720010 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:35.720010 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:35.720010 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:35.720010 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:35.720010 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:35.720010 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:35.720010 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:35.720010 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:35.720010 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:35.720010 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:35.720010 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:35.722054 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 03:44:35.722054 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 03:44:35.722054 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 03:44:35.722054 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 03:44:35.722054 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 03:44:35.722054 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 03:44:35.722054 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:44:35.722054 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:35.722054 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 459/921] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:44:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:35.736541 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfd676-93da-49ee-8360-bad32c6549a7 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:35.783394 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fcad10-adf1-49ac-b154-297920fdb774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:35.784094 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcad10-adf1-49ac-b154-297920fdb774 None admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:35.784367 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcad10-adf1-49ac-b154-297920fdb774 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:35.784640 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcad10-adf1-49ac-b154-297920fdb774 None admin] PATH_INFO: `/v3/services` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:35.785380 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fcad10-adf1-49ac-b154-297920fdb774 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:35.787015 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fcad10-adf1-49ac-b154-297920fdb774 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:35.883791 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 463/922] 10.222.0.46 () {60 vars in 1141 bytes} [Fri Jul 1 03:44:35 2022] POST /identity/v3/services => generated 241 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 03:44:35.939316 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfd676-93da-49ee-8360-bad32c6549a7 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:36.026274 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f517a-e865-4da8-a57a-2a134bf8232f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:36.027414 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f517a-e865-4da8-a57a-2a134bf8232f None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:36.027928 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f517a-e865-4da8-a57a-2a134bf8232f None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:36.028415 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f517a-e865-4da8-a57a-2a134bf8232f None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:36.029703 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f517a-e865-4da8-a57a-2a134bf8232f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:36.030021 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f517a-e865-4da8-a57a-2a134bf8232f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:36.032545 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f517a-e865-4da8-a57a-2a134bf8232f None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:36.037972 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:36.057465 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 460/923] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 1 03:44:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:36.063789 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fcad10-adf1-49ac-b154-297920fdb774 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:36.229749 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fcad10-adf1-49ac-b154-297920fdb774 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:36.298848 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36bd6d-755b-4ffe-b658-019dcd49bb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:36.300487 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36bd6d-755b-4ffe-b658-019dcd49bb70 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:36.301231 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36bd6d-755b-4ffe-b658-019dcd49bb70 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:36.301970 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36bd6d-755b-4ffe-b658-019dcd49bb70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:36.303800 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36bd6d-755b-4ffe-b658-019dcd49bb70 None admin] RBAC: Adding query filter params (role.id=43eeddda303844f3850a6e55a673a34f, scope.project.id=da83db15a312499fb627691ae442f233, user.id=dd41221abea04808bed5ef4ac4528c62) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:36.304630 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36bd6d-755b-4ffe-b658-019dcd49bb70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:36.306760 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36bd6d-755b-4ffe-b658-019dcd49bb70 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:36.317877 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 464/924] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:44:36 2022] GET /identity/v3/role_assignments?user.id=dd41221abea04808bed5ef4ac4528c62&scope.project.id=da83db15a312499fb627691ae442f233&role.id=43eeddda303844f3850a6e55a673a34f => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:36.893721 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94782c04-f6fd-4066-807a-4af486d87932 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:36.894228 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94782c04-f6fd-4066-807a-4af486d87932 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:36.894228 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94782c04-f6fd-4066-807a-4af486d87932 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:36.895924 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 461/925] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:44:36.901776 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b8693-b19e-4162-8ad5-8d0ea164ece5 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:36.902755 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b8693-b19e-4162-8ad5-8d0ea164ece5 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:36.903243 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b8693-b19e-4162-8ad5-8d0ea164ece5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:36.922389 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-1b2b8693-b19e-4162-8ad5-8d0ea164ece5 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:44:36.924851 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-1b2b8693-b19e-4162-8ad5-8d0ea164ece5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:44:36.934781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:37.002180 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 465/926] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:44:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:44:37.025544 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94782c04-f6fd-4066-807a-4af486d87932 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:37.141346 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94782c04-f6fd-4066-807a-4af486d87932 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:37.179808 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce9854-fcf0-4b9d-849b-138fc63085e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:37.180525 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce9854-fcf0-4b9d-849b-138fc63085e6 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:37.180796 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce9854-fcf0-4b9d-849b-138fc63085e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:37.181100 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce9854-fcf0-4b9d-849b-138fc63085e6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:37.181716 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce9854-fcf0-4b9d-849b-138fc63085e6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:37.183104 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce9854-fcf0-4b9d-849b-138fc63085e6 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:37.196511 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-69ce9854-fcf0-4b9d-849b-138fc63085e6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 01 03:44:37.196511 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:37.196511 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 03:44:37.196511 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 03:44:37.196511 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 03:44:37.196511 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 03:44:37.196511 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 03:44:37.196511 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:44:37.196511 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 01 03:44:37.196511 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:37.196511 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 03:44:37.196511 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:37.196511 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:37.196511 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:37.196511 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:37.196511 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:37.196511 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:37.199090 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:37.199090 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:37.199090 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:37.199090 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:37.199090 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:37.199090 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:37.199090 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 03:44:37.199090 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 03:44:37.199090 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 03:44:37.199090 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 03:44:37.199090 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:37.199090 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:37.199090 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:37.199090 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:37.199090 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:37.199090 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:37.200829 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:37.200829 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:37.200829 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:37.200829 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:37.200829 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:37.200829 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:37.200829 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:37.200829 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:37.200829 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:37.200829 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:37.200829 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 03:44:37.200829 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:44:37.200829 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 01 03:44:37.200829 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:37.200829 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 462/927] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:44:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:37.207514 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b8693-b19e-4162-8ad5-8d0ea164ece5 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:37.365540 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b8693-b19e-4162-8ad5-8d0ea164ece5 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:37.427250 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c77a31-afe8-4c2e-8e00-6ba840b69f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:37.428867 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c77a31-afe8-4c2e-8e00-6ba840b69f13 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:37.429547 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c77a31-afe8-4c2e-8e00-6ba840b69f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:37.430324 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c77a31-afe8-4c2e-8e00-6ba840b69f13 None admin] PATH_INFO: `/v3/services` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:37.431902 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c77a31-afe8-4c2e-8e00-6ba840b69f13 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:37.432665 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c77a31-afe8-4c2e-8e00-6ba840b69f13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:37.435601 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c77a31-afe8-4c2e-8e00-6ba840b69f13 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:37.446776 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 466/928] 10.222.0.46 () {56 vars in 1112 bytes} [Fri Jul 1 03:44:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:37.452883 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce9854-fcf0-4b9d-849b-138fc63085e6 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:37.533734 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:37.578869 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce9854-fcf0-4b9d-849b-138fc63085e6 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:37.615293 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea4f6a-2bf4-4b62-99f4-deefb843d312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:37.616005 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea4f6a-2bf4-4b62-99f4-deefb843d312 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:37.616696 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea4f6a-2bf4-4b62-99f4-deefb843d312 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:37.616970 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea4f6a-2bf4-4b62-99f4-deefb843d312 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:37.617685 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea4f6a-2bf4-4b62-99f4-deefb843d312 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:37.617993 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea4f6a-2bf4-4b62-99f4-deefb843d312 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:37.619405 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea4f6a-2bf4-4b62-99f4-deefb843d312 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:37.625640 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 463/929] 10.222.0.46 () {56 vars in 1112 bytes} [Fri Jul 1 03:44:37 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:38.255963 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c4aaa-f186-46d5-9a82-318fde251527 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:38.256759 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c4aaa-f186-46d5-9a82-318fde251527 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:38.256759 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c4aaa-f186-46d5-9a82-318fde251527 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:38.258168 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 467/930] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:44:38.264003 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb04700-5fda-4e18-915b-ea5f1fa684f2 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:38.264825 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb04700-5fda-4e18-915b-ea5f1fa684f2 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:38.264825 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb04700-5fda-4e18-915b-ea5f1fa684f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:38.285564 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-8bb04700-5fda-4e18-915b-ea5f1fa684f2 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:44:38.287012 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8bb04700-5fda-4e18-915b-ea5f1fa684f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:44:38.360345 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 464/931] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:44:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 03:44:38.382325 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c4aaa-f186-46d5-9a82-318fde251527 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:38.392169 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:38.520630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b57a0-6dda-4701-9edd-713d75301dff None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:38.521131 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b57a0-6dda-4701-9edd-713d75301dff None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:38.521601 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b57a0-6dda-4701-9edd-713d75301dff None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:38.523612 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 465/932] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:44:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 03:44:38.529252 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877e529-ede0-4c24-a2bf-c41399043bdc None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:38.529853 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877e529-ede0-4c24-a2bf-c41399043bdc None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:38.530958 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877e529-ede0-4c24-a2bf-c41399043bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:38.532065 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c4aaa-f186-46d5-9a82-318fde251527 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:38.549579 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-7877e529-ede0-4c24-a2bf-c41399043bdc None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:44:38.551182 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-7877e529-ede0-4c24-a2bf-c41399043bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:44:38.603495 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55496b4-5f3c-48fa-8315-395f2b0e26ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:38.606855 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55496b4-5f3c-48fa-8315-395f2b0e26ee None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:38.606855 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55496b4-5f3c-48fa-8315-395f2b0e26ee None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:38.606855 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55496b4-5f3c-48fa-8315-395f2b0e26ee None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:38.606855 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55496b4-5f3c-48fa-8315-395f2b0e26ee None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:38.609863 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55496b4-5f3c-48fa-8315-395f2b0e26ee None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:38.612796 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:38.635550 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 466/933] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:44:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 03:44:38.635550 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f74ca3-6b92-49b3-9fc5-eeb3c09952c8 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:38.635820 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-f55496b4-5f3c-48fa-8315-395f2b0e26ee None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 03:44:38.635820 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:38.635820 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 03:44:38.635820 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 03:44:38.635820 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 03:44:38.635820 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 03:44:38.635820 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 03:44:38.635820 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:44:38.635820 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 03:44:38.635820 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:38.635820 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 03:44:38.635820 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:38.635820 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:38.635820 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:38.635820 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:38.635820 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:38.635820 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:38.636731 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:38.636731 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:38.636731 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:38.636731 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:38.636731 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:38.636731 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:38.636731 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 03:44:38.636731 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 03:44:38.636731 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 03:44:38.636731 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 03:44:38.636731 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:38.636731 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:38.636731 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:38.636731 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:38.636731 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:38.636731 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:38.637887 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:38.637887 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:38.637887 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:38.637887 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:38.637887 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:38.637887 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:38.637887 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:38.637887 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:38.637887 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:38.637887 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:38.637887 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 03:44:38.637887 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:44:38.637887 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 03:44:38.637887 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:38.638662 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f74ca3-6b92-49b3-9fc5-eeb3c09952c8 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:38.638662 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f74ca3-6b92-49b3-9fc5-eeb3c09952c8 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:38.638784 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 468/934] 10.222.0.46 () {56 vars in 1126 bytes} [Fri Jul 1 03:44:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:38.641961 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 467/935] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:44:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:44:38.648786 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55496b4-5f3c-48fa-8315-395f2b0e26ee None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:38.656550 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffbb6d-53db-4c10-aaf8-715db125bad2 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:38.657053 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffbb6d-53db-4c10-aaf8-715db125bad2 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:38.657550 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffbb6d-53db-4c10-aaf8-715db125bad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:38.686003 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-daffbb6d-53db-4c10-aaf8-715db125bad2 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:44:38.687613 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-daffbb6d-53db-4c10-aaf8-715db125bad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:44:38.753658 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:38.804176 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 468/936] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:44:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 03:44:38.808510 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daffbb6d-53db-4c10-aaf8-715db125bad2 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:38.809971 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55496b4-5f3c-48fa-8315-395f2b0e26ee None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:38.883214 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8811e00-6180-4fc1-9750-b1b5568274d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:38.883917 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8811e00-6180-4fc1-9750-b1b5568274d0 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:38.884199 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8811e00-6180-4fc1-9750-b1b5568274d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:38.884472 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8811e00-6180-4fc1-9750-b1b5568274d0 None admin] PATH_INFO: `/v3/services` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:38.885189 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8811e00-6180-4fc1-9750-b1b5568274d0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:38.885495 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8811e00-6180-4fc1-9750-b1b5568274d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:38.886882 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8811e00-6180-4fc1-9750-b1b5568274d0 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:38.893645 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 469/937] 10.222.0.46 () {56 vars in 1122 bytes} [Fri Jul 1 03:44:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:38.899512 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8811e00-6180-4fc1-9750-b1b5568274d0 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:38.969416 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daffbb6d-53db-4c10-aaf8-715db125bad2 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:38.995619 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:39.030793 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f4488-3f39-4342-9d82-928319fb6258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:39.031769 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f4488-3f39-4342-9d82-928319fb6258 None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:39.032222 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f4488-3f39-4342-9d82-928319fb6258 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:39.032672 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f4488-3f39-4342-9d82-928319fb6258 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:39.033507 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78f4488-3f39-4342-9d82-928319fb6258 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:39.035779 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78f4488-3f39-4342-9d82-928319fb6258 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:39.038285 dv-cinder-846842-8-smb devstack@keystone.service[80377]: WARNING keystone.server.flask.common [None req-f78f4488-3f39-4342-9d82-928319fb6258 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 01 03:44:39.063677 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8811e00-6180-4fc1-9750-b1b5568274d0 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:39.093800 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.sql.core [None req-f78f4488-3f39-4342-9d82-928319fb6258 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 01 03:44:39.093800 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 01 03:44:39.093800 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [parameters: {'id': '0b33bbb2680d4b50b5c56758c008b8ae', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 01 03:44:39.093800 dv-cinder-846842-8-smb devstack@keystone.service[80377]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80377) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 01 03:44:39.107940 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04732d2d-7dca-4c9d-8b2a-11be8727d106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:39.109304 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04732d2d-7dca-4c9d-8b2a-11be8727d106 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:39.109767 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04732d2d-7dca-4c9d-8b2a-11be8727d106 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:39.110205 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04732d2d-7dca-4c9d-8b2a-11be8727d106 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:39.110374 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-f78f4488-3f39-4342-9d82-928319fb6258 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0b33bbb2680d4b50b5c56758c008b8ae.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0b33bbb2680d4b50b5c56758c008b8ae. Jul 01 03:44:39.110374 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:39.110374 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 01 03:44:39.110374 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 01 03:44:39.110374 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 01 03:44:39.110374 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 01 03:44:39.110374 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 01 03:44:39.110374 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application result = self._query(query) Jul 01 03:44:39.110374 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 01 03:44:39.110374 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application conn.query(q) Jul 01 03:44:39.110374 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 01 03:44:39.110374 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 01 03:44:39.110374 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 01 03:44:39.111869 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application result.read() Jul 01 03:44:39.111869 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 01 03:44:39.111869 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 01 03:44:39.111869 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 01 03:44:39.111869 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 01 03:44:39.111869 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 01 03:44:39.111869 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 01 03:44:39.111869 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 01 03:44:39.111869 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 01 03:44:39.111869 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 01 03:44:39.111869 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:39.111869 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 01 03:44:39.111869 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:39.111869 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:39.111869 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 01 03:44:39.111869 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 01 03:44:39.111869 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 01 03:44:39.111869 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 01 03:44:39.113813 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 01 03:44:39.113813 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application next(self.gen) Jul 01 03:44:39.113813 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 01 03:44:39.113813 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application yield resource Jul 01 03:44:39.113813 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 01 03:44:39.113813 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application next(self.gen) Jul 01 03:44:39.113813 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 01 03:44:39.113813 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self.session.rollback() Jul 01 03:44:39.113813 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 03:44:39.113813 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self.force_reraise() Jul 01 03:44:39.113813 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 03:44:39.113813 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise self.value Jul 01 03:44:39.113813 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 01 03:44:39.113813 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 01 03:44:39.113813 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 01 03:44:39.113813 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application session.commit() Jul 01 03:44:39.113813 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 01 03:44:39.117114 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 01 03:44:39.117114 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 01 03:44:39.117114 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._prepare_impl() Jul 01 03:44:39.117114 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 01 03:44:39.117114 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self.session.flush() Jul 01 03:44:39.117114 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 01 03:44:39.117114 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._flush(objects) Jul 01 03:44:39.117114 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 01 03:44:39.117114 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 01 03:44:39.117114 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 01 03:44:39.117114 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application compat.raise_( Jul 01 03:44:39.117114 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 01 03:44:39.117114 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception Jul 01 03:44:39.117114 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 01 03:44:39.117114 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application flush_context.execute() Jul 01 03:44:39.117114 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 01 03:44:39.117114 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rec.execute(self) Jul 01 03:44:39.120630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 01 03:44:39.120630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 01 03:44:39.120630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 01 03:44:39.120630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 01 03:44:39.120630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 01 03:44:39.120630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 01 03:44:39.120630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 01 03:44:39.120630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 01 03:44:39.120630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 01 03:44:39.120630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 01 03:44:39.120630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 01 03:44:39.120630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 01 03:44:39.120630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 01 03:44:39.120630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 01 03:44:39.120630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 01 03:44:39.124699 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 01 03:44:39.124699 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 01 03:44:39.124699 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception Jul 01 03:44:39.124699 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 01 03:44:39.124699 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 01 03:44:39.124699 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 01 03:44:39.124699 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 01 03:44:39.124699 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 01 03:44:39.124699 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application result = self._query(query) Jul 01 03:44:39.124699 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 01 03:44:39.124699 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application conn.query(q) Jul 01 03:44:39.124699 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 01 03:44:39.124699 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 01 03:44:39.124699 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 01 03:44:39.124699 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application result.read() Jul 01 03:44:39.124699 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 01 03:44:39.124699 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 01 03:44:39.129630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 01 03:44:39.129630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 01 03:44:39.129630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 01 03:44:39.129630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 01 03:44:39.129630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 01 03:44:39.129630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 01 03:44:39.129630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 01 03:44:39.129630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 01 03:44:39.129630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [parameters: {'id': '0b33bbb2680d4b50b5c56758c008b8ae', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 01 03:44:39.129630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 01 03:44:39.129630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:39.129630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 03:44:39.129630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:39.129630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:39.129630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 01 03:44:39.135430 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 01 03:44:39.135430 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 01 03:44:39.135430 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 01 03:44:39.135430 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 01 03:44:39.135430 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:39.135430 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 03:44:39.135430 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:39.135430 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:39.135430 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:39.135430 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:39.135430 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:39.135430 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:39.135430 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:39.135430 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:39.135430 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:39.135430 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:39.135430 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:39.140768 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:39.140768 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 01 03:44:39.140768 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 01 03:44:39.140768 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:39.140768 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:39.140768 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 01 03:44:39.140768 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 01 03:44:39.140768 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0b33bbb2680d4b50b5c56758c008b8ae. Jul 01 03:44:39.140768 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:39.140768 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 469/938] 10.222.0.46 () {60 vars in 1140 bytes} [Fri Jul 1 03:44:38 2022] POST /identity/v3/projects => generated 262 bytes in 308 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:39.140768 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f4488-3f39-4342-9d82-928319fb6258 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:39.143561 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:39.143561 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04732d2d-7dca-4c9d-8b2a-11be8727d106 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:44:39.156718 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-04732d2d-7dca-4c9d-8b2a-11be8727d106 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 01 03:44:39.156718 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:39.156718 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:39.156718 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:39.156718 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:39.156718 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:39.156718 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:39.156718 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:39.156718 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:39.156718 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:39.156718 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:39.156718 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:39.156718 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:44:39.156718 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:44:39.156718 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:44:39.156718 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:44:39.159732 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:44:39.159732 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:44:39.159732 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:44:39.159732 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:44:39.159732 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:39.159732 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:39.159732 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:39.159732 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:39.159732 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:39.159732 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:39.159732 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:39.159732 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:39.159732 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:39.159732 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:39.159732 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:39.159732 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:39.162220 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:39.162220 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:39.162220 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:39.162220 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:39.162220 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:44:39.162220 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:44:39.162220 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:44:39.162220 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:44:39.162220 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:44:39.162220 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:44:39.162220 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 01 03:44:39.162220 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:39.168287 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 470/939] 10.222.0.46 () {56 vars in 1120 bytes} [Fri Jul 1 03:44:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:39.168547 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04732d2d-7dca-4c9d-8b2a-11be8727d106 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:39.309429 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f4488-3f39-4342-9d82-928319fb6258 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:39.336476 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04732d2d-7dca-4c9d-8b2a-11be8727d106 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:39.375501 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc5b5e-0924-4f29-b536-d1d80291b126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:39.376956 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc5b5e-0924-4f29-b536-d1d80291b126 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:39.377532 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc5b5e-0924-4f29-b536-d1d80291b126 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:39.377738 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ccbb9-2c69-4882-a3ff-33455b6e828c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:39.378183 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc5b5e-0924-4f29-b536-d1d80291b126 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:39.378615 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ccbb9-2c69-4882-a3ff-33455b6e828c None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:39.378963 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ccbb9-2c69-4882-a3ff-33455b6e828c None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:39.379305 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ccbb9-2c69-4882-a3ff-33455b6e828c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:39.379563 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc5b5e-0924-4f29-b536-d1d80291b126 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:39.380281 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc5b5e-0924-4f29-b536-d1d80291b126 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:39.383217 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc5b5e-0924-4f29-b536-d1d80291b126 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:39.388114 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57ccbb9-2c69-4882-a3ff-33455b6e828c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:39.389730 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57ccbb9-2c69-4882-a3ff-33455b6e828c None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:39.405682 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 470/940] 10.222.0.46 () {56 vars in 1122 bytes} [Fri Jul 1 03:44:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:39.405682 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc5b5e-0924-4f29-b536-d1d80291b126 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:39.406106 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-d57ccbb9-2c69-4882-a3ff-33455b6e828c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:44:39.406106 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:39.406106 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:39.406106 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:39.406106 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:39.406106 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:39.406106 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:39.406106 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:39.406106 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:39.406106 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:39.406106 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:39.406106 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:39.406106 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 03:44:39.406106 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 03:44:39.406106 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 03:44:39.408418 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 03:44:39.408418 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:39.408418 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:39.408418 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:39.408418 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:39.408418 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:39.408418 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:39.408418 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:39.408418 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:39.408418 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:39.408418 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:39.408418 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:39.408418 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:39.408418 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:39.408418 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:39.408418 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:39.408418 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:39.410222 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 03:44:39.410222 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 03:44:39.410222 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 03:44:39.410222 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 03:44:39.410222 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 03:44:39.410222 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 03:44:39.410222 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:44:39.410222 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:39.410222 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 471/941] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:44:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:39.415641 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ccbb9-2c69-4882-a3ff-33455b6e828c None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:39.467840 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:39.490729 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:39.560094 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ccbb9-2c69-4882-a3ff-33455b6e828c None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:39.573469 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc5b5e-0924-4f29-b536-d1d80291b126 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:39.613730 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5405e05-0d64-4d21-87a4-e2af103d8b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:39.614819 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5405e05-0d64-4d21-87a4-e2af103d8b92 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:39.615310 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5405e05-0d64-4d21-87a4-e2af103d8b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:39.615861 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5405e05-0d64-4d21-87a4-e2af103d8b92 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:39.617229 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5405e05-0d64-4d21-87a4-e2af103d8b92 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:39.617853 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5405e05-0d64-4d21-87a4-e2af103d8b92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:39.619129 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778fa3c1-c975-48a7-9d97-a6987b53d100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:39.620102 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778fa3c1-c975-48a7-9d97-a6987b53d100 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:39.620437 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5405e05-0d64-4d21-87a4-e2af103d8b92 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:39.620553 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778fa3c1-c975-48a7-9d97-a6987b53d100 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:39.620917 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778fa3c1-c975-48a7-9d97-a6987b53d100 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:39.621863 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778fa3c1-c975-48a7-9d97-a6987b53d100 None admin] RBAC: Adding query filter params (interface=public, service_id=eb4c8cce4f94460ebbf8cdf3185cb991, region_id=RegionOne) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:39.622276 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778fa3c1-c975-48a7-9d97-a6987b53d100 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:39.624606 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778fa3c1-c975-48a7-9d97-a6987b53d100 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:39.636456 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 472/942] 10.222.0.46 () {56 vars in 1251 bytes} [Fri Jul 1 03:44:39 2022] GET /identity/v3/endpoints?service_id=eb4c8cce4f94460ebbf8cdf3185cb991&interface=public®ion_id=RegionOne => generated 194 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:39.636456 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778fa3c1-c975-48a7-9d97-a6987b53d100 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:39.641085 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 471/943] 10.222.0.46 () {56 vars in 1115 bytes} [Fri Jul 1 03:44:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:39.642736 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5405e05-0d64-4d21-87a4-e2af103d8b92 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:39.759634 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:39.768928 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5405e05-0d64-4d21-87a4-e2af103d8b92 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:39.784765 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778fa3c1-c975-48a7-9d97-a6987b53d100 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:39.807201 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:39.817809 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b5d59-3d29-406b-87e8-fd99561b42c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:39.818481 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b5d59-3d29-406b-87e8-fd99561b42c1 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:39.818767 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b5d59-3d29-406b-87e8-fd99561b42c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:39.819043 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b5d59-3d29-406b-87e8-fd99561b42c1 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:39.819762 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b5d59-3d29-406b-87e8-fd99561b42c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:39.821166 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b5d59-3d29-406b-87e8-fd99561b42c1 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:39.831958 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 472/944] 10.222.0.46 () {56 vars in 1087 bytes} [Fri Jul 1 03:44:39 2022] GET /identity/v3/services => generated 1497 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 03:44:39.832824 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b5d59-3d29-406b-87e8-fd99561b42c1 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:39.847274 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb00f91-0b75-413e-8c40-8b202b83cb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:39.848675 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb00f91-0b75-413e-8c40-8b202b83cb51 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:39.849224 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb00f91-0b75-413e-8c40-8b202b83cb51 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:39.851417 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb00f91-0b75-413e-8c40-8b202b83cb51 None admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:39.852265 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb00f91-0b75-413e-8c40-8b202b83cb51 None admin] RBAC: Adding query filter params (name=service) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:39.853397 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb00f91-0b75-413e-8c40-8b202b83cb51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:39.856242 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb00f91-0b75-413e-8c40-8b202b83cb51 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:39.890938 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 473/945] 10.222.0.46 () {56 vars in 1112 bytes} [Fri Jul 1 03:44:39 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:39.893630 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac448c-33b6-4875-bf86-2ff68e4dabd4 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:39.894145 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac448c-33b6-4875-bf86-2ff68e4dabd4 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:39.894655 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac448c-33b6-4875-bf86-2ff68e4dabd4 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:39.897695 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 474/946] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:44:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:44:39.907849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313f855-bbf7-40d8-abfc-f59c0c21fd60 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:39.908346 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313f855-bbf7-40d8-abfc-f59c0c21fd60 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:39.908663 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313f855-bbf7-40d8-abfc-f59c0c21fd60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:39.938936 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-0313f855-bbf7-40d8-abfc-f59c0c21fd60 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:44:39.941770 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-0313f855-bbf7-40d8-abfc-f59c0c21fd60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:44:40.026931 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b5d59-3d29-406b-87e8-fd99561b42c1 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:40.066891 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 475/947] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:44:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:44:40.075986 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d1b7e-175d-41e3-a0cd-7dd80c374a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:40.077572 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d1b7e-175d-41e3-a0cd-7dd80c374a96 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:40.077887 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d1b7e-175d-41e3-a0cd-7dd80c374a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:40.078296 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d1b7e-175d-41e3-a0cd-7dd80c374a96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:40.090202 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313f855-bbf7-40d8-abfc-f59c0c21fd60 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:40.094696 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8d1b7e-175d-41e3-a0cd-7dd80c374a96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:40.097046 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8d1b7e-175d-41e3-a0cd-7dd80c374a96 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:40.129422 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-8a8d1b7e-175d-41e3-a0cd-7dd80c374a96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:40.129422 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:40.129422 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:40.129422 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:40.129422 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:40.129422 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:40.129422 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:40.129422 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:40.129422 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:40.129422 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:40.129422 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:40.129422 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:40.129422 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:44:40.129422 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:44:40.129422 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:44:40.131403 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:44:40.131403 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:40.131403 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:40.131403 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:40.131403 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:40.131403 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:40.131403 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:40.131403 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:40.131403 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:40.131403 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:40.131403 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:40.131403 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:40.131403 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:40.131403 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:40.131403 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:40.131403 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:40.131403 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:40.133652 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:44:40.133652 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:44:40.133652 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:40.133652 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:40.133652 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 473/948] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:44:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:40.138049 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d1b7e-175d-41e3-a0cd-7dd80c374a96 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:40.177799 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:40.232045 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313f855-bbf7-40d8-abfc-f59c0c21fd60 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:40.245371 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:40.287269 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97853d65-7d6a-4b5f-a7b3-c6811a8f7e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:40.289159 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97853d65-7d6a-4b5f-a7b3-c6811a8f7e20 None admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:40.289909 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97853d65-7d6a-4b5f-a7b3-c6811a8f7e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:40.290629 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97853d65-7d6a-4b5f-a7b3-c6811a8f7e20 None admin] PATH_INFO: `/v3/services` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:40.292882 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97853d65-7d6a-4b5f-a7b3-c6811a8f7e20 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:40.296421 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97853d65-7d6a-4b5f-a7b3-c6811a8f7e20 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:40.329714 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d1b7e-175d-41e3-a0cd-7dd80c374a96 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:40.372252 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39238ea1-f6c9-4f3a-af58-8fbc45575423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:40.372947 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39238ea1-f6c9-4f3a-af58-8fbc45575423 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:40.373229 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39238ea1-f6c9-4f3a-af58-8fbc45575423 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:40.373515 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39238ea1-f6c9-4f3a-af58-8fbc45575423 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:40.374813 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39238ea1-f6c9-4f3a-af58-8fbc45575423 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:40.375117 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39238ea1-f6c9-4f3a-af58-8fbc45575423 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:40.376530 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39238ea1-f6c9-4f3a-af58-8fbc45575423 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:40.397593 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 474/949] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:44:40.398872 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39238ea1-f6c9-4f3a-af58-8fbc45575423 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:40.401172 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 476/950] 10.222.0.46 () {60 vars in 1141 bytes} [Fri Jul 1 03:44:40 2022] POST /identity/v3/services => generated 242 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 03:44:40.522788 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:40.576608 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39238ea1-f6c9-4f3a-af58-8fbc45575423 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:40.631106 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d76cd-cf04-4b2e-a076-4d366b7cebae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:40.632027 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d76cd-cf04-4b2e-a076-4d366b7cebae None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:40.632316 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d76cd-cf04-4b2e-a076-4d366b7cebae None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:40.632599 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d76cd-cf04-4b2e-a076-4d366b7cebae None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:40.642635 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d76cd-cf04-4b2e-a076-4d366b7cebae None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:40.644292 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d76cd-cf04-4b2e-a076-4d366b7cebae None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:40.661826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-644d76cd-cf04-4b2e-a076-4d366b7cebae None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 01 03:44:40.661826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:40.661826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:40.661826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:40.661826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:40.661826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:40.661826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:40.661826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:40.661826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:40.661826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:40.661826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:40.661826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:40.661826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 03:44:40.661826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 03:44:40.661826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 03:44:40.661826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 03:44:40.663666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:40.663666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:40.663666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 03:44:40.663666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:44:40.663666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 03:44:40.663666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:44:40.663666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:40.663666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:40.663666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:40.663666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:40.663666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:40.663666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:40.663666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:40.663666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:40.663666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:40.663666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:40.663666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:40.663666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:40.665504 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:40.665504 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:40.665504 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 03:44:40.665504 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 03:44:40.665504 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 03:44:40.665504 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 03:44:40.665504 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 03:44:40.665504 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 03:44:40.665504 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 01 03:44:40.665504 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:40.665504 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 475/951] 10.222.0.46 () {56 vars in 1117 bytes} [Fri Jul 1 03:44:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:40.677191 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97853d65-7d6a-4b5f-a7b3-c6811a8f7e20 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:40.860070 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97853d65-7d6a-4b5f-a7b3-c6811a8f7e20 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:40.908574 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4336ba-168e-4f0d-85c3-db1f072c6c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:40.909264 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4336ba-168e-4f0d-85c3-db1f072c6c22 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:40.909545 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4336ba-168e-4f0d-85c3-db1f072c6c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:40.909820 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4336ba-168e-4f0d-85c3-db1f072c6c22 None admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:40.910675 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4336ba-168e-4f0d-85c3-db1f072c6c22 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:40.911244 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4336ba-168e-4f0d-85c3-db1f072c6c22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:40.912754 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4336ba-168e-4f0d-85c3-db1f072c6c22 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:40.933424 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 477/952] 10.222.0.46 () {56 vars in 1149 bytes} [Fri Jul 1 03:44:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:40.939801 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d76cd-cf04-4b2e-a076-4d366b7cebae None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:41.056683 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d76cd-cf04-4b2e-a076-4d366b7cebae None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:41.089774 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:41.098559 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779eb965-72fc-4f74-8c49-ae66b3f8d6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:41.099393 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779eb965-72fc-4f74-8c49-ae66b3f8d6a5 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:41.099714 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779eb965-72fc-4f74-8c49-ae66b3f8d6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:41.099997 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779eb965-72fc-4f74-8c49-ae66b3f8d6a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:41.112781 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779eb965-72fc-4f74-8c49-ae66b3f8d6a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:41.114206 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779eb965-72fc-4f74-8c49-ae66b3f8d6a5 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:41.134548 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-779eb965-72fc-4f74-8c49-ae66b3f8d6a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:41.134548 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:41.134548 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:41.134548 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:41.134548 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:41.134548 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:41.134548 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:41.134548 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:41.134548 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:41.134548 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:41.134548 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:41.134548 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:41.134548 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:44:41.134548 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:44:41.134548 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:44:41.135616 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:44:41.135616 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:41.135616 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:41.135616 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:41.135616 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:41.135616 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:41.135616 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:41.135616 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:41.135616 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:41.135616 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:41.135616 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:41.135616 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:41.135616 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:41.135616 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:41.135616 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:41.135616 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:41.135616 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:41.136578 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:44:41.136578 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:44:41.136578 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:41.136578 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:41.141074 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 476/953] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:44:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:41.142737 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4336ba-168e-4f0d-85c3-db1f072c6c22 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:41.176026 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:41.310052 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4336ba-168e-4f0d-85c3-db1f072c6c22 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:41.353594 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e19d9b-e66e-41e8-9f31-7a756dac0d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:41.354627 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e19d9b-e66e-41e8-9f31-7a756dac0d9f None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:41.355239 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e19d9b-e66e-41e8-9f31-7a756dac0d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:41.355759 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e19d9b-e66e-41e8-9f31-7a756dac0d9f None admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:41.356715 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e19d9b-e66e-41e8-9f31-7a756dac0d9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:41.357223 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e19d9b-e66e-41e8-9f31-7a756dac0d9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:41.359370 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e19d9b-e66e-41e8-9f31-7a756dac0d9f None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:41.372810 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 478/954] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:41.378987 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779eb965-72fc-4f74-8c49-ae66b3f8d6a5 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:41.492350 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779eb965-72fc-4f74-8c49-ae66b3f8d6a5 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:41.531589 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b5e400-c45a-48f0-9cd9-ef16b737d28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:41.532408 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5e400-c45a-48f0-9cd9-ef16b737d28c None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:41.532696 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5e400-c45a-48f0-9cd9-ef16b737d28c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:41.532979 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5e400-c45a-48f0-9cd9-ef16b737d28c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:41.540811 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b5e400-c45a-48f0-9cd9-ef16b737d28c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:41.542298 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b5e400-c45a-48f0-9cd9-ef16b737d28c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:41.557298 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-12b5e400-c45a-48f0-9cd9-ef16b737d28c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:44:41.557298 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:41.557298 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:41.557298 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:41.557298 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:41.557298 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:41.557298 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:41.557298 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:41.557298 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:41.557298 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:41.557298 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:41.557298 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:41.557298 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 03:44:41.557298 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 03:44:41.557298 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 03:44:41.558256 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 03:44:41.558256 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:41.558256 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:41.558256 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:41.558256 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:41.558256 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:41.558256 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:41.558256 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:41.558256 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:41.558256 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:41.558256 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:41.558256 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:41.558256 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:41.558256 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:41.558256 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:41.558256 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:41.558256 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:41.559147 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 03:44:41.559147 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 03:44:41.559147 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 03:44:41.559147 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 03:44:41.559147 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 03:44:41.559147 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 03:44:41.559147 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:44:41.559147 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:41.563591 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 477/955] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:44:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 03:44:41.565043 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e19d9b-e66e-41e8-9f31-7a756dac0d9f None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:41.662116 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:41.678791 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e19d9b-e66e-41e8-9f31-7a756dac0d9f None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:41.715443 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f0caf2-02b9-4d29-a335-7adabb0b3bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:41.716145 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f0caf2-02b9-4d29-a335-7adabb0b3bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:41.716435 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f0caf2-02b9-4d29-a335-7adabb0b3bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:41.716712 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f0caf2-02b9-4d29-a335-7adabb0b3bd4 None admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:41.718109 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f0caf2-02b9-4d29-a335-7adabb0b3bd4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:41.718394 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f0caf2-02b9-4d29-a335-7adabb0b3bd4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:41.719871 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f0caf2-02b9-4d29-a335-7adabb0b3bd4 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:41.737865 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 479/956] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 1 03:44:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:41.739236 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b5e400-c45a-48f0-9cd9-ef16b737d28c None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:41.786413 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:41.848808 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b5e400-c45a-48f0-9cd9-ef16b737d28c None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:41.910335 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c2426-3dd2-48f0-8188-33960d3b85d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:41.912266 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c2426-3dd2-48f0-8188-33960d3b85d5 None admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:41.912712 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c2426-3dd2-48f0-8188-33960d3b85d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:41.913208 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c2426-3dd2-48f0-8188-33960d3b85d5 None admin] PATH_INFO: `/v3/projects/da83db15a312499fb627691ae442f233/users/dd41221abea04808bed5ef4ac4528c62/roles/43eeddda303844f3850a6e55a673a34f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:41.917183 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c2426-3dd2-48f0-8188-33960d3b85d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=da83db15a312499fb627691ae442f233, user_id=dd41221abea04808bed5ef4ac4528c62, role_id=43eeddda303844f3850a6e55a673a34f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:41.919872 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c2426-3dd2-48f0-8188-33960d3b85d5 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:42.006802 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 478/957] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 1 03:44:41 2022] PUT /identity/v3/projects/da83db15a312499fb627691ae442f233/users/dd41221abea04808bed5ef4ac4528c62/roles/43eeddda303844f3850a6e55a673a34f => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 03:44:42.041314 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894453c-c641-4c6a-b2fe-98f29b403189 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:42.041666 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894453c-c641-4c6a-b2fe-98f29b403189 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:42.041954 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894453c-c641-4c6a-b2fe-98f29b403189 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:42.043811 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 480/958] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:44:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:44:42.049925 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192472c-ec9f-4a7c-b93f-1aff7e223de8 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:42.050261 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192472c-ec9f-4a7c-b93f-1aff7e223de8 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:42.050489 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192472c-ec9f-4a7c-b93f-1aff7e223de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:42.071309 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-7192472c-ec9f-4a7c-b93f-1aff7e223de8 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:44:42.073029 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-7192472c-ec9f-4a7c-b93f-1aff7e223de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:44:42.169700 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 479/959] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:44:42 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:44:42.212330 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3894453c-c641-4c6a-b2fe-98f29b403189 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:42.376737 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244b2fd-5b5a-42b0-a48f-9b9d93addc60 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:42.376737 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244b2fd-5b5a-42b0-a48f-9b9d93addc60 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:42.377208 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244b2fd-5b5a-42b0-a48f-9b9d93addc60 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:42.379334 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 480/960] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:44:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 03:44:42.385996 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236480a4-8030-4a6d-9e0b-e7cd92310d8b None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:42.386344 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236480a4-8030-4a6d-9e0b-e7cd92310d8b None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:42.386717 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236480a4-8030-4a6d-9e0b-e7cd92310d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:42.392364 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3894453c-c641-4c6a-b2fe-98f29b403189 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:42.409299 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-236480a4-8030-4a6d-9e0b-e7cd92310d8b None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:44:42.411557 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-236480a4-8030-4a6d-9e0b-e7cd92310d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:44:42.432368 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662a2c7-3b4a-40a5-b7ac-9327bb0362e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:42.433479 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662a2c7-3b4a-40a5-b7ac-9327bb0362e2 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:42.433956 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662a2c7-3b4a-40a5-b7ac-9327bb0362e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:42.434421 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662a2c7-3b4a-40a5-b7ac-9327bb0362e2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:42.435268 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662a2c7-3b4a-40a5-b7ac-9327bb0362e2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:42.437020 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662a2c7-3b4a-40a5-b7ac-9327bb0362e2 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:42.450324 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-7662a2c7-3b4a-40a5-b7ac-9327bb0362e2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 03:44:42.450324 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:42.450324 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 03:44:42.450324 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 03:44:42.450324 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 03:44:42.450324 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 03:44:42.450324 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 03:44:42.450324 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:44:42.450324 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 03:44:42.450324 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:42.450324 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 03:44:42.450324 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:42.450324 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:42.450324 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:42.450324 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:42.450324 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:42.450324 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:42.451533 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:42.451533 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:42.451533 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:42.451533 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:42.451533 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:42.451533 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:42.451533 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 03:44:42.451533 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 03:44:42.451533 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 03:44:42.451533 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 03:44:42.451533 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:42.451533 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:42.451533 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:42.451533 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:42.451533 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:42.451533 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:42.452965 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:42.452965 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:42.452965 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:42.452965 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:42.452965 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:42.452965 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:42.452965 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:42.452965 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:42.452965 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:42.452965 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:42.452965 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 03:44:42.452965 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:44:42.452965 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 03:44:42.452965 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:42.456228 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 481/961] 10.222.0.46 () {56 vars in 1126 bytes} [Fri Jul 1 03:44:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:42.464461 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:42.467265 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662a2c7-3b4a-40a5-b7ac-9327bb0362e2 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:42.491749 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:42.497496 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 481/962] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:44:42 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 03:44:42.526281 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236480a4-8030-4a6d-9e0b-e7cd92310d8b None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:42.597457 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662a2c7-3b4a-40a5-b7ac-9327bb0362e2 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:42.635112 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4f057-28a4-456b-915b-ad81125c09ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:42.636187 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4f057-28a4-456b-915b-ad81125c09ea None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:42.636612 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4f057-28a4-456b-915b-ad81125c09ea None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:42.637036 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4f057-28a4-456b-915b-ad81125c09ea None admin] PATH_INFO: `/v3/services` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:42.638002 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da4f057-28a4-456b-915b-ad81125c09ea None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:42.638579 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da4f057-28a4-456b-915b-ad81125c09ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:42.640543 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da4f057-28a4-456b-915b-ad81125c09ea None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:42.645739 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236480a4-8030-4a6d-9e0b-e7cd92310d8b None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:42.648161 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 482/963] 10.222.0.46 () {56 vars in 1122 bytes} [Fri Jul 1 03:44:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:42.653501 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4f057-28a4-456b-915b-ad81125c09ea None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:42.696759 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb678270-205a-4d7d-8106-295cf2c4da6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:42.698028 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb678270-205a-4d7d-8106-295cf2c4da6e None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:42.698776 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb678270-205a-4d7d-8106-295cf2c4da6e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:42.699725 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb678270-205a-4d7d-8106-295cf2c4da6e None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:42.700944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb678270-205a-4d7d-8106-295cf2c4da6e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:42.703474 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb678270-205a-4d7d-8106-295cf2c4da6e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:42.746720 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.sql.core [None req-cb678270-205a-4d7d-8106-295cf2c4da6e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 01 03:44:42.746720 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 01 03:44:42.746720 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [parameters: {'user_id': 'daa3fab819a34ed999e62f751995fdcb', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 01 03:44:42.746720 dv-cinder-846842-8-smb devstack@keystone.service[80377]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80377) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 01 03:44:42.751134 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:42.759723 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-cb678270-205a-4d7d-8106-295cf2c4da6e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 01 03:44:42.759723 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:42.759723 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 01 03:44:42.759723 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 01 03:44:42.759723 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 01 03:44:42.759723 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 01 03:44:42.759723 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 01 03:44:42.759723 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application result = self._query(query) Jul 01 03:44:42.759723 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 01 03:44:42.759723 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application conn.query(q) Jul 01 03:44:42.759723 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 01 03:44:42.759723 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 01 03:44:42.759723 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 01 03:44:42.759723 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application result.read() Jul 01 03:44:42.759723 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 01 03:44:42.760648 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 01 03:44:42.760648 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 01 03:44:42.760648 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 01 03:44:42.760648 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 01 03:44:42.760648 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 01 03:44:42.760648 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 01 03:44:42.760648 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 01 03:44:42.760648 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 01 03:44:42.760648 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:42.760648 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 01 03:44:42.760648 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:42.760648 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:42.760648 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 01 03:44:42.760648 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 01 03:44:42.760648 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 01 03:44:42.760648 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 01 03:44:42.760648 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 01 03:44:42.760648 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application next(self.gen) Jul 01 03:44:42.761709 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 01 03:44:42.761709 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application yield resource Jul 01 03:44:42.761709 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 01 03:44:42.761709 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application next(self.gen) Jul 01 03:44:42.761709 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 01 03:44:42.761709 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self.session.rollback() Jul 01 03:44:42.761709 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 03:44:42.761709 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self.force_reraise() Jul 01 03:44:42.761709 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 03:44:42.761709 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise self.value Jul 01 03:44:42.761709 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 01 03:44:42.761709 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 01 03:44:42.761709 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 01 03:44:42.761709 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application session.commit() Jul 01 03:44:42.761709 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 01 03:44:42.761709 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 01 03:44:42.761709 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 01 03:44:42.762613 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._prepare_impl() Jul 01 03:44:42.762613 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 01 03:44:42.762613 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self.session.flush() Jul 01 03:44:42.762613 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 01 03:44:42.762613 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._flush(objects) Jul 01 03:44:42.762613 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 01 03:44:42.762613 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 01 03:44:42.762613 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 01 03:44:42.762613 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application compat.raise_( Jul 01 03:44:42.762613 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 01 03:44:42.762613 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception Jul 01 03:44:42.762613 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 01 03:44:42.762613 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application flush_context.execute() Jul 01 03:44:42.762613 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 01 03:44:42.762613 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rec.execute(self) Jul 01 03:44:42.762613 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 01 03:44:42.762613 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 01 03:44:42.763557 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 01 03:44:42.763557 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 01 03:44:42.763557 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 01 03:44:42.763557 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 01 03:44:42.763557 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 01 03:44:42.763557 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 01 03:44:42.763557 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 01 03:44:42.763557 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 01 03:44:42.763557 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 01 03:44:42.763557 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 01 03:44:42.763557 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 01 03:44:42.763557 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 01 03:44:42.763557 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 01 03:44:42.763557 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 01 03:44:42.763557 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 01 03:44:42.763557 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception Jul 01 03:44:42.764998 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 01 03:44:42.764998 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 01 03:44:42.764998 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 01 03:44:42.764998 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 01 03:44:42.764998 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 01 03:44:42.764998 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application result = self._query(query) Jul 01 03:44:42.764998 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 01 03:44:42.764998 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application conn.query(q) Jul 01 03:44:42.764998 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 01 03:44:42.764998 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 01 03:44:42.764998 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 01 03:44:42.764998 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application result.read() Jul 01 03:44:42.764998 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 01 03:44:42.764998 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 01 03:44:42.764998 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 01 03:44:42.764998 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 01 03:44:42.765845 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 01 03:44:42.765845 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 01 03:44:42.765845 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 01 03:44:42.765845 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 01 03:44:42.765845 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 01 03:44:42.765845 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 01 03:44:42.765845 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [parameters: {'user_id': 'daa3fab819a34ed999e62f751995fdcb', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 01 03:44:42.765845 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 01 03:44:42.765845 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:42.765845 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 03:44:42.765845 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:42.765845 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:42.765845 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:42.765845 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:42.765845 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:42.766637 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:42.766637 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:42.766637 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:42.766637 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:42.766637 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:42.766637 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:42.766637 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:42.766637 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 01 03:44:42.766637 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 01 03:44:42.766637 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:42.766637 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:42.766637 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 03:44:42.766637 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:44:42.766637 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 03:44:42.766637 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:44:42.766637 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 01 03:44:42.766637 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 01 03:44:42.769041 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 01 03:44:42.769041 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 01 03:44:42.769041 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 01 03:44:42.769041 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 01 03:44:42.769041 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 01 03:44:42.769041 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:42.771887 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 482/964] 10.222.0.46 () {60 vars in 1131 bytes} [Fri Jul 1 03:44:42 2022] POST /identity/v3/users => generated 160 bytes in 246 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 01 03:44:42.777129 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb678270-205a-4d7d-8106-295cf2c4da6e None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:42.798706 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4f057-28a4-456b-915b-ad81125c09ea None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:42.811658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:42.847614 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f6dab-f47d-49e1-84e5-5f42ae4dd474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:42.849013 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f6dab-f47d-49e1-84e5-5f42ae4dd474 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:42.850539 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f6dab-f47d-49e1-84e5-5f42ae4dd474 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:42.850955 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f6dab-f47d-49e1-84e5-5f42ae4dd474 None admin] PATH_INFO: `/v3/services` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:42.852062 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f6dab-f47d-49e1-84e5-5f42ae4dd474 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:42.852683 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f6dab-f47d-49e1-84e5-5f42ae4dd474 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:42.854830 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f6dab-f47d-49e1-84e5-5f42ae4dd474 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:42.862918 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 483/965] 10.222.0.46 () {56 vars in 1122 bytes} [Fri Jul 1 03:44:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:42.869769 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f6dab-f47d-49e1-84e5-5f42ae4dd474 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:42.909738 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb678270-205a-4d7d-8106-295cf2c4da6e None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:42.951567 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d77118-106c-4988-8227-ab25634b7b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:42.952920 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d77118-106c-4988-8227-ab25634b7b19 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:42.953264 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d77118-106c-4988-8227-ab25634b7b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:42.953575 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d77118-106c-4988-8227-ab25634b7b19 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:42.962951 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d77118-106c-4988-8227-ab25634b7b19 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:42.964775 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d77118-106c-4988-8227-ab25634b7b19 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:42.980799 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-88d77118-106c-4988-8227-ab25634b7b19 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 01 03:44:42.980799 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:42.980799 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:42.980799 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:42.980799 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:42.980799 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:42.980799 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:42.980799 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:42.980799 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:42.980799 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:42.980799 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:42.980799 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:42.980799 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 03:44:42.980799 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 03:44:42.980799 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 03:44:42.980799 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 03:44:42.982683 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:42.982683 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:42.982683 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 03:44:42.982683 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:44:42.982683 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 03:44:42.982683 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:44:42.982683 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:42.982683 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:42.982683 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:42.982683 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:42.982683 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:42.982683 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:42.982683 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:42.982683 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:42.982683 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:42.982683 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:42.982683 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:42.982683 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:42.985899 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:42.985899 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:42.985899 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 03:44:42.985899 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 03:44:42.985899 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 03:44:42.985899 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 03:44:42.985899 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 03:44:42.985899 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 03:44:42.985899 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 01 03:44:42.985899 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:42.987717 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 483/966] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:44:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:42.988630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d77118-106c-4988-8227-ab25634b7b19 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:43.081294 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:43.082245 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f6dab-f47d-49e1-84e5-5f42ae4dd474 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:43.107648 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d77118-106c-4988-8227-ab25634b7b19 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:43.136498 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4fc215-6922-4b9a-947c-92a92285c325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:43.138104 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fc215-6922-4b9a-947c-92a92285c325 None admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:43.138801 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fc215-6922-4b9a-947c-92a92285c325 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:43.139361 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fc215-6922-4b9a-947c-92a92285c325 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:43.140709 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4fc215-6922-4b9a-947c-92a92285c325 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:43.142135 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4fc215-6922-4b9a-947c-92a92285c325 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:43.151089 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:43.157081 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a659a-daa8-4ae3-92a7-d3c13b05f2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:43.158263 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a659a-daa8-4ae3-92a7-d3c13b05f2ef None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:43.158777 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a659a-daa8-4ae3-92a7-d3c13b05f2ef None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:43.159119 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a659a-daa8-4ae3-92a7-d3c13b05f2ef None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:43.160998 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06a659a-daa8-4ae3-92a7-d3c13b05f2ef None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:43.166634 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06a659a-daa8-4ae3-92a7-d3c13b05f2ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:43.166634 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06a659a-daa8-4ae3-92a7-d3c13b05f2ef None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:43.232053 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 484/967] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Jul 1 03:44:42 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:43.234241 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797b0c9-6437-4f9c-a991-54d12f11e586 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:43.234597 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797b0c9-6437-4f9c-a991-54d12f11e586 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:43.234779 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797b0c9-6437-4f9c-a991-54d12f11e586 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:43.236464 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 485/968] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:44:43.242217 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9755b51-bc60-428c-b786-e7d7dd73d993 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:43.244822 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9755b51-bc60-428c-b786-e7d7dd73d993 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:43.244822 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9755b51-bc60-428c-b786-e7d7dd73d993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:43.248200 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 484/969] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 1 03:44:42 2022] POST /identity/v3/endpoints => generated 349 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 03:44:43.268684 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-c9755b51-bc60-428c-b786-e7d7dd73d993 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:44:43.270780 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c9755b51-bc60-428c-b786-e7d7dd73d993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:44:43.368598 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 486/970] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:44:43 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:44:43.394871 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4fc215-6922-4b9a-947c-92a92285c325 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:43.580956 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4fc215-6922-4b9a-947c-92a92285c325 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:43.641019 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f3693d-6b36-43f3-912f-608400f7feea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:43.642368 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3693d-6b36-43f3-912f-608400f7feea None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:43.642868 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3693d-6b36-43f3-912f-608400f7feea None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:43.643365 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3693d-6b36-43f3-912f-608400f7feea None admin] PATH_INFO: `/v3/services/compute` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:43.644687 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f3693d-6b36-43f3-912f-608400f7feea None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:43.647319 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f3693d-6b36-43f3-912f-608400f7feea None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:43.664055 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-a2f3693d-6b36-43f3-912f-608400f7feea None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 01 03:44:43.664055 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:43.664055 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 03:44:43.664055 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 03:44:43.664055 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 03:44:43.664055 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 03:44:43.664055 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 03:44:43.664055 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:44:43.664055 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 01 03:44:43.664055 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:43.664055 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 03:44:43.664055 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:43.664055 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:43.664055 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:43.664055 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:43.664055 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:43.664055 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:43.665288 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:43.665288 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:43.665288 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:43.665288 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:43.665288 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:43.665288 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:43.665288 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 03:44:43.665288 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 03:44:43.665288 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 03:44:43.665288 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 03:44:43.665288 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:43.665288 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:43.665288 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:43.665288 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:43.665288 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:43.665288 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:43.666280 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:43.666280 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:43.666280 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:43.666280 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:43.666280 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:43.666280 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:43.666280 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:43.666280 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:43.666280 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:43.666280 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:43.666280 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 03:44:43.666280 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:44:43.666280 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 01 03:44:43.666280 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:43.666280 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 485/971] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:44:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:43.672253 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9755b51-bc60-428c-b786-e7d7dd73d993 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:43.745805 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:43.801081 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9755b51-bc60-428c-b786-e7d7dd73d993 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:43.851541 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce28e7-561a-45e5-bbaa-4f99f718c0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:43.852714 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce28e7-561a-45e5-bbaa-4f99f718c0fc None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:43.853177 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce28e7-561a-45e5-bbaa-4f99f718c0fc None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:43.853677 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce28e7-561a-45e5-bbaa-4f99f718c0fc None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:43.855008 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce28e7-561a-45e5-bbaa-4f99f718c0fc None admin] RBAC: Adding query filter params (name=compute) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:43.855700 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce28e7-561a-45e5-bbaa-4f99f718c0fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:43.857831 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce28e7-561a-45e5-bbaa-4f99f718c0fc None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:43.872067 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 487/972] 10.222.0.46 () {56 vars in 1112 bytes} [Fri Jul 1 03:44:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:43.873840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f3693d-6b36-43f3-912f-608400f7feea None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:43.950291 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:44.013580 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f3693d-6b36-43f3-912f-608400f7feea None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:44.053775 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7e3d3-a4ea-4921-898c-d117316f1901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:44.054367 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7e3d3-a4ea-4921-898c-d117316f1901 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:44.054654 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7e3d3-a4ea-4921-898c-d117316f1901 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:44.054930 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7e3d3-a4ea-4921-898c-d117316f1901 None admin] PATH_INFO: `/v3/services` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:44.055678 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c7e3d3-a4ea-4921-898c-d117316f1901 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:44.055990 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c7e3d3-a4ea-4921-898c-d117316f1901 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:44.057364 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c7e3d3-a4ea-4921-898c-d117316f1901 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:44.066613 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 486/973] 10.222.0.46 () {56 vars in 1112 bytes} [Fri Jul 1 03:44:43 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:44.072348 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce28e7-561a-45e5-bbaa-4f99f718c0fc None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:44.218669 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce28e7-561a-45e5-bbaa-4f99f718c0fc None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:44.251900 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:44.258902 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81028f-2737-4975-a9f8-5e504ffd2e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:44.259604 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81028f-2737-4975-a9f8-5e504ffd2e69 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:44.259891 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81028f-2737-4975-a9f8-5e504ffd2e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:44.260170 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81028f-2737-4975-a9f8-5e504ffd2e69 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:44.265229 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee81028f-2737-4975-a9f8-5e504ffd2e69 None admin] RBAC: Adding query filter params (interface=public, service_id=2c5a8a85da30468abe197270f8bb9ced, region_id=RegionOne) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:44.265229 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee81028f-2737-4975-a9f8-5e504ffd2e69 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:44.265229 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee81028f-2737-4975-a9f8-5e504ffd2e69 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:44.271548 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 488/974] 10.222.0.46 () {56 vars in 1251 bytes} [Fri Jul 1 03:44:44 2022] GET /identity/v3/endpoints?service_id=2c5a8a85da30468abe197270f8bb9ced&interface=public®ion_id=RegionOne => generated 194 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:44.276803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7e3d3-a4ea-4921-898c-d117316f1901 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:44.349373 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4f2dd-9694-4988-b628-e06ecb683aae None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:44.349588 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4f2dd-9694-4988-b628-e06ecb683aae None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:44.349841 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4f2dd-9694-4988-b628-e06ecb683aae None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:44.351384 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 489/975] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 03:44:44.356666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725d694-9378-4250-8fd9-2fb21590cf35 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:44.356952 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725d694-9378-4250-8fd9-2fb21590cf35 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:44.357282 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725d694-9378-4250-8fd9-2fb21590cf35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:44.380027 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-9725d694-9378-4250-8fd9-2fb21590cf35 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:44:44.382841 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9725d694-9378-4250-8fd9-2fb21590cf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:44:44.416983 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7e3d3-a4ea-4921-898c-d117316f1901 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:44.453203 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:44.470194 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 490/976] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:44:44 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 03:44:44.470432 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f264a-0cb9-4e11-8810-51b40ea50400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:44.471069 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f264a-0cb9-4e11-8810-51b40ea50400 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:44.471343 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f264a-0cb9-4e11-8810-51b40ea50400 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:44.471842 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f264a-0cb9-4e11-8810-51b40ea50400 None admin] PATH_INFO: `/v3/services` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:44.472348 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365f264a-0cb9-4e11-8810-51b40ea50400 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:44.473725 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365f264a-0cb9-4e11-8810-51b40ea50400 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:44.482354 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 487/977] 10.222.0.46 () {56 vars in 1087 bytes} [Fri Jul 1 03:44:44 2022] GET /identity/v3/services => generated 1727 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 03:44:44.503958 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725d694-9378-4250-8fd9-2fb21590cf35 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:44.659803 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725d694-9378-4250-8fd9-2fb21590cf35 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:44.692029 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:44.704557 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3b705-b740-435d-ac18-20c7837da3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:44.705665 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3b705-b740-435d-ac18-20c7837da3ff None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:44.705665 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3b705-b740-435d-ac18-20c7837da3ff None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:44.711164 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3b705-b740-435d-ac18-20c7837da3ff None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:44.726697 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe3b705-b740-435d-ac18-20c7837da3ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:44:44.742248 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-5fe3b705-b740-435d-ac18-20c7837da3ff None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 01 03:44:44.742248 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:44.742248 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:44.742248 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:44.742248 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:44.742248 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:44.742248 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:44.742248 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:44.742248 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:44.742248 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:44.742248 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:44.742248 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:44.742248 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:44:44.742248 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:44:44.742248 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:44:44.742248 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:44:44.743251 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:44:44.743251 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:44:44.743251 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:44:44.743251 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:44:44.743251 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:44.743251 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:44.743251 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:44.743251 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:44.743251 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:44.743251 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:44.743251 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:44.743251 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:44.743251 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:44.743251 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:44.743251 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:44.743251 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:44.744119 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:44.744119 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:44.744119 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:44.744119 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:44.744119 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:44:44.744119 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:44:44.744119 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:44:44.744119 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:44:44.744119 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:44:44.744119 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:44:44.744119 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 01 03:44:44.744119 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:44.744766 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 491/978] 10.222.0.46 () {56 vars in 1120 bytes} [Fri Jul 1 03:44:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:44.751941 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f264a-0cb9-4e11-8810-51b40ea50400 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:44.875183 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f264a-0cb9-4e11-8810-51b40ea50400 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:44.936145 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cdac4c-ce2f-4b93-8b3d-85a49854f14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:44.937213 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdac4c-ce2f-4b93-8b3d-85a49854f14e None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:44.937729 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdac4c-ce2f-4b93-8b3d-85a49854f14e None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:44.938242 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cdac4c-ce2f-4b93-8b3d-85a49854f14e None admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:44.939687 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cdac4c-ce2f-4b93-8b3d-85a49854f14e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:44.940268 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cdac4c-ce2f-4b93-8b3d-85a49854f14e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:44.942942 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cdac4c-ce2f-4b93-8b3d-85a49854f14e None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:44.962946 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 488/979] 10.222.0.46 () {56 vars in 1115 bytes} [Fri Jul 1 03:44:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:44.965487 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3b705-b740-435d-ac18-20c7837da3ff None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:45.162144 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3b705-b740-435d-ac18-20c7837da3ff None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:45.222095 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf11838-f768-442f-950f-a273ef2edd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:45.223365 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf11838-f768-442f-950f-a273ef2edd8d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:45.223878 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf11838-f768-442f-950f-a273ef2edd8d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:45.224358 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf11838-f768-442f-950f-a273ef2edd8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:45.245061 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf11838-f768-442f-950f-a273ef2edd8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:45.247743 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf11838-f768-442f-950f-a273ef2edd8d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:45.277145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-7cf11838-f768-442f-950f-a273ef2edd8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:45.277145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:45.277145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:45.277145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:45.277145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:45.277145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:45.277145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:45.277145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:45.277145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:45.277145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:45.277145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:45.277145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:45.277145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:44:45.277145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:44:45.277145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:44:45.278498 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:44:45.278498 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:45.278498 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:45.278498 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:45.278498 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:45.278498 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:45.278498 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:45.278498 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:45.278498 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:45.278498 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:45.278498 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:45.278498 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:45.278498 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:45.278498 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:45.278498 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:45.278498 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:45.278498 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:45.285653 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:44:45.285653 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:44:45.285653 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:45.285653 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:45.285653 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 492/980] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:44:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:45.288511 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cdac4c-ce2f-4b93-8b3d-85a49854f14e None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:45.375869 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:45.454803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cdac4c-ce2f-4b93-8b3d-85a49854f14e None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:45.508196 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711889a9-20e0-4ce7-9463-0a223870724b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:45.509581 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711889a9-20e0-4ce7-9463-0a223870724b None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:45.510032 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711889a9-20e0-4ce7-9463-0a223870724b None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:45.510451 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711889a9-20e0-4ce7-9463-0a223870724b None admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:45.511329 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711889a9-20e0-4ce7-9463-0a223870724b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:45.511793 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711889a9-20e0-4ce7-9463-0a223870724b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:45.513348 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711889a9-20e0-4ce7-9463-0a223870724b None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:45.528968 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c8e86-ea44-4513-962c-1fcbdc793c61 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:45.529362 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c8e86-ea44-4513-962c-1fcbdc793c61 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:45.529521 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c8e86-ea44-4513-962c-1fcbdc793c61 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:45.531242 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 493/981] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:44:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 03:44:45.532406 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 489/982] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:45.541483 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2a117-576b-4eb9-96b0-aa07039b044e None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:45.541851 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2a117-576b-4eb9-96b0-aa07039b044e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:45.542134 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2a117-576b-4eb9-96b0-aa07039b044e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:45.542666 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711889a9-20e0-4ce7-9463-0a223870724b None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:45.562878 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-d6f2a117-576b-4eb9-96b0-aa07039b044e None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:44:45.564122 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d6f2a117-576b-4eb9-96b0-aa07039b044e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:44:45.596724 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:45.644572 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 494/983] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:44:45 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:44:45.669208 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2a117-576b-4eb9-96b0-aa07039b044e None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:45.686892 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711889a9-20e0-4ce7-9463-0a223870724b None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:45.699700 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:45.732663 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ca8e1-4b77-498a-a946-f32252fc8cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:45.734287 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ca8e1-4b77-498a-a946-f32252fc8cfd None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:45.734572 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ca8e1-4b77-498a-a946-f32252fc8cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:45.734845 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ca8e1-4b77-498a-a946-f32252fc8cfd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:45.745263 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ca8e1-4b77-498a-a946-f32252fc8cfd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:45.746889 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ca8e1-4b77-498a-a946-f32252fc8cfd None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:45.763154 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-671ca8e1-4b77-498a-a946-f32252fc8cfd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 01 03:44:45.763154 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:45.763154 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:45.763154 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:45.763154 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:45.763154 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:45.763154 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:45.763154 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:45.763154 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:45.763154 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:45.763154 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:45.763154 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:45.763154 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 03:44:45.763154 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 03:44:45.763154 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 03:44:45.763154 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 03:44:45.769866 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:45.769866 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:45.769866 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 03:44:45.769866 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:44:45.769866 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 03:44:45.769866 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:44:45.769866 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:45.769866 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:45.769866 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:45.769866 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:45.769866 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:45.769866 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:45.769866 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:45.769866 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:45.769866 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:45.769866 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:45.769866 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:45.769866 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:45.770832 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:45.770832 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:45.770832 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 03:44:45.770832 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 03:44:45.770832 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 03:44:45.770832 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 03:44:45.770832 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 03:44:45.770832 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 03:44:45.770832 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 01 03:44:45.770832 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:45.770832 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 490/984] 10.222.0.46 () {56 vars in 1117 bytes} [Fri Jul 1 03:44:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:45.770832 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ca8e1-4b77-498a-a946-f32252fc8cfd None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:45.830693 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2a117-576b-4eb9-96b0-aa07039b044e None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:45.870814 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e4b01-eaa1-4e3b-b7f9-834a84ed57e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:45.871752 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e4b01-eaa1-4e3b-b7f9-834a84ed57e9 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:45.872127 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e4b01-eaa1-4e3b-b7f9-834a84ed57e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:45.872543 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e4b01-eaa1-4e3b-b7f9-834a84ed57e9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:45.873340 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792e4b01-eaa1-4e3b-b7f9-834a84ed57e9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:45.874772 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792e4b01-eaa1-4e3b-b7f9-834a84ed57e9 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:45.888444 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-792e4b01-eaa1-4e3b-b7f9-834a84ed57e9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 03:44:45.888444 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:45.888444 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 03:44:45.888444 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 03:44:45.888444 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 03:44:45.888444 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 03:44:45.888444 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 03:44:45.888444 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:44:45.888444 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 03:44:45.888444 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:45.888444 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 03:44:45.888444 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:45.888444 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:45.888444 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:45.888444 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:45.888444 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:45.888444 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:45.890968 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:45.890968 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:45.890968 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:45.890968 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:45.890968 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:45.890968 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:45.890968 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 03:44:45.890968 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 03:44:45.890968 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 03:44:45.890968 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 03:44:45.890968 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:45.890968 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:45.890968 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:45.890968 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:45.890968 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:45.890968 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:45.893184 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:45.893184 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:45.893184 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:45.893184 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:45.893184 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:45.893184 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:45.893184 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:45.893184 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:45.893184 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:45.893184 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:45.893184 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 03:44:45.893184 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:44:45.893184 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 03:44:45.893184 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:45.893184 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 495/985] 10.222.0.46 () {56 vars in 1126 bytes} [Fri Jul 1 03:44:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:45.896621 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e4b01-eaa1-4e3b-b7f9-834a84ed57e9 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:45.918176 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ca8e1-4b77-498a-a946-f32252fc8cfd None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:45.932699 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:45.971041 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbefada-3b7e-41e1-a100-4f725d96f0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:45.971951 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbefada-3b7e-41e1-a100-4f725d96f0c7 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:45.972238 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbefada-3b7e-41e1-a100-4f725d96f0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:45.972519 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbefada-3b7e-41e1-a100-4f725d96f0c7 None admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:45.973367 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbefada-3b7e-41e1-a100-4f725d96f0c7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:45.973692 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbefada-3b7e-41e1-a100-4f725d96f0c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:45.975238 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbefada-3b7e-41e1-a100-4f725d96f0c7 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:45.998395 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 491/986] 10.222.0.46 () {56 vars in 1149 bytes} [Fri Jul 1 03:44:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:46.005825 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbefada-3b7e-41e1-a100-4f725d96f0c7 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:46.021239 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e4b01-eaa1-4e3b-b7f9-834a84ed57e9 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:46.039791 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:46.062084 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac93c2-46f8-4c64-be85-3a31dc7a6462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:46.063061 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac93c2-46f8-4c64-be85-3a31dc7a6462 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:46.063575 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac93c2-46f8-4c64-be85-3a31dc7a6462 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:46.064027 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac93c2-46f8-4c64-be85-3a31dc7a6462 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:46.065291 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac93c2-46f8-4c64-be85-3a31dc7a6462 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:46.065791 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac93c2-46f8-4c64-be85-3a31dc7a6462 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:46.068332 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac93c2-46f8-4c64-be85-3a31dc7a6462 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:46.078375 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 496/987] 10.222.0.46 () {56 vars in 1122 bytes} [Fri Jul 1 03:44:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:44:46.084012 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac93c2-46f8-4c64-be85-3a31dc7a6462 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:46.147381 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbefada-3b7e-41e1-a100-4f725d96f0c7 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:46.188684 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b851c32-9395-4b5d-9efa-68cab533672b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:46.189347 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b851c32-9395-4b5d-9efa-68cab533672b None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:46.189633 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b851c32-9395-4b5d-9efa-68cab533672b None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:46.189910 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b851c32-9395-4b5d-9efa-68cab533672b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:46.217251 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:46.230681 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac93c2-46f8-4c64-be85-3a31dc7a6462 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:46.269961 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b851c32-9395-4b5d-9efa-68cab533672b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:46.271517 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b851c32-9395-4b5d-9efa-68cab533672b None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:46.292238 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361715d-22fb-4552-93b9-b133f46907d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:46.292951 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361715d-22fb-4552-93b9-b133f46907d2 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:46.293231 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361715d-22fb-4552-93b9-b133f46907d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:46.293519 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361715d-22fb-4552-93b9-b133f46907d2 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:46.294324 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b361715d-22fb-4552-93b9-b133f46907d2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:46.294806 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b361715d-22fb-4552-93b9-b133f46907d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:46.297021 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b361715d-22fb-4552-93b9-b133f46907d2 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:46.302279 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:46.310373 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 497/988] 10.222.0.46 () {56 vars in 1122 bytes} [Fri Jul 1 03:44:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:46.314954 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361715d-22fb-4552-93b9-b133f46907d2 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:46.408359 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 492/989] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:44:46 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 01 03:44:46.416804 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b851c32-9395-4b5d-9efa-68cab533672b None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:46.435276 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361715d-22fb-4552-93b9-b133f46907d2 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:46.492371 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d66eba-6481-4aec-8a0d-5d9d68e6d866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:46.493378 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d66eba-6481-4aec-8a0d-5d9d68e6d866 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:46.493807 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d66eba-6481-4aec-8a0d-5d9d68e6d866 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:46.494226 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d66eba-6481-4aec-8a0d-5d9d68e6d866 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:46.495567 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d66eba-6481-4aec-8a0d-5d9d68e6d866 None admin] RBAC: Adding query filter params (interface=admin, service_id=eb4c8cce4f94460ebbf8cdf3185cb991, region_id=RegionOne) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:46.496053 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d66eba-6481-4aec-8a0d-5d9d68e6d866 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:46.498978 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d66eba-6481-4aec-8a0d-5d9d68e6d866 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:46.512472 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 498/990] 10.222.0.46 () {56 vars in 1249 bytes} [Fri Jul 1 03:44:46 2022] GET /identity/v3/endpoints?service_id=eb4c8cce4f94460ebbf8cdf3185cb991&interface=admin®ion_id=RegionOne => generated 193 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:44:46.517959 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d66eba-6481-4aec-8a0d-5d9d68e6d866 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:46.543524 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b851c32-9395-4b5d-9efa-68cab533672b None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:46.551947 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:46.579045 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:46.589869 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4441a4b9-9621-436a-8db5-812f9382c0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:46.590965 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441a4b9-9621-436a-8db5-812f9382c0f3 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:46.591404 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441a4b9-9621-436a-8db5-812f9382c0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:46.591697 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441a4b9-9621-436a-8db5-812f9382c0f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:46.603209 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4441a4b9-9621-436a-8db5-812f9382c0f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:46.604711 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4441a4b9-9621-436a-8db5-812f9382c0f3 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:46.629120 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-4441a4b9-9621-436a-8db5-812f9382c0f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:46.629120 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:46.629120 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:46.629120 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:46.629120 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:46.629120 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:46.629120 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:46.629120 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:46.629120 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:46.629120 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:46.629120 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:46.629120 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:46.629120 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:44:46.629120 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:44:46.629120 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:44:46.630085 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:44:46.630085 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:46.630085 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:46.630085 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:46.630085 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:46.630085 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:46.630085 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:46.630085 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:46.630085 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:46.630085 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:46.630085 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:46.630085 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:46.630085 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:46.630085 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:46.630085 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:46.630085 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:46.630085 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:46.635747 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:44:46.635747 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:44:46.635747 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:46.635747 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:46.635747 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 493/991] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:44:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:46.636644 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4441a4b9-9621-436a-8db5-812f9382c0f3 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:46.670938 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d66eba-6481-4aec-8a0d-5d9d68e6d866 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:46.726225 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173c27a-81a0-46ea-80bd-212e3533df11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:46.727139 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173c27a-81a0-46ea-80bd-212e3533df11 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:46.727635 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173c27a-81a0-46ea-80bd-212e3533df11 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:46.728385 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173c27a-81a0-46ea-80bd-212e3533df11 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:46.728880 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e173c27a-81a0-46ea-80bd-212e3533df11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:46.731269 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e173c27a-81a0-46ea-80bd-212e3533df11 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:46.744026 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 499/992] 10.222.0.46 () {56 vars in 1087 bytes} [Fri Jul 1 03:44:46 2022] GET /identity/v3/services => generated 1727 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 03:44:46.745956 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8eccb-c0cd-42c2-aed2-8dc295f94121 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:46.746421 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8eccb-c0cd-42c2-aed2-8dc295f94121 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:46.746873 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8eccb-c0cd-42c2-aed2-8dc295f94121 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:46.751777 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 500/993] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:44:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:44:46.756140 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f79fc-46cc-4312-a6a5-7e5380afa0f1 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:46.756492 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f79fc-46cc-4312-a6a5-7e5380afa0f1 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:46.756769 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f79fc-46cc-4312-a6a5-7e5380afa0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:46.777827 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-ef7f79fc-46cc-4312-a6a5-7e5380afa0f1 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:44:46.779147 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ef7f79fc-46cc-4312-a6a5-7e5380afa0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:44:46.796351 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4441a4b9-9621-436a-8db5-812f9382c0f3 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:46.851941 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d34c43-efae-4b00-a693-9f09bd4d933f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:46.853111 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d34c43-efae-4b00-a693-9f09bd4d933f None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:46.853403 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d34c43-efae-4b00-a693-9f09bd4d933f None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:46.853692 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d34c43-efae-4b00-a693-9f09bd4d933f None admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:46.854453 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d34c43-efae-4b00-a693-9f09bd4d933f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:46.854760 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d34c43-efae-4b00-a693-9f09bd4d933f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:46.856250 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d34c43-efae-4b00-a693-9f09bd4d933f None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:46.872048 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 501/994] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:44:46 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 03:44:46.875770 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 494/995] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:46.880689 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f79fc-46cc-4312-a6a5-7e5380afa0f1 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:46.896385 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d34c43-efae-4b00-a693-9f09bd4d933f None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:46.905374 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:46.961284 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:47.017259 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f79fc-46cc-4312-a6a5-7e5380afa0f1 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:47.058538 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed31b86-b832-4ff8-99bb-4368b8e46329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:47.059228 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed31b86-b832-4ff8-99bb-4368b8e46329 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:47.059552 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed31b86-b832-4ff8-99bb-4368b8e46329 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:47.059828 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed31b86-b832-4ff8-99bb-4368b8e46329 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:47.065224 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d34c43-efae-4b00-a693-9f09bd4d933f None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:47.067737 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed31b86-b832-4ff8-99bb-4368b8e46329 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:47.069216 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed31b86-b832-4ff8-99bb-4368b8e46329 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:47.084001 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-eed31b86-b832-4ff8-99bb-4368b8e46329 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:44:47.084001 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:47.084001 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:47.084001 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:47.084001 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:47.084001 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:47.084001 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:47.084001 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:47.084001 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:47.084001 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:47.084001 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:47.084001 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:47.084001 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 03:44:47.084001 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 03:44:47.084001 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 03:44:47.085908 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 03:44:47.085908 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:47.085908 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:47.085908 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:47.085908 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:47.085908 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:47.085908 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:47.085908 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:47.085908 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:47.085908 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:47.085908 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:47.085908 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:47.085908 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:47.085908 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:47.085908 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:47.085908 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:47.085908 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:47.087707 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 03:44:47.087707 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 03:44:47.087707 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 03:44:47.087707 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 03:44:47.087707 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 03:44:47.087707 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 03:44:47.087707 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:44:47.087707 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:47.087707 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 502/996] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:44:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:47.091328 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed31b86-b832-4ff8-99bb-4368b8e46329 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:47.122388 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75656621-99d6-4b70-a5f8-5bae9bb5ba7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:47.124282 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75656621-99d6-4b70-a5f8-5bae9bb5ba7e None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:47.124896 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75656621-99d6-4b70-a5f8-5bae9bb5ba7e None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:47.125297 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75656621-99d6-4b70-a5f8-5bae9bb5ba7e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:47.126265 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75656621-99d6-4b70-a5f8-5bae9bb5ba7e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:47.128323 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75656621-99d6-4b70-a5f8-5bae9bb5ba7e None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:47.143840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-75656621-99d6-4b70-a5f8-5bae9bb5ba7e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 01 03:44:47.143840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:47.143840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 03:44:47.143840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 03:44:47.143840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 03:44:47.143840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 03:44:47.143840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 03:44:47.143840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:44:47.143840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 01 03:44:47.143840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:47.143840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 03:44:47.143840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:47.143840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:47.143840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:47.143840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:47.143840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:47.143840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:47.146241 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:47.146241 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:47.146241 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:47.146241 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:47.146241 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:47.146241 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:47.146241 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 03:44:47.146241 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 03:44:47.146241 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 03:44:47.146241 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 03:44:47.146241 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:47.146241 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:47.146241 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:47.146241 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:47.146241 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:47.146241 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:47.148003 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:47.148003 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:47.148003 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:47.148003 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:47.148003 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:47.148003 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:47.148003 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:47.148003 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:47.148003 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:47.148003 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:47.148003 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 03:44:47.148003 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:44:47.148003 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 01 03:44:47.148003 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:47.148003 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 495/997] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:44:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 03:44:47.153054 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75656621-99d6-4b70-a5f8-5bae9bb5ba7e None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:47.202964 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:47.243818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed31b86-b832-4ff8-99bb-4368b8e46329 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:47.289442 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb92ca-1019-4ded-a594-5685e7e4248f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:47.290226 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb92ca-1019-4ded-a594-5685e7e4248f None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:47.290571 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb92ca-1019-4ded-a594-5685e7e4248f None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:47.290853 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb92ca-1019-4ded-a594-5685e7e4248f None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:47.291916 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fb92ca-1019-4ded-a594-5685e7e4248f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:47.292378 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fb92ca-1019-4ded-a594-5685e7e4248f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:47.294203 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fb92ca-1019-4ded-a594-5685e7e4248f None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:47.309092 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75656621-99d6-4b70-a5f8-5bae9bb5ba7e None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:47.312003 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:47.312532 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 503/998] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 1 03:44:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:44:47.320818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb92ca-1019-4ded-a594-5685e7e4248f None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:47.364642 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d3b69-8af5-4dde-b95b-93cbdea2447d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:47.365622 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d3b69-8af5-4dde-b95b-93cbdea2447d None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:47.366049 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d3b69-8af5-4dde-b95b-93cbdea2447d None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:47.366486 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d3b69-8af5-4dde-b95b-93cbdea2447d None admin] PATH_INFO: `/v3/services` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:47.367194 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d3b69-8af5-4dde-b95b-93cbdea2447d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:47.367534 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d3b69-8af5-4dde-b95b-93cbdea2447d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:47.368921 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d3b69-8af5-4dde-b95b-93cbdea2447d None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:47.379836 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 496/999] 10.222.0.46 () {56 vars in 1112 bytes} [Fri Jul 1 03:44:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:47.381037 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d3b69-8af5-4dde-b95b-93cbdea2447d None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:47.469068 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb92ca-1019-4ded-a594-5685e7e4248f None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:47.522838 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb9c8a-8bdb-4b62-bfdb-c75c18074b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:47.524160 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb9c8a-8bdb-4b62-bfdb-c75c18074b10 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:47.524484 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb9c8a-8bdb-4b62-bfdb-c75c18074b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:47.524929 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb9c8a-8bdb-4b62-bfdb-c75c18074b10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:47.526672 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fb9c8a-8bdb-4b62-bfdb-c75c18074b10 None admin] RBAC: Adding query filter params (role.id=43eeddda303844f3850a6e55a673a34f, scope.project.id=da83db15a312499fb627691ae442f233, user.id=dd41221abea04808bed5ef4ac4528c62) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:47.527309 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fb9c8a-8bdb-4b62-bfdb-c75c18074b10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:47.530720 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fb9c8a-8bdb-4b62-bfdb-c75c18074b10 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:47.531292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d3b69-8af5-4dde-b95b-93cbdea2447d None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:47.536855 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:47.551497 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 504/1000] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:44:47 2022] GET /identity/v3/role_assignments?user.id=dd41221abea04808bed5ef4ac4528c62&scope.project.id=da83db15a312499fb627691ae442f233&role.id=43eeddda303844f3850a6e55a673a34f => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:47.583982 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987eb43-f76f-4c38-9b25-17da6d3e7b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:47.584699 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987eb43-f76f-4c38-9b25-17da6d3e7b26 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:47.585075 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987eb43-f76f-4c38-9b25-17da6d3e7b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:47.585416 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987eb43-f76f-4c38-9b25-17da6d3e7b26 None admin] PATH_INFO: `/v3/services` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:47.586268 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1987eb43-f76f-4c38-9b25-17da6d3e7b26 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:47.586642 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1987eb43-f76f-4c38-9b25-17da6d3e7b26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:47.588186 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1987eb43-f76f-4c38-9b25-17da6d3e7b26 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:47.599683 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 497/1001] 10.222.0.46 () {56 vars in 1112 bytes} [Fri Jul 1 03:44:47 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:47.604919 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb9c8a-8bdb-4b62-bfdb-c75c18074b10 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:47.737080 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb9c8a-8bdb-4b62-bfdb-c75c18074b10 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:47.790029 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e5093e-2416-4d1d-a42e-4d5c57529d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:47.790769 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5093e-2416-4d1d-a42e-4d5c57529d29 None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:47.791030 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5093e-2416-4d1d-a42e-4d5c57529d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:47.791364 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5093e-2416-4d1d-a42e-4d5c57529d29 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:47.793204 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e5093e-2416-4d1d-a42e-4d5c57529d29 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:47.794060 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e5093e-2416-4d1d-a42e-4d5c57529d29 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:47.936415 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 505/1002] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 1 03:44:47 2022] POST /identity/v3/endpoints => generated 334 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 03:44:48.931681 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b7804-b10b-4b7c-af8b-3c201adfb662 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:48.932181 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b7804-b10b-4b7c-af8b-3c201adfb662 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:48.932181 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b7804-b10b-4b7c-af8b-3c201adfb662 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:48.933659 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 498/1003] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:44:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:44:48.939522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140dc89-4b07-43d6-9e4c-286c2c47337d None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:48.940042 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140dc89-4b07-43d6-9e4c-286c2c47337d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:48.940042 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140dc89-4b07-43d6-9e4c-286c2c47337d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:48.958547 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-1140dc89-4b07-43d6-9e4c-286c2c47337d None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:44:48.959769 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1140dc89-4b07-43d6-9e4c-286c2c47337d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:44:49.012855 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:49.036593 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 506/1004] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:44:48 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:44:49.060299 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b7804-b10b-4b7c-af8b-3c201adfb662 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:49.096543 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:49.198136 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b7804-b10b-4b7c-af8b-3c201adfb662 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:49.236638 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f61c49-6b3f-4e01-8da6-15a6decc6573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:49.237451 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f61c49-6b3f-4e01-8da6-15a6decc6573 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:49.237729 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f61c49-6b3f-4e01-8da6-15a6decc6573 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:49.238003 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f61c49-6b3f-4e01-8da6-15a6decc6573 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:49.238672 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f61c49-6b3f-4e01-8da6-15a6decc6573 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:49.240086 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f61c49-6b3f-4e01-8da6-15a6decc6573 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:49.252976 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-a2f61c49-6b3f-4e01-8da6-15a6decc6573 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 03:44:49.252976 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:49.252976 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 03:44:49.252976 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 03:44:49.252976 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 03:44:49.252976 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 03:44:49.252976 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 03:44:49.252976 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:44:49.252976 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 03:44:49.252976 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:49.252976 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 03:44:49.252976 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:49.252976 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:49.252976 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:49.252976 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:49.252976 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:49.252976 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:49.254078 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:49.254078 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:49.254078 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:49.254078 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:49.254078 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:49.254078 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:49.254078 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 03:44:49.254078 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 03:44:49.254078 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 03:44:49.254078 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 03:44:49.254078 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:49.254078 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:49.254078 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:49.254078 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:49.254078 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:49.254078 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:49.255055 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:49.255055 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:49.255055 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:49.255055 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:49.255055 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:49.255055 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:49.255055 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:49.255055 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:49.255055 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:49.255055 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:49.255055 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 03:44:49.255055 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:44:49.255055 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 03:44:49.255055 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:49.262729 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 499/1005] 10.222.0.46 () {56 vars in 1126 bytes} [Fri Jul 1 03:44:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:49.262932 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1140dc89-4b07-43d6-9e4c-286c2c47337d None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:49.376080 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1140dc89-4b07-43d6-9e4c-286c2c47337d None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:49.415766 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a35ed1-3cc1-484b-a3c5-be965b1e4450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:49.416442 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a35ed1-3cc1-484b-a3c5-be965b1e4450 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:49.416725 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a35ed1-3cc1-484b-a3c5-be965b1e4450 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:49.417000 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a35ed1-3cc1-484b-a3c5-be965b1e4450 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:49.417706 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a35ed1-3cc1-484b-a3c5-be965b1e4450 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:49.418010 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a35ed1-3cc1-484b-a3c5-be965b1e4450 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:49.419386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a35ed1-3cc1-484b-a3c5-be965b1e4450 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:49.424860 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 507/1006] 10.222.0.46 () {56 vars in 1122 bytes} [Fri Jul 1 03:44:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:49.430971 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f61c49-6b3f-4e01-8da6-15a6decc6573 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:49.556353 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:49.563443 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f61c49-6b3f-4e01-8da6-15a6decc6573 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:49.597755 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b077e1f-d616-4283-8144-eef0155b9d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:49.598423 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b077e1f-d616-4283-8144-eef0155b9d62 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:49.598700 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b077e1f-d616-4283-8144-eef0155b9d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:49.598970 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b077e1f-d616-4283-8144-eef0155b9d62 None admin] PATH_INFO: `/v3/services` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:49.599834 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b077e1f-d616-4283-8144-eef0155b9d62 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:49.600562 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b077e1f-d616-4283-8144-eef0155b9d62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:49.602764 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b077e1f-d616-4283-8144-eef0155b9d62 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:49.612613 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 500/1007] 10.222.0.46 () {56 vars in 1122 bytes} [Fri Jul 1 03:44:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:44:49.613900 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a35ed1-3cc1-484b-a3c5-be965b1e4450 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:49.665430 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:49.706548 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f569c5-4013-4cff-8f40-217ef18703d2 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:49.707205 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f569c5-4013-4cff-8f40-217ef18703d2 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:49.707885 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f569c5-4013-4cff-8f40-217ef18703d2 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:49.710370 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 501/1008] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:44:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:44:49.719624 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8956607-b797-48a7-91d0-0f1fbf03a8bf None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:49.720115 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8956607-b797-48a7-91d0-0f1fbf03a8bf None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:49.720600 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8956607-b797-48a7-91d0-0f1fbf03a8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:49.724155 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a35ed1-3cc1-484b-a3c5-be965b1e4450 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:49.746335 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-e8956607-b797-48a7-91d0-0f1fbf03a8bf None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:44:49.747605 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-e8956607-b797-48a7-91d0-0f1fbf03a8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:44:49.768518 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ec100-2221-43c3-8248-39df130df085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:49.769086 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ec100-2221-43c3-8248-39df130df085 None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:49.769419 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ec100-2221-43c3-8248-39df130df085 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:49.769658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ec100-2221-43c3-8248-39df130df085 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:49.770376 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ec100-2221-43c3-8248-39df130df085 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:49.771781 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ec100-2221-43c3-8248-39df130df085 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:49.827000 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 502/1009] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:44:49 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 03:44:49.851329 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 508/1010] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 1 03:44:49 2022] POST /identity/v3/endpoints => generated 325 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 03:44:49.851585 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8956607-b797-48a7-91d0-0f1fbf03a8bf None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:49.995813 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:50.016248 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8956607-b797-48a7-91d0-0f1fbf03a8bf None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:50.083554 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b88cf-cd68-459b-b707-044b72b8a702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:50.083554 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b88cf-cd68-459b-b707-044b72b8a702 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:50.083554 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b88cf-cd68-459b-b707-044b72b8a702 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:50.083554 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b88cf-cd68-459b-b707-044b72b8a702 None admin] PATH_INFO: `/v3/services/image` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:50.083940 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b88cf-cd68-459b-b707-044b72b8a702 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:50.085025 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b88cf-cd68-459b-b707-044b72b8a702 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:50.098197 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-137b88cf-cd68-459b-b707-044b72b8a702 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 01 03:44:50.098197 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:50.098197 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 03:44:50.098197 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 03:44:50.098197 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 03:44:50.098197 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 03:44:50.098197 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 03:44:50.098197 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:44:50.098197 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 01 03:44:50.098197 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:50.098197 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 03:44:50.098197 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:50.098197 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:50.098197 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:50.098197 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:50.098197 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:50.098197 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:50.099274 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:50.099274 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:50.099274 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:50.099274 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:50.099274 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:50.099274 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:50.099274 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 03:44:50.099274 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 03:44:50.099274 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 03:44:50.099274 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 03:44:50.099274 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:50.099274 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:50.099274 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:50.099274 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:50.099274 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:50.099274 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:50.100194 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:50.100194 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:50.100194 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:50.100194 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:50.100194 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:50.100194 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:50.100194 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:50.100194 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:50.100194 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:50.100194 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:50.100194 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 03:44:50.100194 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:44:50.100194 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 01 03:44:50.100194 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:50.101345 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 503/1011] 10.222.0.46 () {56 vars in 1105 bytes} [Fri Jul 1 03:44:49 2022] GET /identity/v3/services/image => generated 86 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:50.109803 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ec100-2221-43c3-8248-39df130df085 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:50.131183 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ec94f-4b6b-41ae-b93b-d27a465d33a5 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:50.131497 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ec94f-4b6b-41ae-b93b-d27a465d33a5 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:50.131766 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ec94f-4b6b-41ae-b93b-d27a465d33a5 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:50.133132 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 504/1012] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:44:50.138375 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a1fca-4425-476c-a9fa-514ce212b752 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:50.139214 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a1fca-4425-476c-a9fa-514ce212b752 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:50.139532 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a1fca-4425-476c-a9fa-514ce212b752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:50.157488 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-274a1fca-4425-476c-a9fa-514ce212b752 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:44:50.158673 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-274a1fca-4425-476c-a9fa-514ce212b752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:44:50.235759 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 505/1013] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:44:50 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 03:44:50.259567 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a1fca-4425-476c-a9fa-514ce212b752 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:50.283211 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ec100-2221-43c3-8248-39df130df085 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:50.291537 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:50.318776 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd65273-67bc-4650-aa9b-b0b278d79f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:50.319656 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd65273-67bc-4650-aa9b-b0b278d79f76 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:50.319863 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd65273-67bc-4650-aa9b-b0b278d79f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:50.320116 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd65273-67bc-4650-aa9b-b0b278d79f76 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:50.320826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd65273-67bc-4650-aa9b-b0b278d79f76 None admin] RBAC: Adding query filter params (name=image) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:50.321132 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd65273-67bc-4650-aa9b-b0b278d79f76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:50.322524 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd65273-67bc-4650-aa9b-b0b278d79f76 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:50.328534 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 509/1014] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:44:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:50.337573 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd65273-67bc-4650-aa9b-b0b278d79f76 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:50.385914 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:50.417087 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a1fca-4425-476c-a9fa-514ce212b752 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:50.464478 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd65273-67bc-4650-aa9b-b0b278d79f76 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:50.481260 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc7a5d-3061-435d-89ba-1f4dde787755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:50.482092 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc7a5d-3061-435d-89ba-1f4dde787755 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:50.483000 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc7a5d-3061-435d-89ba-1f4dde787755 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:50.483155 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc7a5d-3061-435d-89ba-1f4dde787755 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:50.499045 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc7a5d-3061-435d-89ba-1f4dde787755 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:44:50.507439 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-6cbc7a5d-3061-435d-89ba-1f4dde787755 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 01 03:44:50.507439 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:50.507439 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:50.507439 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:50.507439 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:50.507439 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:50.507439 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:50.507439 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:50.507439 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:50.507439 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:50.507439 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:50.507439 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:50.507439 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:44:50.507439 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:44:50.507439 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:44:50.507439 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:44:50.509178 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:44:50.509178 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:44:50.509178 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:44:50.509178 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:44:50.509178 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:50.509178 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:50.509178 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:50.509178 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:50.509178 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:50.509178 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:50.509178 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:50.509178 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:50.509178 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:50.509178 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:50.509178 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:50.509178 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:50.511371 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:50.511371 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:50.511371 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:50.511371 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:50.511371 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:44:50.511371 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:44:50.511371 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:44:50.511371 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:44:50.511371 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:44:50.511371 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:44:50.511371 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 01 03:44:50.511371 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:50.512632 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76793315-b332-432c-9d52-6c6f81c5a534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:50.512632 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76793315-b332-432c-9d52-6c6f81c5a534 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:50.512632 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76793315-b332-432c-9d52-6c6f81c5a534 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:50.512632 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76793315-b332-432c-9d52-6c6f81c5a534 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:50.513116 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76793315-b332-432c-9d52-6c6f81c5a534 None admin] RBAC: Adding query filter params (type=image) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:50.513116 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76793315-b332-432c-9d52-6c6f81c5a534 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:50.514136 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 506/1015] 10.222.0.46 () {56 vars in 1120 bytes} [Fri Jul 1 03:44:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 03:44:50.514924 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc7a5d-3061-435d-89ba-1f4dde787755 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:50.517758 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76793315-b332-432c-9d52-6c6f81c5a534 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:50.526113 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 510/1016] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:44:50 2022] GET /identity/v3/services?type=image => generated 122 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:44:50.628298 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc7a5d-3061-435d-89ba-1f4dde787755 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:50.664894 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb610bd0-0a8e-40d3-9429-c84739fa63af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:50.665577 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb610bd0-0a8e-40d3-9429-c84739fa63af None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:50.665860 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb610bd0-0a8e-40d3-9429-c84739fa63af None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:50.666136 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb610bd0-0a8e-40d3-9429-c84739fa63af None admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:50.666891 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb610bd0-0a8e-40d3-9429-c84739fa63af None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:50.667200 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb610bd0-0a8e-40d3-9429-c84739fa63af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:50.668637 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb610bd0-0a8e-40d3-9429-c84739fa63af None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:50.675379 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:50.685069 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 507/1017] 10.222.0.46 () {56 vars in 1115 bytes} [Fri Jul 1 03:44:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:50.691807 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76793315-b332-432c-9d52-6c6f81c5a534 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:50.728751 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:50.828251 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76793315-b332-432c-9d52-6c6f81c5a534 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:50.877726 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27912470-617a-466d-a70a-f27cbb3eb752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:50.878612 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27912470-617a-466d-a70a-f27cbb3eb752 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:50.878831 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27912470-617a-466d-a70a-f27cbb3eb752 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:50.879113 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27912470-617a-466d-a70a-f27cbb3eb752 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:50.893131 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27912470-617a-466d-a70a-f27cbb3eb752 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:50.894629 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27912470-617a-466d-a70a-f27cbb3eb752 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:50.913876 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-27912470-617a-466d-a70a-f27cbb3eb752 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:50.913876 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:50.913876 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:50.913876 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:50.913876 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:50.913876 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:50.913876 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:50.913876 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:50.913876 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:50.913876 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:50.913876 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:50.913876 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:50.913876 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:44:50.913876 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:44:50.913876 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:44:50.914990 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:44:50.914990 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:50.914990 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:50.914990 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:50.914990 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:50.914990 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:50.914990 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:50.914990 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:50.914990 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:50.914990 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:50.914990 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:50.914990 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:50.914990 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:50.914990 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:50.914990 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:50.914990 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:50.914990 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:50.922818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:44:50.922818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:44:50.922818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:50.922818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:50.922818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 511/1018] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:44:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:50.923105 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb610bd0-0a8e-40d3-9429-c84739fa63af None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:51.055273 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb610bd0-0a8e-40d3-9429-c84739fa63af None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:51.119893 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff17b6c-d342-4544-a792-f79dc40829ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:51.121048 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff17b6c-d342-4544-a792-f79dc40829ac None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:51.121553 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff17b6c-d342-4544-a792-f79dc40829ac None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:51.122054 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff17b6c-d342-4544-a792-f79dc40829ac None admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:51.123351 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff17b6c-d342-4544-a792-f79dc40829ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:51.123947 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff17b6c-d342-4544-a792-f79dc40829ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:51.125967 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff17b6c-d342-4544-a792-f79dc40829ac None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:51.147314 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 508/1019] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:44:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:51.156430 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27912470-617a-466d-a70a-f27cbb3eb752 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:51.299962 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:51.326744 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27912470-617a-466d-a70a-f27cbb3eb752 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:51.383167 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045551e-fff7-455c-9d32-6a48576daf00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:51.384014 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045551e-fff7-455c-9d32-6a48576daf00 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:51.384306 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045551e-fff7-455c-9d32-6a48576daf00 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:51.384649 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045551e-fff7-455c-9d32-6a48576daf00 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:51.395794 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045551e-fff7-455c-9d32-6a48576daf00 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:51.397259 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045551e-fff7-455c-9d32-6a48576daf00 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:51.413166 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-d045551e-fff7-455c-9d32-6a48576daf00 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 01 03:44:51.413166 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:51.413166 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:51.413166 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:51.413166 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:51.413166 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:51.413166 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:51.413166 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:51.413166 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:51.413166 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:51.413166 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:51.413166 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:51.413166 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 03:44:51.413166 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 03:44:51.413166 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 03:44:51.413166 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 03:44:51.414456 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:51.414456 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:51.414456 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 03:44:51.414456 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:44:51.414456 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 03:44:51.414456 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:44:51.414456 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:51.414456 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:51.414456 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:51.414456 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:51.414456 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:51.414456 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:51.414456 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:51.414456 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:51.414456 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:51.414456 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:51.414456 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:51.414456 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:51.416166 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:51.416166 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:51.416166 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 03:44:51.416166 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 03:44:51.416166 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 03:44:51.416166 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 03:44:51.416166 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 03:44:51.416166 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 03:44:51.416166 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 01 03:44:51.416166 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:51.419913 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 512/1020] 10.222.0.46 () {56 vars in 1093 bytes} [Fri Jul 1 03:44:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:51.421180 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff17b6c-d342-4544-a792-f79dc40829ac None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:51.492042 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:51.551978 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff17b6c-d342-4544-a792-f79dc40829ac None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:51.620178 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47873853-f9ca-4687-a6bf-003d13d60025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:51.621420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47873853-f9ca-4687-a6bf-003d13d60025 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:51.621922 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47873853-f9ca-4687-a6bf-003d13d60025 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:51.622427 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47873853-f9ca-4687-a6bf-003d13d60025 None admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:51.624369 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47873853-f9ca-4687-a6bf-003d13d60025 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:51.624941 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47873853-f9ca-4687-a6bf-003d13d60025 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:51.627811 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47873853-f9ca-4687-a6bf-003d13d60025 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:51.669095 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 509/1021] 10.222.0.46 () {56 vars in 1133 bytes} [Fri Jul 1 03:44:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:51.672018 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045551e-fff7-455c-9d32-6a48576daf00 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:51.814306 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045551e-fff7-455c-9d32-6a48576daf00 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:51.856183 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59bd249-81c2-492c-a32f-2c25f9c446a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:51.856934 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59bd249-81c2-492c-a32f-2c25f9c446a5 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:51.857276 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59bd249-81c2-492c-a32f-2c25f9c446a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:51.858046 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59bd249-81c2-492c-a32f-2c25f9c446a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:51.876997 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:51.939066 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59bd249-81c2-492c-a32f-2c25f9c446a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:51.941152 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59bd249-81c2-492c-a32f-2c25f9c446a5 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:52.082074 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 513/1022] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:44:51 2022] GET /identity/v3/auth/tokens => generated 1863 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 03:44:52.088202 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47873853-f9ca-4687-a6bf-003d13d60025 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:52.223708 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47873853-f9ca-4687-a6bf-003d13d60025 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:52.244624 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:52.264562 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c14f52a-46ba-4363-928b-454351715760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:52.265471 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14f52a-46ba-4363-928b-454351715760 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:52.265802 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14f52a-46ba-4363-928b-454351715760 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:52.266055 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14f52a-46ba-4363-928b-454351715760 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:52.278701 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c14f52a-46ba-4363-928b-454351715760 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:52.280815 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c14f52a-46ba-4363-928b-454351715760 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:52.299713 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a662b7e-ab75-48c5-85a1-92aee7c4f407 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:52.300226 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a662b7e-ab75-48c5-85a1-92aee7c4f407 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:52.300656 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a662b7e-ab75-48c5-85a1-92aee7c4f407 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:52.300876 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-4c14f52a-46ba-4363-928b-454351715760 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:52.300876 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:52.300876 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:52.300876 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:52.300876 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:52.300876 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:52.300876 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:52.300876 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:52.300876 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:52.300876 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:52.300876 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:52.300876 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:52.300876 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:44:52.300876 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:44:52.300876 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:44:52.301716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:44:52.301716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:52.301716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:52.301716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:52.301716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:52.301716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:52.301716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:52.301716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:52.301716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:52.301716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:52.301716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:52.301716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:52.301716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:52.301716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:52.301716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:52.301716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:52.301716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:52.302596 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:44:52.302596 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:44:52.302596 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:52.302596 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:52.303335 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 510/1023] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:44:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:52.304572 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 514/1024] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:44:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:44:52.308859 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab9241-fc93-43e8-a4ae-e2cadd3a39a9 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:52.309031 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a662b7e-ab75-48c5-85a1-92aee7c4f407 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:52.309214 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab9241-fc93-43e8-a4ae-e2cadd3a39a9 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:52.309417 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab9241-fc93-43e8-a4ae-e2cadd3a39a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:52.327410 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-1fab9241-fc93-43e8-a4ae-e2cadd3a39a9 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:44:52.328620 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-1fab9241-fc93-43e8-a4ae-e2cadd3a39a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:44:52.382090 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:52.432596 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 511/1025] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:44:52 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 03:44:52.440304 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a662b7e-ab75-48c5-85a1-92aee7c4f407 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:52.474767 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab9241-fc93-43e8-a4ae-e2cadd3a39a9 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:52.475148 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c8a11-3484-4de1-89bd-8b9f77db4225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:52.475858 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c8a11-3484-4de1-89bd-8b9f77db4225 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:52.476140 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c8a11-3484-4de1-89bd-8b9f77db4225 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:52.476415 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c8a11-3484-4de1-89bd-8b9f77db4225 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:52.477139 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c8a11-3484-4de1-89bd-8b9f77db4225 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:52.477444 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c8a11-3484-4de1-89bd-8b9f77db4225 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:52.478884 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c8a11-3484-4de1-89bd-8b9f77db4225 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:52.495522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 515/1026] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:52.497611 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c8a11-3484-4de1-89bd-8b9f77db4225 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:52.606931 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c8a11-3484-4de1-89bd-8b9f77db4225 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:52.618541 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:52.634882 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:52.652090 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab9241-fc93-43e8-a4ae-e2cadd3a39a9 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:52.662366 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdff69b-3eab-4492-bdfa-6c56bd7fc661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:52.663180 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdff69b-3eab-4492-bdfa-6c56bd7fc661 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:52.663491 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdff69b-3eab-4492-bdfa-6c56bd7fc661 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:52.663935 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdff69b-3eab-4492-bdfa-6c56bd7fc661 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:52.672528 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdff69b-3eab-4492-bdfa-6c56bd7fc661 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:52.675735 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdff69b-3eab-4492-bdfa-6c56bd7fc661 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:52.681804 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6dd898-afda-4ca2-ae56-36ce7b2b17fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:52.682613 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dd898-afda-4ca2-ae56-36ce7b2b17fc None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:52.682900 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dd898-afda-4ca2-ae56-36ce7b2b17fc None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:52.683172 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dd898-afda-4ca2-ae56-36ce7b2b17fc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:52.688221 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6dd898-afda-4ca2-ae56-36ce7b2b17fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:52.688221 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6dd898-afda-4ca2-ae56-36ce7b2b17fc None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:52.688803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 512/1027] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:44:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:52.697436 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6dd898-afda-4ca2-ae56-36ce7b2b17fc None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:52.699380 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-5cdff69b-3eab-4492-bdfa-6c56bd7fc661 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:44:52.699380 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:52.699380 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:52.699380 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:52.699380 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:52.699380 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:52.699380 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:52.699380 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:52.699380 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:52.699380 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:52.699380 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:52.699380 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:52.699380 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 03:44:52.699380 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 03:44:52.699380 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 03:44:52.700581 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 03:44:52.700581 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:52.700581 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:52.700581 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:52.700581 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:52.700581 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:52.700581 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:52.700581 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:52.700581 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:52.700581 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:52.700581 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:52.700581 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:52.700581 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:52.700581 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:52.700581 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:52.700581 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:52.700581 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:52.702525 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 03:44:52.702525 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 03:44:52.702525 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 03:44:52.702525 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 03:44:52.702525 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 03:44:52.702525 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 03:44:52.702525 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:44:52.702525 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:52.705893 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 516/1028] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:44:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 03:44:52.706997 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdff69b-3eab-4492-bdfa-6c56bd7fc661 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:52.813571 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdff69b-3eab-4492-bdfa-6c56bd7fc661 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:52.827221 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6dd898-afda-4ca2-ae56-36ce7b2b17fc None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:52.848652 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a6f05a-755b-4a83-98a2-bfff671ec7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:52.849331 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a6f05a-755b-4a83-98a2-bfff671ec7f1 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:52.849616 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a6f05a-755b-4a83-98a2-bfff671ec7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:52.849886 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a6f05a-755b-4a83-98a2-bfff671ec7f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:52.850675 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a6f05a-755b-4a83-98a2-bfff671ec7f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:52.850997 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a6f05a-755b-4a83-98a2-bfff671ec7f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:52.852481 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a6f05a-755b-4a83-98a2-bfff671ec7f1 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:52.862448 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580661b-9ecd-4919-bd9f-a946a2152c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:52.863123 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580661b-9ecd-4919-bd9f-a946a2152c9e None admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:52.863407 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580661b-9ecd-4919-bd9f-a946a2152c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:52.863717 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580661b-9ecd-4919-bd9f-a946a2152c9e None admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:52.864446 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e580661b-9ecd-4919-bd9f-a946a2152c9e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:52.865025 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 517/1029] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 1 03:44:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:44:52.871036 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e580661b-9ecd-4919-bd9f-a946a2152c9e None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:52.871183 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84222541-954f-439d-a180-edd801605160 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:52.871183 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84222541-954f-439d-a180-edd801605160 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:52.871183 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84222541-954f-439d-a180-edd801605160 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:52.871183 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 518/1030] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:44:52.873880 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84222541-954f-439d-a180-edd801605160 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:52.901615 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:52.962064 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 513/1031] 10.222.0.46 () {60 vars in 1141 bytes} [Fri Jul 1 03:44:52 2022] POST /identity/v3/projects => generated 311 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 03:44:52.963673 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf57af8-ab25-4080-926d-3588b1f891f8 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:52.963984 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf57af8-ab25-4080-926d-3588b1f891f8 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:52.964225 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf57af8-ab25-4080-926d-3588b1f891f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:52.984253 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-bdf57af8-ab25-4080-926d-3588b1f891f8 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:44:52.985480 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-bdf57af8-ab25-4080-926d-3588b1f891f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:44:52.995256 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84222541-954f-439d-a180-edd801605160 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:53.003061 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:53.040161 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2bb9fc-21ae-4998-a51b-8f53d04622a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:53.040923 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bb9fc-21ae-4998-a51b-8f53d04622a9 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:53.041204 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bb9fc-21ae-4998-a51b-8f53d04622a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:53.041472 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bb9fc-21ae-4998-a51b-8f53d04622a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:53.042326 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2bb9fc-21ae-4998-a51b-8f53d04622a9 None admin] RBAC: Adding query filter params (role.id=43eeddda303844f3850a6e55a673a34f, scope.project.id=da83db15a312499fb627691ae442f233, user.id=2da466ad31d344898f5c838f77d45181) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:53.042767 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2bb9fc-21ae-4998-a51b-8f53d04622a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:53.044404 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2bb9fc-21ae-4998-a51b-8f53d04622a9 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:53.051627 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 519/1032] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:44:52 2022] GET /identity/v3/role_assignments?user.id=2da466ad31d344898f5c838f77d45181&scope.project.id=da83db15a312499fb627691ae442f233&role.id=43eeddda303844f3850a6e55a673a34f => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:53.080823 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 514/1033] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:44:52 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:44:53.105985 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2bb9fc-21ae-4998-a51b-8f53d04622a9 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:53.240881 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:53.251728 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2bb9fc-21ae-4998-a51b-8f53d04622a9 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:53.289154 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d07da-0592-4d0d-b762-93ff2d1fd7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:53.289827 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d07da-0592-4d0d-b762-93ff2d1fd7ab None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:53.290109 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d07da-0592-4d0d-b762-93ff2d1fd7ab None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:53.290378 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d07da-0592-4d0d-b762-93ff2d1fd7ab None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:53.291491 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d07da-0592-4d0d-b762-93ff2d1fd7ab None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:53.293476 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d07da-0592-4d0d-b762-93ff2d1fd7ab None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:53.370736 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 520/1034] 10.222.0.46 () {60 vars in 1141 bytes} [Fri Jul 1 03:44:53 2022] POST /identity/v3/services => generated 242 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 03:44:55.165485 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797c8aa-2cab-4657-bafc-a254e98ee02c None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:55.166138 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797c8aa-2cab-4657-bafc-a254e98ee02c None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:55.166138 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797c8aa-2cab-4657-bafc-a254e98ee02c None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:55.167598 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 515/1035] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:44:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:44:55.173008 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e9ac3-d580-43ad-b356-0827f4e0f2b1 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:55.173467 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e9ac3-d580-43ad-b356-0827f4e0f2b1 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:55.173543 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e9ac3-d580-43ad-b356-0827f4e0f2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:55.196150 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-aa4e9ac3-d580-43ad-b356-0827f4e0f2b1 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:44:55.197572 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-aa4e9ac3-d580-43ad-b356-0827f4e0f2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:44:55.311929 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 521/1036] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:44:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:44:55.353305 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b797c8aa-2cab-4657-bafc-a254e98ee02c None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:55.516850 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b797c8aa-2cab-4657-bafc-a254e98ee02c None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:55.573913 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83495bb-bce3-4f2f-bdc6-17272353a64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:55.575357 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83495bb-bce3-4f2f-bdc6-17272353a64c None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:55.576421 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83495bb-bce3-4f2f-bdc6-17272353a64c None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:55.576894 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83495bb-bce3-4f2f-bdc6-17272353a64c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:55.595384 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83495bb-bce3-4f2f-bdc6-17272353a64c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:44:55.611308 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-e83495bb-bce3-4f2f-bdc6-17272353a64c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 01 03:44:55.611308 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:55.611308 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:55.611308 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:55.611308 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:55.611308 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:55.611308 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:55.611308 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:55.611308 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:55.611308 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:55.611308 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:55.611308 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:55.611308 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:44:55.611308 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:44:55.611308 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:44:55.611308 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:44:55.612497 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:44:55.612497 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:44:55.612497 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:44:55.612497 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:44:55.612497 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:55.612497 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:55.612497 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:55.612497 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:55.612497 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:55.612497 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:55.612497 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:55.612497 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:55.612497 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:55.612497 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:55.612497 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:55.612497 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:55.613799 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:55.613799 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:55.613799 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:55.613799 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:55.613799 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:44:55.613799 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:44:55.613799 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:44:55.613799 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:44:55.613799 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:44:55.613799 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:44:55.613799 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 01 03:44:55.613799 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:55.613799 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 516/1037] 10.222.0.46 () {56 vars in 1120 bytes} [Fri Jul 1 03:44:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 03:44:55.621659 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e9ac3-d580-43ad-b356-0827f4e0f2b1 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:55.721652 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:55.752922 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e9ac3-d580-43ad-b356-0827f4e0f2b1 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:55.783316 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293de9ed-6f8d-4678-9ecb-69602bc914e1 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:55.783771 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293de9ed-6f8d-4678-9ecb-69602bc914e1 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:55.783925 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293de9ed-6f8d-4678-9ecb-69602bc914e1 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:55.785598 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 517/1038] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:44:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 03:44:55.791796 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842726bd-e7a0-4820-9b8b-21c762b964b1 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:55.792304 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842726bd-e7a0-4820-9b8b-21c762b964b1 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:55.792807 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842726bd-e7a0-4820-9b8b-21c762b964b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:55.800513 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25310ffb-dc09-467c-ab09-91f8d6b81d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:55.801444 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25310ffb-dc09-467c-ab09-91f8d6b81d01 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:55.801871 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25310ffb-dc09-467c-ab09-91f8d6b81d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:55.802288 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25310ffb-dc09-467c-ab09-91f8d6b81d01 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:55.803218 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25310ffb-dc09-467c-ab09-91f8d6b81d01 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:55.803565 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25310ffb-dc09-467c-ab09-91f8d6b81d01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:55.804961 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25310ffb-dc09-467c-ab09-91f8d6b81d01 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:55.814962 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-842726bd-e7a0-4820-9b8b-21c762b964b1 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:44:55.815841 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 522/1039] 10.222.0.46 () {56 vars in 1115 bytes} [Fri Jul 1 03:44:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:44:55.816232 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-842726bd-e7a0-4820-9b8b-21c762b964b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:44:55.820504 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25310ffb-dc09-467c-ab09-91f8d6b81d01 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:55.821166 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:55.899897 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 518/1040] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:44:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:44:55.920520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842726bd-e7a0-4820-9b8b-21c762b964b1 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:55.973318 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25310ffb-dc09-467c-ab09-91f8d6b81d01 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:56.019547 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2ea3a-2c50-4cac-ba7b-062b47da574d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:56.020671 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2ea3a-2c50-4cac-ba7b-062b47da574d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:56.021168 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2ea3a-2c50-4cac-ba7b-062b47da574d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:56.021651 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2ea3a-2c50-4cac-ba7b-062b47da574d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:56.031341 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:56.035881 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2ea3a-2c50-4cac-ba7b-062b47da574d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:56.037274 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2ea3a-2c50-4cac-ba7b-062b47da574d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:56.056850 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842726bd-e7a0-4820-9b8b-21c762b964b1 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:56.070366 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-67c2ea3a-2c50-4cac-ba7b-062b47da574d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:56.070366 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:56.070366 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:56.070366 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:56.070366 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:56.070366 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:56.070366 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:56.070366 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:56.070366 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:56.070366 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:56.070366 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:56.070366 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:56.070366 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:44:56.070366 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:44:56.070366 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:44:56.071365 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:44:56.071365 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:56.071365 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:56.071365 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:56.071365 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:56.071365 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:56.071365 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:56.071365 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:56.071365 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:56.071365 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:56.071365 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:56.071365 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:56.071365 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:56.071365 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:56.071365 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:56.071365 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:56.071365 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:56.072333 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:44:56.072333 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:44:56.072333 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:56.072333 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:56.073315 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 523/1041] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:44:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 03:44:56.079941 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2ea3a-2c50-4cac-ba7b-062b47da574d None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:56.116941 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75047fba-93ed-4250-81df-700210205936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:56.118186 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75047fba-93ed-4250-81df-700210205936 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:56.118628 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75047fba-93ed-4250-81df-700210205936 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:56.119073 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75047fba-93ed-4250-81df-700210205936 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:56.121162 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75047fba-93ed-4250-81df-700210205936 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:56.124498 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75047fba-93ed-4250-81df-700210205936 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:56.127756 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 519/1042] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:44:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:44:56.135217 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75047fba-93ed-4250-81df-700210205936 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:56.154510 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:56.202749 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2ea3a-2c50-4cac-ba7b-062b47da574d None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:56.243027 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1670b700-8639-43ba-8705-85f244376c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:56.243734 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670b700-8639-43ba-8705-85f244376c5e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:56.247997 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670b700-8639-43ba-8705-85f244376c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:56.247997 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670b700-8639-43ba-8705-85f244376c5e None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:56.247997 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1670b700-8639-43ba-8705-85f244376c5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:56.247997 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1670b700-8639-43ba-8705-85f244376c5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:56.247997 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1670b700-8639-43ba-8705-85f244376c5e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:56.257028 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75047fba-93ed-4250-81df-700210205936 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:56.267485 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 524/1043] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:44:56.269960 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78ea9a-462d-4626-b27b-20ac031965b7 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:56.269960 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78ea9a-462d-4626-b27b-20ac031965b7 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:56.270800 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78ea9a-462d-4626-b27b-20ac031965b7 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:56.273447 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 525/1044] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:44:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:44:56.274652 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78ea9a-462d-4626-b27b-20ac031965b7 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:56.295031 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4351eca-7aed-4b7d-a5ad-c578d0b6d783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:56.295653 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4351eca-7aed-4b7d-a5ad-c578d0b6d783 None admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:56.295947 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4351eca-7aed-4b7d-a5ad-c578d0b6d783 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:56.296219 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4351eca-7aed-4b7d-a5ad-c578d0b6d783 None admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:56.296957 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4351eca-7aed-4b7d-a5ad-c578d0b6d783 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:56.298393 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4351eca-7aed-4b7d-a5ad-c578d0b6d783 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:56.333698 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:56.392968 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 520/1045] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Jul 1 03:44:56 2022] POST /identity/v3/users => generated 285 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 03:44:56.394910 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839079cb-10f9-42c7-9627-70344977186c None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:56.395235 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839079cb-10f9-42c7-9627-70344977186c None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:56.395588 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839079cb-10f9-42c7-9627-70344977186c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:56.406240 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78ea9a-462d-4626-b27b-20ac031965b7 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:56.422427 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-839079cb-10f9-42c7-9627-70344977186c None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:44:56.425173 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-839079cb-10f9-42c7-9627-70344977186c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:44:56.449175 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40445fe0-3922-45fa-8727-b570ef2df6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:56.450305 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40445fe0-3922-45fa-8727-b570ef2df6d5 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:56.450694 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40445fe0-3922-45fa-8727-b570ef2df6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:56.451639 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40445fe0-3922-45fa-8727-b570ef2df6d5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:56.460180 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40445fe0-3922-45fa-8727-b570ef2df6d5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:56.461691 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40445fe0-3922-45fa-8727-b570ef2df6d5 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:56.479327 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-40445fe0-3922-45fa-8727-b570ef2df6d5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 01 03:44:56.479327 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:56.479327 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:56.479327 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:56.479327 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:56.479327 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:56.479327 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:56.479327 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:56.479327 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:56.479327 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:56.479327 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:56.479327 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:56.479327 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 03:44:56.479327 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 03:44:56.479327 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 03:44:56.479327 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 03:44:56.481481 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:56.481481 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:56.481481 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 03:44:56.481481 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:44:56.481481 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 03:44:56.481481 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:44:56.481481 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:56.481481 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:56.481481 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:56.481481 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:56.481481 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:56.481481 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:56.481481 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:56.481481 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:56.481481 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:56.481481 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:56.481481 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:56.481481 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:56.488777 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:56.488777 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:56.488777 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 03:44:56.488777 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 03:44:56.488777 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 03:44:56.488777 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 03:44:56.488777 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 03:44:56.488777 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 03:44:56.488777 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 01 03:44:56.488777 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:56.488777 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 526/1046] 10.222.0.46 () {56 vars in 1093 bytes} [Fri Jul 1 03:44:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:56.488777 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40445fe0-3922-45fa-8727-b570ef2df6d5 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:56.540850 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:56.559605 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 521/1047] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:44:56 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:44:56.584097 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839079cb-10f9-42c7-9627-70344977186c None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:56.637989 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40445fe0-3922-45fa-8727-b570ef2df6d5 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:56.659177 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:56.706473 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52881275-4cc0-4699-aa16-a3f97a2388af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:56.707698 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52881275-4cc0-4699-aa16-a3f97a2388af None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:56.708216 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52881275-4cc0-4699-aa16-a3f97a2388af None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:56.708728 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52881275-4cc0-4699-aa16-a3f97a2388af None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:56.710388 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52881275-4cc0-4699-aa16-a3f97a2388af None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:56.710799 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52881275-4cc0-4699-aa16-a3f97a2388af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:56.713618 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52881275-4cc0-4699-aa16-a3f97a2388af None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:56.742284 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839079cb-10f9-42c7-9627-70344977186c None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:56.745667 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 527/1048] 10.222.0.46 () {56 vars in 1133 bytes} [Fri Jul 1 03:44:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:44:56.752422 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52881275-4cc0-4699-aa16-a3f97a2388af None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:56.791929 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76cabd-9501-40be-b2e7-c0ec29b8fdfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:56.792777 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76cabd-9501-40be-b2e7-c0ec29b8fdfb None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:56.793034 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76cabd-9501-40be-b2e7-c0ec29b8fdfb None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:56.793297 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76cabd-9501-40be-b2e7-c0ec29b8fdfb None admin] PATH_INFO: `/v3/services/image` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:56.793967 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76cabd-9501-40be-b2e7-c0ec29b8fdfb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:56.795889 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76cabd-9501-40be-b2e7-c0ec29b8fdfb None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:56.808872 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-dc76cabd-9501-40be-b2e7-c0ec29b8fdfb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 01 03:44:56.808872 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:56.808872 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 03:44:56.808872 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 03:44:56.808872 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 03:44:56.808872 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 03:44:56.808872 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 03:44:56.808872 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:44:56.808872 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 01 03:44:56.808872 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:56.808872 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 03:44:56.808872 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:56.808872 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:56.808872 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:56.808872 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:56.808872 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:56.808872 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:56.811582 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:56.811582 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:56.811582 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:56.811582 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:56.811582 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:56.811582 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:56.811582 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 03:44:56.811582 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 03:44:56.811582 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 03:44:56.811582 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 03:44:56.811582 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:56.811582 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:56.811582 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:56.811582 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:56.811582 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:56.811582 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:56.812903 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:56.812903 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:56.812903 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:56.812903 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:56.812903 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:56.812903 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:56.812903 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:56.812903 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:56.812903 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:56.812903 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:56.812903 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 03:44:56.812903 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:44:56.812903 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 01 03:44:56.812903 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:56.812903 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 522/1049] 10.222.0.46 () {56 vars in 1105 bytes} [Fri Jul 1 03:44:56 2022] GET /identity/v3/services/image => generated 86 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 03:44:56.817612 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76cabd-9501-40be-b2e7-c0ec29b8fdfb None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:56.904240 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52881275-4cc0-4699-aa16-a3f97a2388af None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:56.917078 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:56.955531 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eea2ab-7769-4713-9d6a-90f9bd70ab36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:56.956731 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eea2ab-7769-4713-9d6a-90f9bd70ab36 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:56.957018 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eea2ab-7769-4713-9d6a-90f9bd70ab36 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:56.957296 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eea2ab-7769-4713-9d6a-90f9bd70ab36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:56.971142 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eea2ab-7769-4713-9d6a-90f9bd70ab36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:56.972700 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eea2ab-7769-4713-9d6a-90f9bd70ab36 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:56.991105 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76cabd-9501-40be-b2e7-c0ec29b8fdfb None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:56.995128 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-61eea2ab-7769-4713-9d6a-90f9bd70ab36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:56.995128 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:56.995128 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:56.995128 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:56.995128 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:56.995128 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:56.995128 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:56.995128 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:56.995128 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:56.995128 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:56.995128 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:56.995128 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:56.995128 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:44:56.995128 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:44:56.995128 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:44:56.997008 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:44:56.997008 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:56.997008 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:56.997008 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:56.997008 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:56.997008 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:56.997008 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:56.997008 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:56.997008 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:56.997008 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:56.997008 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:56.997008 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:56.997008 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:56.997008 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:56.997008 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:56.997008 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:56.997008 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:56.998845 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:44:56.998845 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:44:56.998845 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:44:56.998845 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:56.998845 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 528/1050] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:44:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:57.002369 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eea2ab-7769-4713-9d6a-90f9bd70ab36 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:57.030058 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:57.041425 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87401975-04bc-4668-9aa1-2b84f1808041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:57.042108 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87401975-04bc-4668-9aa1-2b84f1808041 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:57.046107 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87401975-04bc-4668-9aa1-2b84f1808041 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:57.046107 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87401975-04bc-4668-9aa1-2b84f1808041 None admin] PATH_INFO: `/v3/services` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:57.046107 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87401975-04bc-4668-9aa1-2b84f1808041 None admin] RBAC: Adding query filter params (name=image) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:57.046107 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87401975-04bc-4668-9aa1-2b84f1808041 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:57.046107 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87401975-04bc-4668-9aa1-2b84f1808041 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:57.051554 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 523/1051] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:44:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:44:57.061199 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87401975-04bc-4668-9aa1-2b84f1808041 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:57.148523 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eea2ab-7769-4713-9d6a-90f9bd70ab36 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:57.195842 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366dafe5-16e3-4921-8feb-bd326bf887cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:57.196685 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366dafe5-16e3-4921-8feb-bd326bf887cb None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:57.197127 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366dafe5-16e3-4921-8feb-bd326bf887cb None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:57.197579 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366dafe5-16e3-4921-8feb-bd326bf887cb None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:57.198373 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366dafe5-16e3-4921-8feb-bd326bf887cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:57.198686 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366dafe5-16e3-4921-8feb-bd326bf887cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:57.200385 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366dafe5-16e3-4921-8feb-bd326bf887cb None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:57.203571 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87401975-04bc-4668-9aa1-2b84f1808041 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:57.216638 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 529/1052] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:44:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:44:57.223182 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366dafe5-16e3-4921-8feb-bd326bf887cb None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:57.234676 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:57.246540 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c79bfd0-679f-48d1-a764-f3b4f3745ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:57.247306 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79bfd0-679f-48d1-a764-f3b4f3745ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:57.247634 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79bfd0-679f-48d1-a764-f3b4f3745ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:57.253210 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79bfd0-679f-48d1-a764-f3b4f3745ce9 None admin] PATH_INFO: `/v3/services` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:57.253210 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c79bfd0-679f-48d1-a764-f3b4f3745ce9 None admin] RBAC: Adding query filter params (type=image) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:57.253210 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c79bfd0-679f-48d1-a764-f3b4f3745ce9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:57.253210 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c79bfd0-679f-48d1-a764-f3b4f3745ce9 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:57.256944 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 524/1053] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:44:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:57.262582 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c79bfd0-679f-48d1-a764-f3b4f3745ce9 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:57.353498 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:57.376596 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366dafe5-16e3-4921-8feb-bd326bf887cb None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:57.394921 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c79bfd0-679f-48d1-a764-f3b4f3745ce9 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:57.417751 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda478f-6067-42d3-b30f-5e4b866d4706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:57.418461 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda478f-6067-42d3-b30f-5e4b866d4706 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:57.418754 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda478f-6067-42d3-b30f-5e4b866d4706 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:57.419027 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda478f-6067-42d3-b30f-5e4b866d4706 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:57.426651 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda478f-6067-42d3-b30f-5e4b866d4706 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:57.428183 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda478f-6067-42d3-b30f-5e4b866d4706 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:57.443034 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-3fda478f-6067-42d3-b30f-5e4b866d4706 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:44:57.443034 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:57.443034 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:57.443034 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:57.443034 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:57.443034 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:57.443034 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:57.443034 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:57.443034 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:57.443034 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:57.443034 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:57.443034 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:57.443034 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 03:44:57.443034 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 03:44:57.443034 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 03:44:57.444971 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 03:44:57.444971 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:57.444971 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:57.444971 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:57.444971 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:57.444971 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:57.444971 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:57.444971 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:57.444971 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:57.444971 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:57.444971 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:57.444971 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:57.444971 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:57.444971 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:57.444971 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:57.444971 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:57.444971 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:57.446662 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 03:44:57.446662 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 03:44:57.446662 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 03:44:57.446662 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 03:44:57.446662 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 03:44:57.446662 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 03:44:57.446662 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:44:57.446662 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:44:57.446662 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 530/1054] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:44:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 03:44:57.450241 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda478f-6067-42d3-b30f-5e4b866d4706 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:57.458924 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c566894-6cf3-4f3e-9efd-df8549d1577d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:57.459630 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c566894-6cf3-4f3e-9efd-df8549d1577d None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:57.459927 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c566894-6cf3-4f3e-9efd-df8549d1577d None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:57.460716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c566894-6cf3-4f3e-9efd-df8549d1577d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:57.461522 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c566894-6cf3-4f3e-9efd-df8549d1577d None admin] RBAC: Adding query filter params (interface=public, service_id=2169abd174e9443191184739b1b2f019, region_id=RegionOne) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:57.461844 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c566894-6cf3-4f3e-9efd-df8549d1577d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:57.463642 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c566894-6cf3-4f3e-9efd-df8549d1577d None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:57.475835 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 525/1055] 10.222.0.46 () {56 vars in 1251 bytes} [Fri Jul 1 03:44:57 2022] GET /identity/v3/endpoints?service_id=2169abd174e9443191184739b1b2f019&interface=public®ion_id=RegionOne => generated 194 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:44:57.480495 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c566894-6cf3-4f3e-9efd-df8549d1577d None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:57.560144 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:57.589499 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda478f-6067-42d3-b30f-5e4b866d4706 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:57.621634 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c566894-6cf3-4f3e-9efd-df8549d1577d None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:57.634150 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13c87f-e335-49f5-b966-da19d3027de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:57.634829 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13c87f-e335-49f5-b966-da19d3027de9 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:57.635127 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13c87f-e335-49f5-b966-da19d3027de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:57.635377 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13c87f-e335-49f5-b966-da19d3027de9 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:57.636866 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13c87f-e335-49f5-b966-da19d3027de9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:57.637593 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13c87f-e335-49f5-b966-da19d3027de9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:57.639645 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13c87f-e335-49f5-b966-da19d3027de9 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:57.655294 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:57.666774 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9fcad-9118-4e17-89cd-bec0653e82de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:57.666990 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 531/1056] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 1 03:44:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:44:57.669749 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9fcad-9118-4e17-89cd-bec0653e82de None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:57.669749 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9fcad-9118-4e17-89cd-bec0653e82de None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:57.669749 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9fcad-9118-4e17-89cd-bec0653e82de None admin] PATH_INFO: `/v3/services` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:57.669749 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b9fcad-9118-4e17-89cd-bec0653e82de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:57.669749 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b9fcad-9118-4e17-89cd-bec0653e82de None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:57.670119 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13c87f-e335-49f5-b966-da19d3027de9 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:57.677539 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 526/1057] 10.222.0.46 () {56 vars in 1087 bytes} [Fri Jul 1 03:44:57 2022] GET /identity/v3/services => generated 1957 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 03:44:57.855723 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13c87f-e335-49f5-b966-da19d3027de9 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:57.896189 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370ee4f-b7cc-4715-80e6-309384321e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:57.897136 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370ee4f-b7cc-4715-80e6-309384321e61 None admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:57.897417 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370ee4f-b7cc-4715-80e6-309384321e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:57.897692 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370ee4f-b7cc-4715-80e6-309384321e61 None admin] PATH_INFO: `/v3/projects/da83db15a312499fb627691ae442f233/users/2da466ad31d344898f5c838f77d45181/roles/43eeddda303844f3850a6e55a673a34f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:57.899983 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e370ee4f-b7cc-4715-80e6-309384321e61 None admin] RBAC: Authorizing `identity:create_grant(project_id=da83db15a312499fb627691ae442f233, user_id=2da466ad31d344898f5c838f77d45181, role_id=43eeddda303844f3850a6e55a673a34f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:57.901446 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e370ee4f-b7cc-4715-80e6-309384321e61 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:57.980131 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 532/1058] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 1 03:44:57 2022] PUT /identity/v3/projects/da83db15a312499fb627691ae442f233/users/2da466ad31d344898f5c838f77d45181/roles/43eeddda303844f3850a6e55a673a34f => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 03:44:58.647934 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1c027-c235-487f-b00e-b93a41d31f0f None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:58.648810 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1c027-c235-487f-b00e-b93a41d31f0f None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:58.648810 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1c027-c235-487f-b00e-b93a41d31f0f None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:58.649954 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 527/1059] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:44:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:44:58.657522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0ba50-720a-42be-a092-44225a3ef846 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:58.658137 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0ba50-720a-42be-a092-44225a3ef846 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:58.658646 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0ba50-720a-42be-a092-44225a3ef846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:58.682017 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-6af0ba50-720a-42be-a092-44225a3ef846 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:44:58.683313 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-6af0ba50-720a-42be-a092-44225a3ef846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:44:58.760142 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:58.778486 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 533/1060] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:44:58 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 03:44:58.800385 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1c027-c235-487f-b00e-b93a41d31f0f None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:58.945492 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1c027-c235-487f-b00e-b93a41d31f0f None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:58.962199 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:58.986374 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0971cbc-2041-4721-b04e-92b102236d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:58.987186 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0971cbc-2041-4721-b04e-92b102236d85 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:58.987488 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0971cbc-2041-4721-b04e-92b102236d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:58.987874 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0971cbc-2041-4721-b04e-92b102236d85 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:59.003901 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0971cbc-2041-4721-b04e-92b102236d85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:44:59.013500 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-d0971cbc-2041-4721-b04e-92b102236d85 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:44:59.013500 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:44:59.013500 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:44:59.013500 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:44:59.013500 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:44:59.013500 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:44:59.013500 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:44:59.013500 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:44:59.013500 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:44:59.013500 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:44:59.013500 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:44:59.013500 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:44:59.013500 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:44:59.013500 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:44:59.013500 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:44:59.013500 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:44:59.014507 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:44:59.014507 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:44:59.014507 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:44:59.014507 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:44:59.014507 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:44:59.014507 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:44:59.014507 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:44:59.014507 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:44:59.014507 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:44:59.014507 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:44:59.014507 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:44:59.014507 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:44:59.014507 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:44:59.014507 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:44:59.014507 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:44:59.014507 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:44:59.015342 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:44:59.015342 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:44:59.015342 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:44:59.015342 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:44:59.015342 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:44:59.015342 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:44:59.015342 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:44:59.015342 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:44:59.015342 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:44:59.015342 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:44:59.015342 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:44:59.015342 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:44:59.015342 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 528/1061] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 1 03:44:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:44:59.022580 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0ba50-720a-42be-a092-44225a3ef846 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:59.181611 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0ba50-720a-42be-a092-44225a3ef846 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:59.240338 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a870a69-5e8a-4f7a-a120-7e064c235edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:59.241417 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a870a69-5e8a-4f7a-a120-7e064c235edd None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:59.241871 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a870a69-5e8a-4f7a-a120-7e064c235edd None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:59.242328 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a870a69-5e8a-4f7a-a120-7e064c235edd None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:59.243722 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a870a69-5e8a-4f7a-a120-7e064c235edd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:44:59.244258 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a870a69-5e8a-4f7a-a120-7e064c235edd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:59.246703 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a870a69-5e8a-4f7a-a120-7e064c235edd None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:59.262037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 534/1062] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:44:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:44:59.271475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0971cbc-2041-4721-b04e-92b102236d85 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:59.384420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0971cbc-2041-4721-b04e-92b102236d85 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:59.429668 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb30bc-dbff-4072-92a5-b11fa1e271d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:59.430714 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb30bc-dbff-4072-92a5-b11fa1e271d5 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:59.431001 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb30bc-dbff-4072-92a5-b11fa1e271d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:59.431280 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb30bc-dbff-4072-92a5-b11fa1e271d5 None admin] PATH_INFO: `/v3/users/baf5af994f0c40b1a67954834788406c` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:59.449382 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb30bc-dbff-4072-92a5-b11fa1e271d5 None admin] RBAC: Authorizing `identity:get_user(user_id=baf5af994f0c40b1a67954834788406c)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:59.451318 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb30bc-dbff-4072-92a5-b11fa1e271d5 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:59.453274 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 529/1063] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:44:59 2022] GET /identity/v3/users/baf5af994f0c40b1a67954834788406c => generated 285 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:44:59.460626 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a870a69-5e8a-4f7a-a120-7e064c235edd None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:44:59.563546 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:59.642155 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a870a69-5e8a-4f7a-a120-7e064c235edd None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:44:59.698987 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c00d572-fcb3-45b2-be11-c7fc87588fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:44:59.700687 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00d572-fcb3-45b2-be11-c7fc87588fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:44:59.700979 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00d572-fcb3-45b2-be11-c7fc87588fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:44:59.701272 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00d572-fcb3-45b2-be11-c7fc87588fd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:44:59.819655 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c00d572-fcb3-45b2-be11-c7fc87588fd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:44:59.822377 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c00d572-fcb3-45b2-be11-c7fc87588fd4 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:44:59.917884 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:44:59.982293 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 535/1064] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:44:59 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 01 03:44:59.988246 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb30bc-dbff-4072-92a5-b11fa1e271d5 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:00.019130 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04f656-9842-469e-a7be-a9e892afb6de None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:00.019422 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04f656-9842-469e-a7be-a9e892afb6de None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:00.019741 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04f656-9842-469e-a7be-a9e892afb6de None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:00.021395 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 536/1065] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:45:00.026302 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:00.026587 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f948b-69c4-4dba-8a3e-1e47a4685e7c None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:00.026878 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f948b-69c4-4dba-8a3e-1e47a4685e7c None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:00.027163 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f948b-69c4-4dba-8a3e-1e47a4685e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:00.044599 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-814f948b-69c4-4dba-8a3e-1e47a4685e7c None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:45:00.045806 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-814f948b-69c4-4dba-8a3e-1e47a4685e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:45:00.106996 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb30bc-dbff-4072-92a5-b11fa1e271d5 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:00.148129 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13318f40-39ff-4e3c-a5c7-4b5f7b32288c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:00.149104 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13318f40-39ff-4e3c-a5c7-4b5f7b32288c None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:00.149396 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13318f40-39ff-4e3c-a5c7-4b5f7b32288c None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:00.149680 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13318f40-39ff-4e3c-a5c7-4b5f7b32288c None admin] PATH_INFO: `/v3/projects/fcca125e0dc542aaaf2587a6abc43711` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:00.151014 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13318f40-39ff-4e3c-a5c7-4b5f7b32288c None admin] RBAC: Authorizing `identity:get_project(project_id=fcca125e0dc542aaaf2587a6abc43711)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:00.152488 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13318f40-39ff-4e3c-a5c7-4b5f7b32288c None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:00.154618 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 530/1066] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:44:59 2022] GET /identity/v3/projects/fcca125e0dc542aaaf2587a6abc43711 => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:45:00.161375 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 537/1067] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:45:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 03:45:00.161606 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13318f40-39ff-4e3c-a5c7-4b5f7b32288c None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:00.187823 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f948b-69c4-4dba-8a3e-1e47a4685e7c None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:00.281774 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:00.284790 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13318f40-39ff-4e3c-a5c7-4b5f7b32288c None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:00.295899 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:00.317505 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f948b-69c4-4dba-8a3e-1e47a4685e7c None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:00.328868 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6428290-4bbb-495a-9bd5-fddd455c8743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:00.329537 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6428290-4bbb-495a-9bd5-fddd455c8743 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:00.329820 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6428290-4bbb-495a-9bd5-fddd455c8743 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:00.330098 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6428290-4bbb-495a-9bd5-fddd455c8743 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:00.330952 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6428290-4bbb-495a-9bd5-fddd455c8743 None admin] RBAC: Adding query filter params (role.id=681755518698445fabd9a8accec13c0f, scope.project.id=fcca125e0dc542aaaf2587a6abc43711, user.id=baf5af994f0c40b1a67954834788406c) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:45:00.331271 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6428290-4bbb-495a-9bd5-fddd455c8743 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:00.332755 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6428290-4bbb-495a-9bd5-fddd455c8743 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:00.344638 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 531/1068] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:45:00 2022] GET /identity/v3/role_assignments?user.id=baf5af994f0c40b1a67954834788406c&scope.project.id=fcca125e0dc542aaaf2587a6abc43711&role.id=681755518698445fabd9a8accec13c0f => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:45:00.359774 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02915125-f8a9-4ad2-9258-bfb961ac5f80 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:00.359774 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02915125-f8a9-4ad2-9258-bfb961ac5f80 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:00.359774 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02915125-f8a9-4ad2-9258-bfb961ac5f80 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:00.359774 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 532/1069] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:45:00.359774 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f1148-b1a2-4c4f-bcf7-08566f407ca4 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:00.359774 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f1148-b1a2-4c4f-bcf7-08566f407ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:00.360244 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f1148-b1a2-4c4f-bcf7-08566f407ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:00.377385 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff57ff-36e6-4368-9c38-533e65877d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:00.379145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff57ff-36e6-4368-9c38-533e65877d78 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:00.379816 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff57ff-36e6-4368-9c38-533e65877d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:00.380543 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff57ff-36e6-4368-9c38-533e65877d78 None admin] PATH_INFO: `/v3/services/image` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:00.381789 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff57ff-36e6-4368-9c38-533e65877d78 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:00.384780 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff57ff-36e6-4368-9c38-533e65877d78 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:00.385048 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-a80f1148-b1a2-4c4f-bcf7-08566f407ca4 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:45:00.386828 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-a80f1148-b1a2-4c4f-bcf7-08566f407ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:45:00.401456 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-69ff57ff-36e6-4368-9c38-533e65877d78 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 01 03:45:00.401456 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:45:00.401456 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 03:45:00.401456 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 03:45:00.401456 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 03:45:00.401456 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 03:45:00.401456 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 03:45:00.401456 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:45:00.401456 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 01 03:45:00.401456 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:45:00.401456 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 03:45:00.401456 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:45:00.401456 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:45:00.401456 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:45:00.401456 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:45:00.401456 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:45:00.401456 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:45:00.402911 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:45:00.402911 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:45:00.402911 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:45:00.402911 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:45:00.402911 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:45:00.402911 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:45:00.402911 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 03:45:00.402911 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 03:45:00.402911 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 03:45:00.402911 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 03:45:00.402911 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:45:00.402911 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:45:00.402911 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:45:00.402911 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:45:00.402911 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:45:00.402911 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:45:00.406167 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:45:00.406167 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:45:00.406167 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:45:00.406167 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:45:00.406167 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:45:00.406167 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:45:00.406167 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:45:00.406167 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:45:00.406167 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:45:00.406167 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:45:00.406167 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 03:45:00.406167 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:45:00.406167 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 01 03:45:00.406167 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:45:00.408768 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 538/1070] 10.222.0.46 () {56 vars in 1105 bytes} [Fri Jul 1 03:45:00 2022] GET /identity/v3/services/image => generated 86 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:45:00.410327 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff57ff-36e6-4368-9c38-533e65877d78 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:00.510497 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 533/1071] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:45:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 03:45:00.525934 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f1148-b1a2-4c4f-bcf7-08566f407ca4 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:00.554682 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff57ff-36e6-4368-9c38-533e65877d78 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:00.592720 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7406eba-cb6f-420c-ab42-7ad816294145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:00.593397 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7406eba-cb6f-420c-ab42-7ad816294145 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:00.593710 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7406eba-cb6f-420c-ab42-7ad816294145 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:00.593997 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7406eba-cb6f-420c-ab42-7ad816294145 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:00.594705 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7406eba-cb6f-420c-ab42-7ad816294145 None admin] RBAC: Adding query filter params (name=image) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:45:00.595008 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7406eba-cb6f-420c-ab42-7ad816294145 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:00.596447 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7406eba-cb6f-420c-ab42-7ad816294145 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:00.602481 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 539/1072] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:45:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:45:00.608521 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7406eba-cb6f-420c-ab42-7ad816294145 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:00.624055 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:00.645352 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:00.652589 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f1148-b1a2-4c4f-bcf7-08566f407ca4 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:00.699534 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a4c63-8355-4e86-bd27-872a74c681f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:00.700945 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a4c63-8355-4e86-bd27-872a74c681f1 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:00.701224 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a4c63-8355-4e86-bd27-872a74c681f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:00.701484 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a4c63-8355-4e86-bd27-872a74c681f1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:00.713148 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a4c63-8355-4e86-bd27-872a74c681f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:45:00.722154 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-a91a4c63-8355-4e86-bd27-872a74c681f1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 01 03:45:00.722154 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:45:00.722154 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:45:00.722154 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:45:00.722154 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:45:00.722154 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:45:00.722154 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:45:00.722154 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:45:00.722154 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:45:00.722154 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:45:00.722154 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:45:00.722154 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:45:00.722154 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:45:00.722154 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:45:00.722154 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:45:00.722154 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:45:00.724100 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:45:00.724100 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:45:00.724100 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:45:00.724100 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:45:00.724100 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:45:00.724100 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:45:00.724100 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:45:00.724100 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:45:00.724100 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:45:00.724100 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:45:00.724100 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:45:00.724100 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:45:00.724100 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:45:00.724100 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:45:00.724100 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:45:00.724100 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:45:00.725400 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:45:00.725400 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:45:00.725400 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:45:00.725400 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:45:00.725400 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:45:00.725400 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:45:00.725400 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:45:00.725400 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:45:00.725400 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:45:00.725400 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:45:00.725400 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 01 03:45:00.725400 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:45:00.725400 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 534/1073] 10.222.0.46 () {56 vars in 1120 bytes} [Fri Jul 1 03:45:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 03:45:00.732096 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a4c63-8355-4e86-bd27-872a74c681f1 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:00.751765 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7406eba-cb6f-420c-ab42-7ad816294145 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:00.810035 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d86c7-199d-440f-9b5f-0c9a1cda8705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:00.811115 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d86c7-199d-440f-9b5f-0c9a1cda8705 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:00.811581 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d86c7-199d-440f-9b5f-0c9a1cda8705 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:00.811865 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d86c7-199d-440f-9b5f-0c9a1cda8705 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:00.812922 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d86c7-199d-440f-9b5f-0c9a1cda8705 None admin] RBAC: Adding query filter params (type=image) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:45:00.813417 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d86c7-199d-440f-9b5f-0c9a1cda8705 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:00.815762 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d86c7-199d-440f-9b5f-0c9a1cda8705 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:00.824504 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 540/1074] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:45:00 2022] GET /identity/v3/services?type=image => generated 350 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:45:00.831282 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d86c7-199d-440f-9b5f-0c9a1cda8705 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:00.889560 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a4c63-8355-4e86-bd27-872a74c681f1 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:00.932556 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:00.933601 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5db08-b3ab-40c4-8f5b-099f8d754fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:00.934906 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5db08-b3ab-40c4-8f5b-099f8d754fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:00.935099 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5db08-b3ab-40c4-8f5b-099f8d754fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:00.935365 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5db08-b3ab-40c4-8f5b-099f8d754fa6 None admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:00.936160 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b5db08-b3ab-40c4-8f5b-099f8d754fa6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:45:00.936464 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b5db08-b3ab-40c4-8f5b-099f8d754fa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:00.937842 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b5db08-b3ab-40c4-8f5b-099f8d754fa6 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:00.952656 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 535/1075] 10.222.0.46 () {56 vars in 1115 bytes} [Fri Jul 1 03:45:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:45:00.954332 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5db08-b3ab-40c4-8f5b-099f8d754fa6 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:00.974366 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:00.977407 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d86c7-199d-440f-9b5f-0c9a1cda8705 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:01.039847 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83440e66-bd5c-4c07-8650-38fe27857499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:01.041130 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83440e66-bd5c-4c07-8650-38fe27857499 None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:01.041659 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83440e66-bd5c-4c07-8650-38fe27857499 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:01.042298 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83440e66-bd5c-4c07-8650-38fe27857499 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:01.044302 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83440e66-bd5c-4c07-8650-38fe27857499 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:01.046873 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83440e66-bd5c-4c07-8650-38fe27857499 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:01.077517 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5db08-b3ab-40c4-8f5b-099f8d754fa6 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:01.107971 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f3565-2e2d-456a-ad96-ac0ba8664eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:01.108782 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f3565-2e2d-456a-ad96-ac0ba8664eb8 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:01.109070 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f3565-2e2d-456a-ad96-ac0ba8664eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:01.109336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f3565-2e2d-456a-ad96-ac0ba8664eb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:01.121473 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f3565-2e2d-456a-ad96-ac0ba8664eb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:01.123619 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f3565-2e2d-456a-ad96-ac0ba8664eb8 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:01.141938 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-d71f3565-2e2d-456a-ad96-ac0ba8664eb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:45:01.141938 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:45:01.141938 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:45:01.141938 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:45:01.141938 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:45:01.141938 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:45:01.141938 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:45:01.141938 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:45:01.141938 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:45:01.141938 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:45:01.141938 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:45:01.141938 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:45:01.141938 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:45:01.141938 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:45:01.141938 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:45:01.147525 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:45:01.147525 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:45:01.147525 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:45:01.147525 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:45:01.147525 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:45:01.147525 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:45:01.147525 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:45:01.147525 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:45:01.147525 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:45:01.147525 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:45:01.147525 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:45:01.147525 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:45:01.147525 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:45:01.147525 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:45:01.147525 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:45:01.147525 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:45:01.147525 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:45:01.148979 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:45:01.148979 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:45:01.148979 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:45:01.148979 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:45:01.148979 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 536/1076] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:45:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 03:45:01.149540 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f3565-2e2d-456a-ad96-ac0ba8664eb8 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:01.180546 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 541/1077] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 1 03:45:00 2022] POST /identity/v3/endpoints => generated 327 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 03:45:01.244772 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:01.290949 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f3565-2e2d-456a-ad96-ac0ba8664eb8 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:01.355190 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba9015-28b6-4ed7-a147-2463dd620c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:01.355912 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba9015-28b6-4ed7-a147-2463dd620c37 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:01.356199 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba9015-28b6-4ed7-a147-2463dd620c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:01.357084 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba9015-28b6-4ed7-a147-2463dd620c37 None admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:01.358325 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ba9015-28b6-4ed7-a147-2463dd620c37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:45:01.358325 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ba9015-28b6-4ed7-a147-2463dd620c37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:01.361429 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ba9015-28b6-4ed7-a147-2463dd620c37 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:01.377315 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 537/1078] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:45:01.383440 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83440e66-bd5c-4c07-8650-38fe27857499 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:01.514735 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83440e66-bd5c-4c07-8650-38fe27857499 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:01.549799 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:01.556948 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf68c7-4f1d-4351-a112-e651d4b404bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:01.557916 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf68c7-4f1d-4351-a112-e651d4b404bd None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:01.558298 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf68c7-4f1d-4351-a112-e651d4b404bd None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:01.562782 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf68c7-4f1d-4351-a112-e651d4b404bd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:01.567691 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf68c7-4f1d-4351-a112-e651d4b404bd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:01.569168 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf68c7-4f1d-4351-a112-e651d4b404bd None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:01.584675 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-65cf68c7-4f1d-4351-a112-e651d4b404bd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 01 03:45:01.584675 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:45:01.584675 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:45:01.584675 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:45:01.584675 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:45:01.584675 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:45:01.584675 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:45:01.584675 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:45:01.584675 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:45:01.584675 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:45:01.584675 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:45:01.584675 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:45:01.584675 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 03:45:01.584675 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 03:45:01.584675 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 03:45:01.584675 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 03:45:01.585812 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:45:01.585812 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:45:01.585812 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 03:45:01.585812 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:45:01.585812 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 03:45:01.585812 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:45:01.585812 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:45:01.585812 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:45:01.585812 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:45:01.585812 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:45:01.585812 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:45:01.585812 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:45:01.585812 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:45:01.585812 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:45:01.585812 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:45:01.585812 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:45:01.585812 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:45:01.585812 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:45:01.586751 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:45:01.586751 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:45:01.586751 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 03:45:01.586751 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 03:45:01.586751 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 03:45:01.586751 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 03:45:01.586751 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 03:45:01.586751 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 03:45:01.586751 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 01 03:45:01.586751 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:45:01.586751 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 542/1079] 10.222.0.46 () {56 vars in 1093 bytes} [Fri Jul 1 03:45:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:45:01.593732 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba9015-28b6-4ed7-a147-2463dd620c37 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:01.743562 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba9015-28b6-4ed7-a147-2463dd620c37 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:01.781902 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:01.796377 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764879d-06b3-4d61-928b-5a8bce030a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:01.797057 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764879d-06b3-4d61-928b-5a8bce030a7b None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:01.799335 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764879d-06b3-4d61-928b-5a8bce030a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:01.799335 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764879d-06b3-4d61-928b-5a8bce030a7b None admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:01.799335 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764879d-06b3-4d61-928b-5a8bce030a7b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:45:01.799335 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764879d-06b3-4d61-928b-5a8bce030a7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:01.800893 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764879d-06b3-4d61-928b-5a8bce030a7b None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:01.826250 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 538/1080] 10.222.0.46 () {56 vars in 1133 bytes} [Fri Jul 1 03:45:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:45:01.827564 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf68c7-4f1d-4351-a112-e651d4b404bd None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:01.991220 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf68c7-4f1d-4351-a112-e651d4b404bd None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:02.045225 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f39f4-9217-48ff-accc-eb41db159083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:02.046339 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f39f4-9217-48ff-accc-eb41db159083 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:02.046846 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f39f4-9217-48ff-accc-eb41db159083 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:02.047298 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f39f4-9217-48ff-accc-eb41db159083 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:02.155630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:02.171616 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f39f4-9217-48ff-accc-eb41db159083 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:02.173554 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f39f4-9217-48ff-accc-eb41db159083 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:02.373366 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 543/1081] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:45:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 01 03:45:02.379697 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764879d-06b3-4d61-928b-5a8bce030a7b None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:02.493934 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764879d-06b3-4d61-928b-5a8bce030a7b None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:02.500928 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308874f0-9408-4450-ba4c-f6db44e49dff None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:02.501209 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308874f0-9408-4450-ba4c-f6db44e49dff None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:02.501488 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308874f0-9408-4450-ba4c-f6db44e49dff None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:02.503037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 544/1082] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:45:02.508206 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0bc195-d4a7-4c93-ae30-e4a0dd1938cf None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:02.508512 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0bc195-d4a7-4c93-ae30-e4a0dd1938cf None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:02.508772 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0bc195-d4a7-4c93-ae30-e4a0dd1938cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:02.527565 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-ec0bc195-d4a7-4c93-ae30-e4a0dd1938cf None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:45:02.528793 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ec0bc195-d4a7-4c93-ae30-e4a0dd1938cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:45:02.535127 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec52f84-3c86-4e2e-a510-16f07e7a2ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:02.536092 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec52f84-3c86-4e2e-a510-16f07e7a2ceb None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:02.536475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec52f84-3c86-4e2e-a510-16f07e7a2ceb None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:02.536969 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec52f84-3c86-4e2e-a510-16f07e7a2ceb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:02.549472 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec52f84-3c86-4e2e-a510-16f07e7a2ceb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:02.551060 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec52f84-3c86-4e2e-a510-16f07e7a2ceb None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:02.570682 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-8ec52f84-3c86-4e2e-a510-16f07e7a2ceb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:45:02.570682 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:45:02.570682 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:45:02.570682 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:45:02.570682 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:45:02.570682 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:45:02.570682 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:45:02.570682 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:45:02.570682 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:45:02.570682 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:45:02.570682 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:45:02.570682 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:45:02.570682 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:45:02.570682 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:45:02.570682 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:45:02.571849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:45:02.571849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:45:02.571849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:45:02.571849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:45:02.571849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:45:02.571849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:45:02.571849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:45:02.571849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:45:02.571849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:45:02.571849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:45:02.571849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:45:02.571849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:45:02.571849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:45:02.571849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:45:02.571849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:45:02.571849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:45:02.571849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:45:02.572906 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:45:02.572906 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:45:02.572906 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:45:02.572906 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:45:02.572906 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 539/1083] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:45:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:45:02.578420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec52f84-3c86-4e2e-a510-16f07e7a2ceb None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:02.601212 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 545/1084] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:45:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 03:45:02.615675 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:02.624916 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0bc195-d4a7-4c93-ae30-e4a0dd1938cf None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:02.647039 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:02.688775 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec52f84-3c86-4e2e-a510-16f07e7a2ceb None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:02.725606 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e30003-ad3d-410b-acb9-fed8bd33db87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:02.726263 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e30003-ad3d-410b-acb9-fed8bd33db87 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:02.726544 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e30003-ad3d-410b-acb9-fed8bd33db87 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:02.726816 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e30003-ad3d-410b-acb9-fed8bd33db87 None admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:02.727555 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e30003-ad3d-410b-acb9-fed8bd33db87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:45:02.727867 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e30003-ad3d-410b-acb9-fed8bd33db87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:02.729215 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e30003-ad3d-410b-acb9-fed8bd33db87 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:02.730784 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0bc195-d4a7-4c93-ae30-e4a0dd1938cf None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:02.749026 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 540/1085] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:45:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:45:02.750684 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e30003-ad3d-410b-acb9-fed8bd33db87 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:02.777143 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f1b8e-eaa0-4440-8907-3cb20bececdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:02.777939 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f1b8e-eaa0-4440-8907-3cb20bececdd None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:02.778256 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f1b8e-eaa0-4440-8907-3cb20bececdd None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:02.778535 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f1b8e-eaa0-4440-8907-3cb20bececdd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:02.790003 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331f1b8e-eaa0-4440-8907-3cb20bececdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:45:02.798353 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-331f1b8e-eaa0-4440-8907-3cb20bececdd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:45:02.798353 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:45:02.798353 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:45:02.798353 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:45:02.798353 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:45:02.798353 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:45:02.798353 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:45:02.798353 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:45:02.798353 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:45:02.798353 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:45:02.798353 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:45:02.798353 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:45:02.798353 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:45:02.798353 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:45:02.798353 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:45:02.798353 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:45:02.799292 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:45:02.799292 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:45:02.799292 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:45:02.799292 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:45:02.799292 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:45:02.799292 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:45:02.799292 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:45:02.799292 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:45:02.799292 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:45:02.799292 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:45:02.799292 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:45:02.799292 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:45:02.799292 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:45:02.799292 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:45:02.799292 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:45:02.799292 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:45:02.800203 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:45:02.800203 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:45:02.800203 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:45:02.800203 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:45:02.800203 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:45:02.800203 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:45:02.800203 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:45:02.800203 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:45:02.800203 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:45:02.800203 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:45:02.800203 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:45:02.800203 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:45:02.800203 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 546/1086] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 1 03:45:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 03:45:02.806322 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f1b8e-eaa0-4440-8907-3cb20bececdd None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:02.853607 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:02.861381 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e30003-ad3d-410b-acb9-fed8bd33db87 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:02.895840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be04b39-c0d4-4829-8965-645a14e8d256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:02.896606 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be04b39-c0d4-4829-8965-645a14e8d256 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:02.896893 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be04b39-c0d4-4829-8965-645a14e8d256 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:02.897175 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be04b39-c0d4-4829-8965-645a14e8d256 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:02.900597 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:02.905474 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be04b39-c0d4-4829-8965-645a14e8d256 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:02.907648 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be04b39-c0d4-4829-8965-645a14e8d256 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:02.921922 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f1b8e-eaa0-4440-8907-3cb20bececdd None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:02.923773 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-7be04b39-c0d4-4829-8965-645a14e8d256 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:45:02.923773 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:45:02.923773 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:45:02.923773 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:45:02.923773 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:45:02.923773 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:45:02.923773 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:45:02.923773 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:45:02.923773 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:45:02.923773 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:45:02.923773 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:45:02.923773 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:45:02.923773 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 03:45:02.923773 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 03:45:02.923773 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 03:45:02.924728 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 03:45:02.924728 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:45:02.924728 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:45:02.924728 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:45:02.924728 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:45:02.924728 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:45:02.924728 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:45:02.924728 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:45:02.924728 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:45:02.924728 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:45:02.924728 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:45:02.924728 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:45:02.924728 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:45:02.924728 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:45:02.924728 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:45:02.924728 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:45:02.924728 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:45:02.925631 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 03:45:02.925631 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 03:45:02.925631 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 03:45:02.925631 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 03:45:02.925631 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 03:45:02.925631 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 03:45:02.925631 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:45:02.925631 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:45:02.925631 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 541/1087] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:45:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 03:45:02.930885 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be04b39-c0d4-4829-8965-645a14e8d256 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:02.961035 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983164c-d9f4-4683-8e07-c0893b447843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:02.961697 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983164c-d9f4-4683-8e07-c0893b447843 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:02.961976 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983164c-d9f4-4683-8e07-c0893b447843 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:02.962502 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983164c-d9f4-4683-8e07-c0893b447843 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:02.962981 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983164c-d9f4-4683-8e07-c0893b447843 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:45:02.963286 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983164c-d9f4-4683-8e07-c0893b447843 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:02.964689 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983164c-d9f4-4683-8e07-c0893b447843 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:02.973885 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 547/1088] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:45:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:45:02.979757 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983164c-d9f4-4683-8e07-c0893b447843 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:03.050158 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be04b39-c0d4-4829-8965-645a14e8d256 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:03.086241 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983164c-d9f4-4683-8e07-c0893b447843 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:03.087782 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732c4aa-f148-444c-b09c-00ce0c35d134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:03.088480 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732c4aa-f148-444c-b09c-00ce0c35d134 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:03.089400 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732c4aa-f148-444c-b09c-00ce0c35d134 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:03.089400 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732c4aa-f148-444c-b09c-00ce0c35d134 None admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:03.089817 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732c4aa-f148-444c-b09c-00ce0c35d134 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:45:03.090134 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732c4aa-f148-444c-b09c-00ce0c35d134 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:03.092139 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732c4aa-f148-444c-b09c-00ce0c35d134 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:03.104678 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 542/1089] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 1 03:45:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:45:03.111159 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732c4aa-f148-444c-b09c-00ce0c35d134 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:03.122945 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa2aaa-78df-4132-bd97-94d466228c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:03.123848 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa2aaa-78df-4132-bd97-94d466228c3d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:03.124184 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa2aaa-78df-4132-bd97-94d466228c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:03.124468 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa2aaa-78df-4132-bd97-94d466228c3d None admin] PATH_INFO: `/v3/users/baf5af994f0c40b1a67954834788406c` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:03.125710 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa2aaa-78df-4132-bd97-94d466228c3d None admin] RBAC: Authorizing `identity:get_user(user_id=baf5af994f0c40b1a67954834788406c)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:03.127162 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa2aaa-78df-4132-bd97-94d466228c3d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:03.128310 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:03.134068 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 548/1090] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:45:02 2022] GET /identity/v3/users/baf5af994f0c40b1a67954834788406c => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:45:03.135998 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa2aaa-78df-4132-bd97-94d466228c3d None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:03.148511 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:03.213849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732c4aa-f148-444c-b09c-00ce0c35d134 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:03.248644 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa2aaa-78df-4132-bd97-94d466228c3d None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:03.252508 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c86a8e-5e33-42f5-935b-a646d4e02e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:03.253172 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c86a8e-5e33-42f5-935b-a646d4e02e5e None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:03.253453 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c86a8e-5e33-42f5-935b-a646d4e02e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:03.253728 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c86a8e-5e33-42f5-935b-a646d4e02e5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:03.254558 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c86a8e-5e33-42f5-935b-a646d4e02e5e None admin] RBAC: Adding query filter params (role.id=43eeddda303844f3850a6e55a673a34f, scope.project.id=da83db15a312499fb627691ae442f233, user.id=2da466ad31d344898f5c838f77d45181) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:45:03.254873 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c86a8e-5e33-42f5-935b-a646d4e02e5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:03.256465 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c86a8e-5e33-42f5-935b-a646d4e02e5e None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:03.263490 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 543/1091] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:45:03 2022] GET /identity/v3/role_assignments?user.id=2da466ad31d344898f5c838f77d45181&scope.project.id=da83db15a312499fb627691ae442f233&role.id=43eeddda303844f3850a6e55a673a34f => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:45:03.292093 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801f1a9-1f1f-4946-8267-57debb785399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:03.293017 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801f1a9-1f1f-4946-8267-57debb785399 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:03.293301 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801f1a9-1f1f-4946-8267-57debb785399 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:03.293622 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801f1a9-1f1f-4946-8267-57debb785399 None admin] PATH_INFO: `/v3/projects/fcca125e0dc542aaaf2587a6abc43711` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:03.295047 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801f1a9-1f1f-4946-8267-57debb785399 None admin] RBAC: Authorizing `identity:get_project(project_id=fcca125e0dc542aaaf2587a6abc43711)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:03.296654 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801f1a9-1f1f-4946-8267-57debb785399 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:03.298780 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 549/1092] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:45:03 2022] GET /identity/v3/projects/fcca125e0dc542aaaf2587a6abc43711 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:45:03.305002 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c86a8e-5e33-42f5-935b-a646d4e02e5e None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:03.394041 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:03.420429 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c86a8e-5e33-42f5-935b-a646d4e02e5e None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:03.461077 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbd953-3a99-4167-b0c2-1fe52d1b950f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:03.461980 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbd953-3a99-4167-b0c2-1fe52d1b950f None admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:03.462266 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbd953-3a99-4167-b0c2-1fe52d1b950f None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:03.462545 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbd953-3a99-4167-b0c2-1fe52d1b950f None admin] PATH_INFO: `/v3/projects/fcca125e0dc542aaaf2587a6abc43711/users/baf5af994f0c40b1a67954834788406c/roles/681755518698445fabd9a8accec13c0f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:03.464596 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffbd953-3a99-4167-b0c2-1fe52d1b950f None admin] RBAC: Authorizing `identity:create_grant(project_id=fcca125e0dc542aaaf2587a6abc43711, user_id=baf5af994f0c40b1a67954834788406c, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:03.466608 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffbd953-3a99-4167-b0c2-1fe52d1b950f None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:03.543839 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 544/1093] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 1 03:45:03 2022] PUT /identity/v3/projects/fcca125e0dc542aaaf2587a6abc43711/users/baf5af994f0c40b1a67954834788406c/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 03:45:04.072494 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70fb25-5e54-40c1-b93b-cc215de706c7 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:04.073017 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70fb25-5e54-40c1-b93b-cc215de706c7 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:04.073102 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70fb25-5e54-40c1-b93b-cc215de706c7 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:04.074457 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 550/1094] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:45:04.079791 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d26fb7-2d31-4115-8996-463e38253674 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:04.080103 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d26fb7-2d31-4115-8996-463e38253674 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:04.080388 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d26fb7-2d31-4115-8996-463e38253674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:04.097328 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-e5d26fb7-2d31-4115-8996-463e38253674 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:45:04.098519 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-e5d26fb7-2d31-4115-8996-463e38253674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:45:04.165777 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 545/1095] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:45:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:45:04.189603 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70fb25-5e54-40c1-b93b-cc215de706c7 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:04.270788 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:04.295201 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70fb25-5e54-40c1-b93b-cc215de706c7 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:04.332975 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ea3b6-8916-46cd-8e77-15332c01a0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:04.333534 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ea3b6-8916-46cd-8e77-15332c01a0e7 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:04.333810 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ea3b6-8916-46cd-8e77-15332c01a0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:04.334083 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ea3b6-8916-46cd-8e77-15332c01a0e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:04.403815 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ea3b6-8916-46cd-8e77-15332c01a0e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:04.405278 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ea3b6-8916-46cd-8e77-15332c01a0e7 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:04.488090 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:04.514420 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 551/1096] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:45:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 03:45:04.519207 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d26fb7-2d31-4115-8996-463e38253674 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:04.587592 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:04.620834 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d26fb7-2d31-4115-8996-463e38253674 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:04.657287 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699cb4f-615b-4678-a962-70fccfcb973c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:04.658104 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699cb4f-615b-4678-a962-70fccfcb973c None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:04.658384 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699cb4f-615b-4678-a962-70fccfcb973c None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:04.658654 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699cb4f-615b-4678-a962-70fccfcb973c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:04.671623 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3699cb4f-615b-4678-a962-70fccfcb973c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:04.673232 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3699cb4f-615b-4678-a962-70fccfcb973c None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:04.693015 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-3699cb4f-615b-4678-a962-70fccfcb973c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:45:04.693015 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:45:04.693015 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:45:04.693015 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:45:04.693015 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:45:04.693015 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:45:04.693015 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:45:04.693015 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:45:04.693015 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:45:04.693015 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:45:04.693015 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:45:04.693015 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:45:04.693015 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:45:04.693015 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:45:04.693015 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:45:04.694203 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:45:04.694203 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:45:04.694203 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:45:04.694203 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:45:04.694203 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:45:04.694203 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:45:04.694203 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:45:04.694203 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:45:04.694203 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:45:04.694203 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:45:04.694203 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:45:04.694203 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:45:04.694203 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:45:04.694203 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:45:04.694203 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:45:04.694203 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:45:04.694203 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:45:04.695341 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:45:04.695341 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:45:04.695341 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:45:04.695341 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:45:04.699240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 546/1097] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:45:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:45:04.700951 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ea3b6-8916-46cd-8e77-15332c01a0e7 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:04.806920 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ea3b6-8916-46cd-8e77-15332c01a0e7 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:04.843875 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba110825-c844-4db0-9104-efc0c4a2ed44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:04.845088 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba110825-c844-4db0-9104-efc0c4a2ed44 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:04.845088 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba110825-c844-4db0-9104-efc0c4a2ed44 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:04.846785 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba110825-c844-4db0-9104-efc0c4a2ed44 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:04.846785 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba110825-c844-4db0-9104-efc0c4a2ed44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:45:04.846785 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba110825-c844-4db0-9104-efc0c4a2ed44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:04.849085 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba110825-c844-4db0-9104-efc0c4a2ed44 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:04.861128 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 552/1098] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:45:05.616762 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf72a0f-ec50-4d86-bf66-93db1fce58a5 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:05.617363 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf72a0f-ec50-4d86-bf66-93db1fce58a5 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:05.617363 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf72a0f-ec50-4d86-bf66-93db1fce58a5 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:05.618831 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 547/1099] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:45:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:45:05.625160 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e2b98-e029-4498-bb6f-629ebba9735c None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:05.625673 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e2b98-e029-4498-bb6f-629ebba9735c None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:05.625762 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e2b98-e029-4498-bb6f-629ebba9735c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:05.644240 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-808e2b98-e029-4498-bb6f-629ebba9735c None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:45:05.645497 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-808e2b98-e029-4498-bb6f-629ebba9735c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:45:05.682663 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:05.727270 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 553/1100] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:45:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:45:05.751563 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf72a0f-ec50-4d86-bf66-93db1fce58a5 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:05.857041 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf72a0f-ec50-4d86-bf66-93db1fce58a5 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:05.881482 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:05.896883 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc479b10-2931-455c-8ec5-87b46f82e89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:05.897679 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc479b10-2931-455c-8ec5-87b46f82e89b None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:05.897960 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc479b10-2931-455c-8ec5-87b46f82e89b None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:05.898235 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc479b10-2931-455c-8ec5-87b46f82e89b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:05.908691 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc479b10-2931-455c-8ec5-87b46f82e89b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:45:05.917153 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-cc479b10-2931-455c-8ec5-87b46f82e89b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:45:05.917153 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:45:05.917153 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:45:05.917153 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:45:05.917153 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:45:05.917153 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:45:05.917153 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:45:05.917153 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:45:05.917153 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:45:05.917153 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:45:05.917153 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:45:05.917153 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:45:05.917153 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:45:05.917153 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:45:05.917153 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:45:05.917153 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:45:05.918364 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:45:05.918364 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:45:05.918364 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:45:05.918364 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:45:05.918364 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:45:05.918364 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:45:05.918364 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:45:05.918364 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:45:05.918364 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:45:05.918364 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:45:05.918364 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:45:05.918364 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:45:05.918364 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:45:05.918364 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:45:05.918364 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:45:05.918364 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:45:05.919479 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:45:05.919479 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:45:05.919479 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:45:05.919479 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:45:05.919479 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:45:05.919479 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:45:05.919479 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:45:05.919479 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:45:05.919479 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:45:05.919479 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:45:05.919479 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:45:05.919479 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:45:05.919479 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 548/1101] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 1 03:45:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:45:05.924725 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e2b98-e029-4498-bb6f-629ebba9735c None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:06.024104 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e2b98-e029-4498-bb6f-629ebba9735c None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:06.062397 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3211b90c-ea0f-48b6-9a8b-490743aa2be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:06.063067 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211b90c-ea0f-48b6-9a8b-490743aa2be0 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:06.063349 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211b90c-ea0f-48b6-9a8b-490743aa2be0 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:06.063655 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211b90c-ea0f-48b6-9a8b-490743aa2be0 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:06.064407 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3211b90c-ea0f-48b6-9a8b-490743aa2be0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:45:06.064716 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3211b90c-ea0f-48b6-9a8b-490743aa2be0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:06.066095 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3211b90c-ea0f-48b6-9a8b-490743aa2be0 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:06.074472 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 554/1102] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:45:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:45:06.081070 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc479b10-2931-455c-8ec5-87b46f82e89b None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:06.182677 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc479b10-2931-455c-8ec5-87b46f82e89b None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:06.217066 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962401d-0aae-405e-b708-4468186cbc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:06.217924 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962401d-0aae-405e-b708-4468186cbc23 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:06.218201 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962401d-0aae-405e-b708-4468186cbc23 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:06.218471 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962401d-0aae-405e-b708-4468186cbc23 None admin] PATH_INFO: `/v3/users/baf5af994f0c40b1a67954834788406c` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:06.219674 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3962401d-0aae-405e-b708-4468186cbc23 None admin] RBAC: Authorizing `identity:get_user(user_id=baf5af994f0c40b1a67954834788406c)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:06.221089 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3962401d-0aae-405e-b708-4468186cbc23 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:06.222699 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 549/1103] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:45:06 2022] GET /identity/v3/users/baf5af994f0c40b1a67954834788406c => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:45:06.228706 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3211b90c-ea0f-48b6-9a8b-490743aa2be0 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:06.261085 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:06.333433 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3211b90c-ea0f-48b6-9a8b-490743aa2be0 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:06.366832 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ab180-f53e-4d71-97ca-9a0012564e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:06.367507 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ab180-f53e-4d71-97ca-9a0012564e1d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:06.367790 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ab180-f53e-4d71-97ca-9a0012564e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:06.368065 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ab180-f53e-4d71-97ca-9a0012564e1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:06.435440 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ab180-f53e-4d71-97ca-9a0012564e1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:06.436852 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ab180-f53e-4d71-97ca-9a0012564e1d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:06.465372 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:06.537857 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 555/1104] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:45:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 03:45:06.544293 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962401d-0aae-405e-b708-4468186cbc23 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:06.592410 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:06.643111 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962401d-0aae-405e-b708-4468186cbc23 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:06.677427 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6720f5-3a10-4fb5-88f6-f9129344f0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:06.678285 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6720f5-3a10-4fb5-88f6-f9129344f0b8 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:06.678566 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6720f5-3a10-4fb5-88f6-f9129344f0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:06.678838 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6720f5-3a10-4fb5-88f6-f9129344f0b8 None admin] PATH_INFO: `/v3/projects/fcca125e0dc542aaaf2587a6abc43711` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:06.680068 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6720f5-3a10-4fb5-88f6-f9129344f0b8 None admin] RBAC: Authorizing `identity:get_project(project_id=fcca125e0dc542aaaf2587a6abc43711)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:06.681486 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6720f5-3a10-4fb5-88f6-f9129344f0b8 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:06.683166 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 550/1105] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:45:06 2022] GET /identity/v3/projects/fcca125e0dc542aaaf2587a6abc43711 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:45:06.689561 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ab180-f53e-4d71-97ca-9a0012564e1d None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:06.793956 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ab180-f53e-4d71-97ca-9a0012564e1d None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:06.821728 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:06.827142 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74224b-ae35-4999-9429-7df73559ac45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:06.827845 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74224b-ae35-4999-9429-7df73559ac45 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:06.828127 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74224b-ae35-4999-9429-7df73559ac45 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:06.828401 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74224b-ae35-4999-9429-7df73559ac45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:06.829226 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb74224b-ae35-4999-9429-7df73559ac45 None admin] RBAC: Adding query filter params (role.id=681755518698445fabd9a8accec13c0f, scope.project.id=fcca125e0dc542aaaf2587a6abc43711, user.id=baf5af994f0c40b1a67954834788406c) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:45:06.829536 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb74224b-ae35-4999-9429-7df73559ac45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:06.830968 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb74224b-ae35-4999-9429-7df73559ac45 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:06.837096 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 556/1106] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:45:06 2022] GET /identity/v3/role_assignments?user.id=baf5af994f0c40b1a67954834788406c&scope.project.id=fcca125e0dc542aaaf2587a6abc43711&role.id=681755518698445fabd9a8accec13c0f => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:45:08.907004 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ce348-8006-44e7-a546-6272f3d97789 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:08.907589 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ce348-8006-44e7-a546-6272f3d97789 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:08.907589 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ce348-8006-44e7-a546-6272f3d97789 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:08.908938 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 551/1107] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:45:08.914426 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61f66b-4fcb-4ab2-9662-f3203c1ffecd None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:08.914863 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61f66b-4fcb-4ab2-9662-f3203c1ffecd None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:08.914957 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61f66b-4fcb-4ab2-9662-f3203c1ffecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:08.931169 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-4d61f66b-4fcb-4ab2-9662-f3203c1ffecd None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:45:08.932378 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-4d61f66b-4fcb-4ab2-9662-f3203c1ffecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:45:08.997740 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 557/1108] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:45:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:45:09.023438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630ce348-8006-44e7-a546-6272f3d97789 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:09.123935 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630ce348-8006-44e7-a546-6272f3d97789 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:09.140093 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:09.156923 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3760075-797d-4fd2-8ad7-00b3d2afaf22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:09.157768 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3760075-797d-4fd2-8ad7-00b3d2afaf22 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:09.157998 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3760075-797d-4fd2-8ad7-00b3d2afaf22 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:09.158272 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3760075-797d-4fd2-8ad7-00b3d2afaf22 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:09.159427 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3760075-797d-4fd2-8ad7-00b3d2afaf22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:09.161196 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3760075-797d-4fd2-8ad7-00b3d2afaf22 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:09.162774 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 552/1109] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:45:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:45:09.168546 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61f66b-4fcb-4ab2-9662-f3203c1ffecd None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:09.264195 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61f66b-4fcb-4ab2-9662-f3203c1ffecd None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:09.286662 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:09.297383 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02c9bc-43a7-49d8-84f4-67101c053b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:09.298053 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02c9bc-43a7-49d8-84f4-67101c053b3a None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:09.298335 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02c9bc-43a7-49d8-84f4-67101c053b3a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:09.298609 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02c9bc-43a7-49d8-84f4-67101c053b3a None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:09.299308 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a02c9bc-43a7-49d8-84f4-67101c053b3a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:09.300770 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a02c9bc-43a7-49d8-84f4-67101c053b3a None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:09.414208 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 558/1110] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Jul 1 03:45:09 2022] POST /identity/v3/users => generated 286 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 03:45:11.470054 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d1ea3-a414-4633-b3de-a9c496d1c99b None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:11.470588 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d1ea3-a414-4633-b3de-a9c496d1c99b None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:11.470588 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d1ea3-a414-4633-b3de-a9c496d1c99b None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:11.472013 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 553/1111] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:45:11.478312 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128fccd-79bd-488c-8a9f-76bd99082048 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:11.478746 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128fccd-79bd-488c-8a9f-76bd99082048 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:11.478859 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128fccd-79bd-488c-8a9f-76bd99082048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:11.496630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-1128fccd-79bd-488c-8a9f-76bd99082048 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:45:11.497848 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1128fccd-79bd-488c-8a9f-76bd99082048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:45:11.564361 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 559/1112] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:45:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:45:11.587469 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d1ea3-a414-4633-b3de-a9c496d1c99b None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:11.692455 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d1ea3-a414-4633-b3de-a9c496d1c99b None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:11.724712 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d6b64c-fb33-428e-b31f-63d510cd4e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:11.725484 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6b64c-fb33-428e-b31f-63d510cd4e39 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:11.725767 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6b64c-fb33-428e-b31f-63d510cd4e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:11.726044 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6b64c-fb33-428e-b31f-63d510cd4e39 None admin] PATH_INFO: `/v3/roles/132287c7d1f9428d9195f2b4ed60756b` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:11.727528 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d6b64c-fb33-428e-b31f-63d510cd4e39 None admin] RBAC: Authorizing `identity:get_role(role_id=132287c7d1f9428d9195f2b4ed60756b)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:11.728887 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d6b64c-fb33-428e-b31f-63d510cd4e39 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:11.730725 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 554/1113] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:45:11 2022] GET /identity/v3/roles/132287c7d1f9428d9195f2b4ed60756b => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:45:11.736507 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1128fccd-79bd-488c-8a9f-76bd99082048 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:11.830542 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1128fccd-79bd-488c-8a9f-76bd99082048 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:11.840792 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:11.862961 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c54dfb-3f3b-4f96-8720-14f2efe8074e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:11.864658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c54dfb-3f3b-4f96-8720-14f2efe8074e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:11.864658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c54dfb-3f3b-4f96-8720-14f2efe8074e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:11.864658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c54dfb-3f3b-4f96-8720-14f2efe8074e None admin] PATH_INFO: `/v3/users/1f8c3ee4247b48419a2d5a5e8fbce731` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:11.878222 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c54dfb-3f3b-4f96-8720-14f2efe8074e None admin] RBAC: Authorizing `identity:get_user(user_id=1f8c3ee4247b48419a2d5a5e8fbce731)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:11.879683 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c54dfb-3f3b-4f96-8720-14f2efe8074e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:11.881785 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 560/1114] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:45:11 2022] GET /identity/v3/users/1f8c3ee4247b48419a2d5a5e8fbce731 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:45:11.887281 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d6b64c-fb33-428e-b31f-63d510cd4e39 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:11.938658 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:11.984253 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d6b64c-fb33-428e-b31f-63d510cd4e39 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:12.016056 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbffed0-b4d4-492b-951d-84b3558ce4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:12.016696 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbffed0-b4d4-492b-951d-84b3558ce4a3 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:12.016974 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbffed0-b4d4-492b-951d-84b3558ce4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:12.017246 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbffed0-b4d4-492b-951d-84b3558ce4a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:12.082441 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbffed0-b4d4-492b-951d-84b3558ce4a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:12.083909 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbffed0-b4d4-492b-951d-84b3558ce4a3 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:12.134906 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:12.182162 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 555/1115] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:45:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 03:45:12.188072 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c54dfb-3f3b-4f96-8720-14f2efe8074e None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:12.284995 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c54dfb-3f3b-4f96-8720-14f2efe8074e None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:12.317044 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e832b9-8a62-4bcd-a7a7-2c37e08655ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:12.317901 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e832b9-8a62-4bcd-a7a7-2c37e08655ff None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:12.318184 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e832b9-8a62-4bcd-a7a7-2c37e08655ff None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:12.318466 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e832b9-8a62-4bcd-a7a7-2c37e08655ff None admin] PATH_INFO: `/v3/projects/fcca125e0dc542aaaf2587a6abc43711` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:12.319655 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e832b9-8a62-4bcd-a7a7-2c37e08655ff None admin] RBAC: Authorizing `identity:get_project(project_id=fcca125e0dc542aaaf2587a6abc43711)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:12.321096 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e832b9-8a62-4bcd-a7a7-2c37e08655ff None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:12.322783 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 561/1116] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:45:12 2022] GET /identity/v3/projects/fcca125e0dc542aaaf2587a6abc43711 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:45:12.329576 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbffed0-b4d4-492b-951d-84b3558ce4a3 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:12.428524 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbffed0-b4d4-492b-951d-84b3558ce4a3 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:12.460883 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad85d4d-d82b-40b9-96c6-8ebcfd0d5f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:12.461526 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad85d4d-d82b-40b9-96c6-8ebcfd0d5f5c None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:12.461804 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad85d4d-d82b-40b9-96c6-8ebcfd0d5f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:12.462075 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad85d4d-d82b-40b9-96c6-8ebcfd0d5f5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:12.462886 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad85d4d-d82b-40b9-96c6-8ebcfd0d5f5c None admin] RBAC: Adding query filter params (role.id=132287c7d1f9428d9195f2b4ed60756b, scope.project.id=fcca125e0dc542aaaf2587a6abc43711, user.id=1f8c3ee4247b48419a2d5a5e8fbce731) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:45:12.463192 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad85d4d-d82b-40b9-96c6-8ebcfd0d5f5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:12.465210 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad85d4d-d82b-40b9-96c6-8ebcfd0d5f5c None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:12.470451 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 556/1117] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:45:12 2022] GET /identity/v3/role_assignments?user.id=1f8c3ee4247b48419a2d5a5e8fbce731&scope.project.id=fcca125e0dc542aaaf2587a6abc43711&role.id=132287c7d1f9428d9195f2b4ed60756b => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:45:14.455836 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2489d1-2589-4a6e-9210-3a3f032a1084 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:14.456386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2489d1-2589-4a6e-9210-3a3f032a1084 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:14.456386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2489d1-2589-4a6e-9210-3a3f032a1084 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:14.457749 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 562/1118] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:45:14.462893 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299abff0-3f86-4ea1-a95a-7789a607f1db None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:14.463291 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299abff0-3f86-4ea1-a95a-7789a607f1db None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:14.463441 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299abff0-3f86-4ea1-a95a-7789a607f1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:14.479775 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-299abff0-3f86-4ea1-a95a-7789a607f1db None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:45:14.481498 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-299abff0-3f86-4ea1-a95a-7789a607f1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:45:14.492442 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:14.548690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 557/1119] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:45:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:45:14.571732 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2489d1-2589-4a6e-9210-3a3f032a1084 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:14.606409 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:14.670017 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2489d1-2589-4a6e-9210-3a3f032a1084 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:14.703314 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c6d311-d327-4e21-8819-046eacd86251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:14.704191 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6d311-d327-4e21-8819-046eacd86251 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:14.704467 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6d311-d327-4e21-8819-046eacd86251 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:14.704741 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6d311-d327-4e21-8819-046eacd86251 None admin] PATH_INFO: `/v3/roles/132287c7d1f9428d9195f2b4ed60756b` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:14.706235 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c6d311-d327-4e21-8819-046eacd86251 None admin] RBAC: Authorizing `identity:get_role(role_id=132287c7d1f9428d9195f2b4ed60756b)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:14.707586 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c6d311-d327-4e21-8819-046eacd86251 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:14.708957 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 563/1120] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:45:14 2022] GET /identity/v3/roles/132287c7d1f9428d9195f2b4ed60756b => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:45:14.714796 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299abff0-3f86-4ea1-a95a-7789a607f1db None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:14.811019 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299abff0-3f86-4ea1-a95a-7789a607f1db None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:14.842990 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf70fb3-2187-420f-8094-07dd437b6f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:14.843882 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf70fb3-2187-420f-8094-07dd437b6f50 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:14.844168 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf70fb3-2187-420f-8094-07dd437b6f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:14.844444 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf70fb3-2187-420f-8094-07dd437b6f50 None admin] PATH_INFO: `/v3/users/1f8c3ee4247b48419a2d5a5e8fbce731` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:14.845606 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf70fb3-2187-420f-8094-07dd437b6f50 None admin] RBAC: Authorizing `identity:get_user(user_id=1f8c3ee4247b48419a2d5a5e8fbce731)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:14.847025 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf70fb3-2187-420f-8094-07dd437b6f50 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:14.848671 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 558/1121] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:45:14 2022] GET /identity/v3/users/1f8c3ee4247b48419a2d5a5e8fbce731 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:45:14.854720 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c6d311-d327-4e21-8819-046eacd86251 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:14.951435 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c6d311-d327-4e21-8819-046eacd86251 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:14.953692 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:14.984186 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a822a-d5d2-469d-8f4d-8cb5c2b23f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:14.984978 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a822a-d5d2-469d-8f4d-8cb5c2b23f5e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:14.985257 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a822a-d5d2-469d-8f4d-8cb5c2b23f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:14.985530 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a822a-d5d2-469d-8f4d-8cb5c2b23f5e None admin] PATH_INFO: `/v3/projects/fcca125e0dc542aaaf2587a6abc43711` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:14.986692 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a822a-d5d2-469d-8f4d-8cb5c2b23f5e None admin] RBAC: Authorizing `identity:get_project(project_id=fcca125e0dc542aaaf2587a6abc43711)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:14.988173 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a822a-d5d2-469d-8f4d-8cb5c2b23f5e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:14.989847 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 564/1122] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:45:14 2022] GET /identity/v3/projects/fcca125e0dc542aaaf2587a6abc43711 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:45:14.996264 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf70fb3-2187-420f-8094-07dd437b6f50 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:15.011429 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:15.092224 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf70fb3-2187-420f-8094-07dd437b6f50 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:15.126508 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95e830-7815-42f4-8858-b026b39bac7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:15.127392 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95e830-7815-42f4-8858-b026b39bac7e None admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:15.127701 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95e830-7815-42f4-8858-b026b39bac7e None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:15.127973 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95e830-7815-42f4-8858-b026b39bac7e None admin] PATH_INFO: `/v3/projects/fcca125e0dc542aaaf2587a6abc43711/users/1f8c3ee4247b48419a2d5a5e8fbce731/roles/132287c7d1f9428d9195f2b4ed60756b` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:15.130162 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac95e830-7815-42f4-8858-b026b39bac7e None admin] RBAC: Authorizing `identity:create_grant(project_id=fcca125e0dc542aaaf2587a6abc43711, user_id=1f8c3ee4247b48419a2d5a5e8fbce731, role_id=132287c7d1f9428d9195f2b4ed60756b)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:15.131623 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac95e830-7815-42f4-8858-b026b39bac7e None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:15.199755 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 559/1123] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 1 03:45:14 2022] PUT /identity/v3/projects/fcca125e0dc542aaaf2587a6abc43711/users/1f8c3ee4247b48419a2d5a5e8fbce731/roles/132287c7d1f9428d9195f2b4ed60756b => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 03:45:17.190665 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7f0fd-a33d-4993-8fe0-b923ca231240 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:17.191238 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7f0fd-a33d-4993-8fe0-b923ca231240 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:17.191238 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7f0fd-a33d-4993-8fe0-b923ca231240 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:17.192618 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 565/1124] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:45:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:45:17.198149 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f7858-8c61-4250-ab3c-8d8b417fae20 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:17.198636 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f7858-8c61-4250-ab3c-8d8b417fae20 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:17.198831 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f7858-8c61-4250-ab3c-8d8b417fae20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:17.216500 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-402f7858-8c61-4250-ab3c-8d8b417fae20 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:45:17.217716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-402f7858-8c61-4250-ab3c-8d8b417fae20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:45:17.288884 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 560/1125] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:45:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:45:17.312567 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f7f0fd-a33d-4993-8fe0-b923ca231240 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:17.412697 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f7f0fd-a33d-4993-8fe0-b923ca231240 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:17.445433 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27598a-1f56-4bbe-b33e-164a132d8c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:17.446210 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27598a-1f56-4bbe-b33e-164a132d8c10 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:17.446486 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27598a-1f56-4bbe-b33e-164a132d8c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:17.446754 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27598a-1f56-4bbe-b33e-164a132d8c10 None admin] PATH_INFO: `/v3/roles/132287c7d1f9428d9195f2b4ed60756b` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:17.448229 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27598a-1f56-4bbe-b33e-164a132d8c10 None admin] RBAC: Authorizing `identity:get_role(role_id=132287c7d1f9428d9195f2b4ed60756b)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:17.450158 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27598a-1f56-4bbe-b33e-164a132d8c10 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:17.451541 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 566/1126] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:45:17 2022] GET /identity/v3/roles/132287c7d1f9428d9195f2b4ed60756b => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:45:17.457331 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f7858-8c61-4250-ab3c-8d8b417fae20 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:17.460476 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:17.555338 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f7858-8c61-4250-ab3c-8d8b417fae20 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:17.588675 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a35ae-683b-4bf0-a374-77b5ba521cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:17.589540 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a35ae-683b-4bf0-a374-77b5ba521cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:17.589824 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a35ae-683b-4bf0-a374-77b5ba521cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:17.590097 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a35ae-683b-4bf0-a374-77b5ba521cc3 None admin] PATH_INFO: `/v3/users/1f8c3ee4247b48419a2d5a5e8fbce731` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:17.591303 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a35ae-683b-4bf0-a374-77b5ba521cc3 None admin] RBAC: Authorizing `identity:get_user(user_id=1f8c3ee4247b48419a2d5a5e8fbce731)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:17.592762 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a35ae-683b-4bf0-a374-77b5ba521cc3 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:17.594617 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 561/1127] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:45:17 2022] GET /identity/v3/users/1f8c3ee4247b48419a2d5a5e8fbce731 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:45:17.600245 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27598a-1f56-4bbe-b33e-164a132d8c10 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:17.641829 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:17.697706 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27598a-1f56-4bbe-b33e-164a132d8c10 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:17.729644 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009cd8f-9509-48c5-893d-e509998145d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:17.730803 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009cd8f-9509-48c5-893d-e509998145d5 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:17.731080 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009cd8f-9509-48c5-893d-e509998145d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:17.731351 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009cd8f-9509-48c5-893d-e509998145d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:17.797109 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3009cd8f-9509-48c5-893d-e509998145d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:17.798568 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3009cd8f-9509-48c5-893d-e509998145d5 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:17.837227 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:17.893885 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 567/1128] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:45:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 03:45:17.899808 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a35ae-683b-4bf0-a374-77b5ba521cc3 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:17.968134 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:17.996497 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a35ae-683b-4bf0-a374-77b5ba521cc3 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:18.029073 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b2b4a-3519-4bfb-a888-64dd02dabea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:18.029915 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b2b4a-3519-4bfb-a888-64dd02dabea8 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:18.030196 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b2b4a-3519-4bfb-a888-64dd02dabea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:18.030469 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b2b4a-3519-4bfb-a888-64dd02dabea8 None admin] PATH_INFO: `/v3/projects/fcca125e0dc542aaaf2587a6abc43711` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:18.031826 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b2b4a-3519-4bfb-a888-64dd02dabea8 None admin] RBAC: Authorizing `identity:get_project(project_id=fcca125e0dc542aaaf2587a6abc43711)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:18.033294 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b2b4a-3519-4bfb-a888-64dd02dabea8 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:18.035220 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 562/1129] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:45:17 2022] GET /identity/v3/projects/fcca125e0dc542aaaf2587a6abc43711 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:45:18.041252 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009cd8f-9509-48c5-893d-e509998145d5 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:18.136693 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009cd8f-9509-48c5-893d-e509998145d5 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:18.170160 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d4b17-e847-4f6a-be28-f932c52e9232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:18.170815 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d4b17-e847-4f6a-be28-f932c52e9232 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:18.171098 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d4b17-e847-4f6a-be28-f932c52e9232 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:18.171374 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d4b17-e847-4f6a-be28-f932c52e9232 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:18.172241 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1d4b17-e847-4f6a-be28-f932c52e9232 None admin] RBAC: Adding query filter params (role.id=132287c7d1f9428d9195f2b4ed60756b, scope.project.id=fcca125e0dc542aaaf2587a6abc43711, user.id=1f8c3ee4247b48419a2d5a5e8fbce731) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:45:18.172556 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1d4b17-e847-4f6a-be28-f932c52e9232 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:18.174005 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1d4b17-e847-4f6a-be28-f932c52e9232 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:18.180121 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 568/1130] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:45:18 2022] GET /identity/v3/role_assignments?user.id=1f8c3ee4247b48419a2d5a5e8fbce731&scope.project.id=fcca125e0dc542aaaf2587a6abc43711&role.id=132287c7d1f9428d9195f2b4ed60756b => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:45:20.209783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96b7c7-2cc9-4995-a0d1-f5a61cad5360 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:20.210314 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96b7c7-2cc9-4995-a0d1-f5a61cad5360 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:20.210402 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96b7c7-2cc9-4995-a0d1-f5a61cad5360 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:20.211725 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 563/1131] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:45:20.216825 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83690f-3b87-4b7a-a25e-17f1b9ede6b3 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:20.217252 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83690f-3b87-4b7a-a25e-17f1b9ede6b3 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:20.217371 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83690f-3b87-4b7a-a25e-17f1b9ede6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:20.223209 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:20.233669 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-3c83690f-3b87-4b7a-a25e-17f1b9ede6b3 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:45:20.235008 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-3c83690f-3b87-4b7a-a25e-17f1b9ede6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:45:20.300085 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 569/1132] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:45:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:45:20.325477 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96b7c7-2cc9-4995-a0d1-f5a61cad5360 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:20.427986 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96b7c7-2cc9-4995-a0d1-f5a61cad5360 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:20.462016 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3ed44-cc5c-4bd4-8c72-8c47430d5c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:20.462735 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3ed44-cc5c-4bd4-8c72-8c47430d5c0c None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:20.463014 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3ed44-cc5c-4bd4-8c72-8c47430d5c0c None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:20.463290 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3ed44-cc5c-4bd4-8c72-8c47430d5c0c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:20.464543 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d3ed44-cc5c-4bd4-8c72-8c47430d5c0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:20.465976 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d3ed44-cc5c-4bd4-8c72-8c47430d5c0c None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:20.472486 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 564/1133] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:45:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:45:20.473591 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83690f-3b87-4b7a-a25e-17f1b9ede6b3 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:20.572925 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83690f-3b87-4b7a-a25e-17f1b9ede6b3 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:20.605395 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d029781-d1af-4618-9be3-42140e8036c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:20.606044 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d029781-d1af-4618-9be3-42140e8036c8 None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:20.606323 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d029781-d1af-4618-9be3-42140e8036c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:20.606593 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d029781-d1af-4618-9be3-42140e8036c8 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:20.607279 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d029781-d1af-4618-9be3-42140e8036c8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:20.608733 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d029781-d1af-4618-9be3-42140e8036c8 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:20.612016 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:20.716851 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 570/1134] 10.222.0.46 () {60 vars in 1141 bytes} [Fri Jul 1 03:45:20 2022] POST /identity/v3/projects => generated 311 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 03:45:22.767270 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f358d-6f5b-41be-adc0-b9eaacd8d89d None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:22.767832 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f358d-6f5b-41be-adc0-b9eaacd8d89d None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:22.767832 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f358d-6f5b-41be-adc0-b9eaacd8d89d None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:22.769090 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 565/1135] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:45:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:45:22.774189 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805a0eb-f99b-4665-b6b6-7db5dfa85991 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:22.774562 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805a0eb-f99b-4665-b6b6-7db5dfa85991 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:22.774746 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805a0eb-f99b-4665-b6b6-7db5dfa85991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:22.791328 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-5805a0eb-f99b-4665-b6b6-7db5dfa85991 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:45:22.793032 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-5805a0eb-f99b-4665-b6b6-7db5dfa85991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:45:22.857771 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 571/1136] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:45:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:45:22.882777 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f358d-6f5b-41be-adc0-b9eaacd8d89d None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:22.893505 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:22.981550 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f358d-6f5b-41be-adc0-b9eaacd8d89d None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:23.014527 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed38deb-966a-41a2-ab16-29db980ebd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:23.015307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed38deb-966a-41a2-ab16-29db980ebd0c None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:23.015625 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed38deb-966a-41a2-ab16-29db980ebd0c None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:23.015906 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed38deb-966a-41a2-ab16-29db980ebd0c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:23.017073 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed38deb-966a-41a2-ab16-29db980ebd0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:23.018548 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed38deb-966a-41a2-ab16-29db980ebd0c None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:23.020112 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 566/1137] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:45:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:45:23.025953 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805a0eb-f99b-4665-b6b6-7db5dfa85991 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:23.120811 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805a0eb-f99b-4665-b6b6-7db5dfa85991 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:23.136462 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:23.153668 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c39db-a6be-4b54-bf38-8c3cad430208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:23.154331 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c39db-a6be-4b54-bf38-8c3cad430208 None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:23.154615 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c39db-a6be-4b54-bf38-8c3cad430208 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:23.154891 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c39db-a6be-4b54-bf38-8c3cad430208 None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:23.155633 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358c39db-a6be-4b54-bf38-8c3cad430208 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:23.157147 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358c39db-a6be-4b54-bf38-8c3cad430208 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:23.279026 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 572/1138] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Jul 1 03:45:23 2022] POST /identity/v3/users => generated 286 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 03:45:25.357437 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a427bf0-8a06-453a-af8e-5e2dc60d9f7d None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:25.357952 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a427bf0-8a06-453a-af8e-5e2dc60d9f7d None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:25.358043 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a427bf0-8a06-453a-af8e-5e2dc60d9f7d None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:25.359319 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 567/1139] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:45:25.364539 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ac62e-f016-4e1e-8f7a-87825801b18f None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:25.364947 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ac62e-f016-4e1e-8f7a-87825801b18f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:25.365088 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ac62e-f016-4e1e-8f7a-87825801b18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:25.381893 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-888ac62e-f016-4e1e-8f7a-87825801b18f None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:45:25.383070 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-888ac62e-f016-4e1e-8f7a-87825801b18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:45:25.449147 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 573/1140] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:45:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:45:25.490924 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a427bf0-8a06-453a-af8e-5e2dc60d9f7d None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:25.575200 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:25.598938 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a427bf0-8a06-453a-af8e-5e2dc60d9f7d None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:25.634396 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7526d79-9394-47f5-9526-326f77b193b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:25.635109 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7526d79-9394-47f5-9526-326f77b193b4 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:25.635986 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7526d79-9394-47f5-9526-326f77b193b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:25.636262 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7526d79-9394-47f5-9526-326f77b193b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:25.646373 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7526d79-9394-47f5-9526-326f77b193b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:45:25.654045 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-d7526d79-9394-47f5-9526-326f77b193b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:45:25.654045 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:45:25.654045 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:45:25.654045 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:45:25.654045 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:45:25.654045 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:45:25.654045 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:45:25.654045 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:45:25.654045 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:45:25.654045 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:45:25.654045 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:45:25.654045 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:45:25.654045 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:45:25.654045 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:45:25.654045 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:45:25.654045 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:45:25.655140 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:45:25.655140 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:45:25.655140 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:45:25.655140 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:45:25.655140 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:45:25.655140 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:45:25.655140 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:45:25.655140 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:45:25.655140 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:45:25.655140 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:45:25.655140 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:45:25.655140 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:45:25.655140 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:45:25.655140 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:45:25.655140 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:45:25.655140 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:45:25.656441 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:45:25.656441 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:45:25.656441 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:45:25.656441 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:45:25.656441 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:45:25.656441 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:45:25.656441 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:45:25.656441 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:45:25.656441 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:45:25.656441 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:45:25.656441 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:45:25.656441 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:45:25.656441 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 568/1141] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 1 03:45:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:45:25.661633 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ac62e-f016-4e1e-8f7a-87825801b18f None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:25.762968 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ac62e-f016-4e1e-8f7a-87825801b18f None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:25.764519 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:25.796568 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5169981-a55c-4d66-b28d-ec7675c532c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:25.797233 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5169981-a55c-4d66-b28d-ec7675c532c6 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:25.797516 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5169981-a55c-4d66-b28d-ec7675c532c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:25.797792 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5169981-a55c-4d66-b28d-ec7675c532c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:25.798531 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5169981-a55c-4d66-b28d-ec7675c532c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:45:25.798839 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5169981-a55c-4d66-b28d-ec7675c532c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:25.800280 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5169981-a55c-4d66-b28d-ec7675c532c6 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:25.809505 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 574/1142] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:45:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:45:25.815344 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7526d79-9394-47f5-9526-326f77b193b4 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:25.911835 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7526d79-9394-47f5-9526-326f77b193b4 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:25.945005 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7cd978-4739-4f65-b1a4-0aa806cd0295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:25.945871 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cd978-4739-4f65-b1a4-0aa806cd0295 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:25.946149 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cd978-4739-4f65-b1a4-0aa806cd0295 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:25.946423 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cd978-4739-4f65-b1a4-0aa806cd0295 None admin] PATH_INFO: `/v3/users/4ce6d82a73ce4964ae7e7a959a2d5bc6` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:25.949150 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:25.960116 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7cd978-4739-4f65-b1a4-0aa806cd0295 None admin] RBAC: Authorizing `identity:get_user(user_id=4ce6d82a73ce4964ae7e7a959a2d5bc6)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:25.961554 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7cd978-4739-4f65-b1a4-0aa806cd0295 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:25.963213 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 569/1143] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:45:25 2022] GET /identity/v3/users/4ce6d82a73ce4964ae7e7a959a2d5bc6 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:45:25.969082 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5169981-a55c-4d66-b28d-ec7675c532c6 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:26.067343 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5169981-a55c-4d66-b28d-ec7675c532c6 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:26.099552 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4ed5d-2a0f-428b-85f3-6d036a6a2db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:26.100206 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4ed5d-2a0f-428b-85f3-6d036a6a2db2 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:26.103018 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4ed5d-2a0f-428b-85f3-6d036a6a2db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:26.103018 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4ed5d-2a0f-428b-85f3-6d036a6a2db2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:26.132448 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:26.169536 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a4ed5d-2a0f-428b-85f3-6d036a6a2db2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:26.171013 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a4ed5d-2a0f-428b-85f3-6d036a6a2db2 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:26.267167 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 575/1144] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:45:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 03:45:26.273154 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7cd978-4739-4f65-b1a4-0aa806cd0295 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:26.369596 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7cd978-4739-4f65-b1a4-0aa806cd0295 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:26.401751 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1adca9-19b9-4b08-8b18-488f897881d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:26.402618 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1adca9-19b9-4b08-8b18-488f897881d5 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:26.402898 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1adca9-19b9-4b08-8b18-488f897881d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:26.403169 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1adca9-19b9-4b08-8b18-488f897881d5 None admin] PATH_INFO: `/v3/projects/5002ec70f6e44a48ad02a8ba38a0a1f7` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:26.404357 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1adca9-19b9-4b08-8b18-488f897881d5 None admin] RBAC: Authorizing `identity:get_project(project_id=5002ec70f6e44a48ad02a8ba38a0a1f7)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:26.405783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1adca9-19b9-4b08-8b18-488f897881d5 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:26.407439 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 570/1145] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:45:26 2022] GET /identity/v3/projects/5002ec70f6e44a48ad02a8ba38a0a1f7 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:45:26.413824 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4ed5d-2a0f-428b-85f3-6d036a6a2db2 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:26.473669 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:26.511164 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4ed5d-2a0f-428b-85f3-6d036a6a2db2 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:26.545340 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c73f61-2a1d-4618-b37a-2d5cc41b0128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:26.546015 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c73f61-2a1d-4618-b37a-2d5cc41b0128 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:26.546295 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c73f61-2a1d-4618-b37a-2d5cc41b0128 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:26.546569 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c73f61-2a1d-4618-b37a-2d5cc41b0128 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:26.547387 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c73f61-2a1d-4618-b37a-2d5cc41b0128 None admin] RBAC: Adding query filter params (role.id=681755518698445fabd9a8accec13c0f, scope.project.id=5002ec70f6e44a48ad02a8ba38a0a1f7, user.id=4ce6d82a73ce4964ae7e7a959a2d5bc6) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:45:26.547726 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c73f61-2a1d-4618-b37a-2d5cc41b0128 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:26.549154 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c73f61-2a1d-4618-b37a-2d5cc41b0128 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:26.554535 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 576/1146] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:45:26 2022] GET /identity/v3/role_assignments?user.id=4ce6d82a73ce4964ae7e7a959a2d5bc6&scope.project.id=5002ec70f6e44a48ad02a8ba38a0a1f7&role.id=681755518698445fabd9a8accec13c0f => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:45:28.564071 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3376cba-3feb-4ede-bd5f-61691a4dfd47 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:28.564667 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3376cba-3feb-4ede-bd5f-61691a4dfd47 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:28.564667 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3376cba-3feb-4ede-bd5f-61691a4dfd47 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:28.566022 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 571/1147] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:45:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:45:28.572050 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf516b-120b-4336-b574-e70f7403afe1 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:28.573158 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf516b-120b-4336-b574-e70f7403afe1 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:28.573270 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf516b-120b-4336-b574-e70f7403afe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:28.590775 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-4eaf516b-120b-4336-b574-e70f7403afe1 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:45:28.592015 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-4eaf516b-120b-4336-b574-e70f7403afe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:45:28.659716 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 577/1148] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:45:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:45:28.683070 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3376cba-3feb-4ede-bd5f-61691a4dfd47 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:28.746005 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:28.783936 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3376cba-3feb-4ede-bd5f-61691a4dfd47 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:28.826294 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f79943-3058-4e9e-b05c-4a66f2624758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:28.827077 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f79943-3058-4e9e-b05c-4a66f2624758 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:28.827355 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f79943-3058-4e9e-b05c-4a66f2624758 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:28.827654 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f79943-3058-4e9e-b05c-4a66f2624758 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:28.837417 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f79943-3058-4e9e-b05c-4a66f2624758 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:45:28.845002 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-f8f79943-3058-4e9e-b05c-4a66f2624758 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:45:28.845002 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:45:28.845002 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:45:28.845002 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:45:28.845002 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:45:28.845002 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:45:28.845002 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:45:28.845002 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:45:28.845002 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:45:28.845002 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:45:28.845002 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:45:28.845002 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:45:28.845002 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:45:28.845002 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:45:28.845002 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:45:28.845002 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:45:28.846084 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:45:28.846084 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:45:28.846084 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:45:28.846084 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:45:28.846084 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:45:28.846084 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:45:28.846084 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:45:28.846084 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:45:28.846084 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:45:28.846084 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:45:28.846084 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:45:28.846084 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:45:28.846084 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:45:28.846084 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:45:28.846084 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:45:28.846084 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:45:28.847307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:45:28.847307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:45:28.847307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:45:28.847307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:45:28.847307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:45:28.847307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:45:28.847307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:45:28.847307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:45:28.847307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:45:28.847307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:45:28.847307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:45:28.847307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:45:28.847307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 572/1149] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 1 03:45:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:45:28.852538 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf516b-120b-4336-b574-e70f7403afe1 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:28.909773 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:28.951058 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf516b-120b-4336-b574-e70f7403afe1 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:28.984054 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8561b929-8111-43c1-ab7e-481f5be323c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:28.984714 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561b929-8111-43c1-ab7e-481f5be323c4 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:28.984996 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561b929-8111-43c1-ab7e-481f5be323c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:28.985273 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561b929-8111-43c1-ab7e-481f5be323c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:28.986017 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8561b929-8111-43c1-ab7e-481f5be323c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:45:28.986325 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8561b929-8111-43c1-ab7e-481f5be323c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:28.987717 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8561b929-8111-43c1-ab7e-481f5be323c4 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:28.996277 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 578/1150] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:45:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:45:29.002360 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f79943-3058-4e9e-b05c-4a66f2624758 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:29.097458 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f79943-3058-4e9e-b05c-4a66f2624758 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:29.118701 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:29.130348 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86744604-37ca-4b53-9c39-62cf118cc84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:29.131249 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86744604-37ca-4b53-9c39-62cf118cc84a None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:29.131557 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86744604-37ca-4b53-9c39-62cf118cc84a None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:29.131831 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86744604-37ca-4b53-9c39-62cf118cc84a None admin] PATH_INFO: `/v3/users/4ce6d82a73ce4964ae7e7a959a2d5bc6` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:29.132995 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86744604-37ca-4b53-9c39-62cf118cc84a None admin] RBAC: Authorizing `identity:get_user(user_id=4ce6d82a73ce4964ae7e7a959a2d5bc6)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:29.134418 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86744604-37ca-4b53-9c39-62cf118cc84a None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:29.136156 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 573/1151] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:45:29 2022] GET /identity/v3/users/4ce6d82a73ce4964ae7e7a959a2d5bc6 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:45:29.142472 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8561b929-8111-43c1-ab7e-481f5be323c4 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:29.239639 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8561b929-8111-43c1-ab7e-481f5be323c4 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:29.258167 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:29.271439 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec741c1a-67a4-4fa8-9d4b-25e2bd399b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:29.272323 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec741c1a-67a4-4fa8-9d4b-25e2bd399b46 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:29.272608 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec741c1a-67a4-4fa8-9d4b-25e2bd399b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:29.272884 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec741c1a-67a4-4fa8-9d4b-25e2bd399b46 None admin] PATH_INFO: `/v3/projects/5002ec70f6e44a48ad02a8ba38a0a1f7` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:29.274046 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec741c1a-67a4-4fa8-9d4b-25e2bd399b46 None admin] RBAC: Authorizing `identity:get_project(project_id=5002ec70f6e44a48ad02a8ba38a0a1f7)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:29.276009 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec741c1a-67a4-4fa8-9d4b-25e2bd399b46 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:29.277714 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 579/1152] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:45:29 2022] GET /identity/v3/projects/5002ec70f6e44a48ad02a8ba38a0a1f7 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:45:29.283955 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86744604-37ca-4b53-9c39-62cf118cc84a None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:29.379464 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86744604-37ca-4b53-9c39-62cf118cc84a None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:29.411888 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b020520-7a73-40cf-af72-096604cbe3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:29.412766 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b020520-7a73-40cf-af72-096604cbe3ce None admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:29.413047 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b020520-7a73-40cf-af72-096604cbe3ce None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:29.413321 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b020520-7a73-40cf-af72-096604cbe3ce None admin] PATH_INFO: `/v3/projects/5002ec70f6e44a48ad02a8ba38a0a1f7/users/4ce6d82a73ce4964ae7e7a959a2d5bc6/roles/681755518698445fabd9a8accec13c0f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:29.415249 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b020520-7a73-40cf-af72-096604cbe3ce None admin] RBAC: Authorizing `identity:create_grant(project_id=5002ec70f6e44a48ad02a8ba38a0a1f7, user_id=4ce6d82a73ce4964ae7e7a959a2d5bc6, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:29.417319 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b020520-7a73-40cf-af72-096604cbe3ce None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:29.518917 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 574/1153] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 1 03:45:29 2022] PUT /identity/v3/projects/5002ec70f6e44a48ad02a8ba38a0a1f7/users/4ce6d82a73ce4964ae7e7a959a2d5bc6/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 03:45:31.524851 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480a569-2463-4961-8c80-eaa4c9d03f80 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:31.525794 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480a569-2463-4961-8c80-eaa4c9d03f80 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:31.525895 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480a569-2463-4961-8c80-eaa4c9d03f80 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:31.527272 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 580/1154] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:45:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:45:31.532347 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9c087-87f0-4bd2-a8c3-7f2910021646 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:31.532779 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9c087-87f0-4bd2-a8c3-7f2910021646 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:31.532899 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9c087-87f0-4bd2-a8c3-7f2910021646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:31.550167 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-0eb9c087-87f0-4bd2-a8c3-7f2910021646 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:45:31.551351 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-0eb9c087-87f0-4bd2-a8c3-7f2910021646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:45:31.595963 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:31.618214 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 575/1155] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:45:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:45:31.642854 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480a569-2463-4961-8c80-eaa4c9d03f80 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:31.752548 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480a569-2463-4961-8c80-eaa4c9d03f80 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:31.788219 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d455b27-6e9e-474a-b288-541bd79e5003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:31.788977 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d455b27-6e9e-474a-b288-541bd79e5003 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:31.789258 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d455b27-6e9e-474a-b288-541bd79e5003 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:31.789533 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d455b27-6e9e-474a-b288-541bd79e5003 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:31.800507 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d455b27-6e9e-474a-b288-541bd79e5003 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:45:31.808101 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-3d455b27-6e9e-474a-b288-541bd79e5003 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:45:31.808101 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:45:31.808101 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:45:31.808101 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:45:31.808101 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:45:31.808101 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:45:31.808101 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:45:31.808101 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:45:31.808101 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:45:31.808101 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:45:31.808101 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:45:31.808101 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:45:31.808101 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:45:31.808101 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:45:31.808101 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:45:31.808101 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:45:31.809258 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:45:31.809258 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:45:31.809258 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:45:31.809258 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:45:31.809258 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:45:31.809258 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:45:31.809258 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:45:31.809258 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:45:31.809258 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:45:31.809258 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:45:31.809258 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:45:31.809258 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:45:31.809258 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:45:31.809258 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:45:31.809258 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:45:31.809258 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:45:31.810290 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:45:31.810290 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:45:31.810290 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:45:31.810290 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:45:31.810290 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:45:31.810290 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:45:31.810290 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:45:31.810290 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:45:31.810290 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:45:31.810290 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:45:31.810290 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:45:31.810290 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:45:31.810290 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 581/1156] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 1 03:45:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:45:31.815397 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9c087-87f0-4bd2-a8c3-7f2910021646 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:31.912665 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9c087-87f0-4bd2-a8c3-7f2910021646 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:31.946163 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61219d29-10da-4ee5-b41b-d2f0ab3f54c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:31.946819 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61219d29-10da-4ee5-b41b-d2f0ab3f54c8 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:31.947626 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61219d29-10da-4ee5-b41b-d2f0ab3f54c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:31.947901 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61219d29-10da-4ee5-b41b-d2f0ab3f54c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:31.948638 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61219d29-10da-4ee5-b41b-d2f0ab3f54c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:45:31.948942 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61219d29-10da-4ee5-b41b-d2f0ab3f54c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:31.950302 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61219d29-10da-4ee5-b41b-d2f0ab3f54c8 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:31.958077 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 576/1157] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:45:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:45:31.964451 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d455b27-6e9e-474a-b288-541bd79e5003 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:32.012239 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:32.061558 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d455b27-6e9e-474a-b288-541bd79e5003 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:32.095978 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5a22c-191c-440e-8f0b-8b888ae5b061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:32.099334 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5a22c-191c-440e-8f0b-8b888ae5b061 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:32.099334 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5a22c-191c-440e-8f0b-8b888ae5b061 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:32.099334 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5a22c-191c-440e-8f0b-8b888ae5b061 None admin] PATH_INFO: `/v3/users/4ce6d82a73ce4964ae7e7a959a2d5bc6` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:32.099334 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5a22c-191c-440e-8f0b-8b888ae5b061 None admin] RBAC: Authorizing `identity:get_user(user_id=4ce6d82a73ce4964ae7e7a959a2d5bc6)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:32.100002 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5a22c-191c-440e-8f0b-8b888ae5b061 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:32.101607 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 582/1158] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:45:31 2022] GET /identity/v3/users/4ce6d82a73ce4964ae7e7a959a2d5bc6 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:45:32.107494 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61219d29-10da-4ee5-b41b-d2f0ab3f54c8 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:32.151130 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:32.206487 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61219d29-10da-4ee5-b41b-d2f0ab3f54c8 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:32.238397 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8f50a-5e8c-4499-b7a9-e0d73efdcb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:32.239039 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8f50a-5e8c-4499-b7a9-e0d73efdcb60 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:32.239321 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8f50a-5e8c-4499-b7a9-e0d73efdcb60 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:32.239627 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8f50a-5e8c-4499-b7a9-e0d73efdcb60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:32.304488 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee8f50a-5e8c-4499-b7a9-e0d73efdcb60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:32.305921 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee8f50a-5e8c-4499-b7a9-e0d73efdcb60 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:32.347034 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:32.403816 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 577/1159] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:45:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 03:45:32.409999 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5a22c-191c-440e-8f0b-8b888ae5b061 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:32.506233 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5a22c-191c-440e-8f0b-8b888ae5b061 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:32.522359 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:32.541328 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f39faf-582b-4a91-853c-d74bf581daed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:32.542195 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f39faf-582b-4a91-853c-d74bf581daed None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:32.542479 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f39faf-582b-4a91-853c-d74bf581daed None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:32.542756 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f39faf-582b-4a91-853c-d74bf581daed None admin] PATH_INFO: `/v3/projects/5002ec70f6e44a48ad02a8ba38a0a1f7` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:32.543976 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f39faf-582b-4a91-853c-d74bf581daed None admin] RBAC: Authorizing `identity:get_project(project_id=5002ec70f6e44a48ad02a8ba38a0a1f7)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:32.545446 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f39faf-582b-4a91-853c-d74bf581daed None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:32.547375 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 583/1160] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:45:32 2022] GET /identity/v3/projects/5002ec70f6e44a48ad02a8ba38a0a1f7 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:45:32.553632 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8f50a-5e8c-4499-b7a9-e0d73efdcb60 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:32.649243 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8f50a-5e8c-4499-b7a9-e0d73efdcb60 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:32.682910 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375e5bd-5118-4a7a-8740-cb2e0a2f871d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:32.683587 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375e5bd-5118-4a7a-8740-cb2e0a2f871d None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:32.683870 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375e5bd-5118-4a7a-8740-cb2e0a2f871d None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:32.684142 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375e5bd-5118-4a7a-8740-cb2e0a2f871d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:32.684969 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1375e5bd-5118-4a7a-8740-cb2e0a2f871d None admin] RBAC: Adding query filter params (role.id=681755518698445fabd9a8accec13c0f, scope.project.id=5002ec70f6e44a48ad02a8ba38a0a1f7, user.id=4ce6d82a73ce4964ae7e7a959a2d5bc6) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:45:32.685279 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1375e5bd-5118-4a7a-8740-cb2e0a2f871d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:32.686704 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1375e5bd-5118-4a7a-8740-cb2e0a2f871d None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:32.692593 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 578/1161] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:45:32 2022] GET /identity/v3/role_assignments?user.id=4ce6d82a73ce4964ae7e7a959a2d5bc6&scope.project.id=5002ec70f6e44a48ad02a8ba38a0a1f7&role.id=681755518698445fabd9a8accec13c0f => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:45:34.748164 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b1804-c4ee-4f1c-b543-d6f75764c0ea None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:34.748718 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b1804-c4ee-4f1c-b543-d6f75764c0ea None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:34.748718 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b1804-c4ee-4f1c-b543-d6f75764c0ea None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:34.750096 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 584/1162] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:45:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:45:34.755269 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5812d14-5bf4-415a-aa36-257a787de450 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:34.755718 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5812d14-5bf4-415a-aa36-257a787de450 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:34.755853 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5812d14-5bf4-415a-aa36-257a787de450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:34.767322 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:34.773178 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-b5812d14-5bf4-415a-aa36-257a787de450 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:45:34.774369 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-b5812d14-5bf4-415a-aa36-257a787de450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:45:34.840939 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 579/1163] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:45:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:45:34.863234 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b1804-c4ee-4f1c-b543-d6f75764c0ea None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:34.963987 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b1804-c4ee-4f1c-b543-d6f75764c0ea None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:34.995983 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556fee10-d34f-4e28-a3c0-fc7644e2dcc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:34.996625 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fee10-d34f-4e28-a3c0-fc7644e2dcc4 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:34.996906 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fee10-d34f-4e28-a3c0-fc7644e2dcc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:34.997183 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fee10-d34f-4e28-a3c0-fc7644e2dcc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:35.047137 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:35.061875 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556fee10-d34f-4e28-a3c0-fc7644e2dcc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:35.066123 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556fee10-d34f-4e28-a3c0-fc7644e2dcc4 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:35.159104 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 585/1164] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:45:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 03:45:35.165034 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5812d14-5bf4-415a-aa36-257a787de450 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:35.260116 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5812d14-5bf4-415a-aa36-257a787de450 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:35.292528 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdadb76-ccaf-40ea-8d86-3fd149f91883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:35.293296 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdadb76-ccaf-40ea-8d86-3fd149f91883 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:35.293573 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdadb76-ccaf-40ea-8d86-3fd149f91883 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:35.293841 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdadb76-ccaf-40ea-8d86-3fd149f91883 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:35.296433 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:35.300722 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdadb76-ccaf-40ea-8d86-3fd149f91883 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:35.302149 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdadb76-ccaf-40ea-8d86-3fd149f91883 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:35.317461 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-3fdadb76-ccaf-40ea-8d86-3fd149f91883 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 01 03:45:35.317461 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:45:35.317461 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 01 03:45:35.317461 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 01 03:45:35.317461 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 03:45:35.317461 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 03:45:35.317461 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 03:45:35.317461 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 03:45:35.317461 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 01 03:45:35.317461 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:45:35.317461 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 03:45:35.317461 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:45:35.317461 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:45:35.317461 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:45:35.317461 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:45:35.317461 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:45:35.317461 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:45:35.318749 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:45:35.318749 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:45:35.318749 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:45:35.318749 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:45:35.318749 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:45:35.318749 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:45:35.318749 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:45:35.318749 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:45:35.318749 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:45:35.318749 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:45:35.318749 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:45:35.318749 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:45:35.318749 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:45:35.318749 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:45:35.318749 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:45:35.318749 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:45:35.319709 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:45:35.319709 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:45:35.319709 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:45:35.319709 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:45:35.319709 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:45:35.319709 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:45:35.319709 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:45:35.319709 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:45:35.319709 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:45:35.319709 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:45:35.319709 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 01 03:45:35.319709 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:45:35.319709 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 01 03:45:35.319709 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:45:35.319709 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 580/1165] 10.222.0.46 () {56 vars in 1117 bytes} [Fri Jul 1 03:45:35 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:45:35.325198 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556fee10-d34f-4e28-a3c0-fc7644e2dcc4 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:35.405190 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:35.420329 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556fee10-d34f-4e28-a3c0-fc7644e2dcc4 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:35.454394 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35cfd5-d7bd-47d6-a553-86d1d5c34340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:35.455051 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35cfd5-d7bd-47d6-a553-86d1d5c34340 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:35.455332 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35cfd5-d7bd-47d6-a553-86d1d5c34340 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:35.455637 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35cfd5-d7bd-47d6-a553-86d1d5c34340 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:35.456355 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35cfd5-d7bd-47d6-a553-86d1d5c34340 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:45:35.456664 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35cfd5-d7bd-47d6-a553-86d1d5c34340 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:35.458041 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35cfd5-d7bd-47d6-a553-86d1d5c34340 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:35.465158 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 586/1166] 10.222.0.46 () {56 vars in 1115 bytes} [Fri Jul 1 03:45:35 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:45:37.475815 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fc425-cbd7-4932-a068-4ff057adc4e2 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:37.476366 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fc425-cbd7-4932-a068-4ff057adc4e2 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:37.476366 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fc425-cbd7-4932-a068-4ff057adc4e2 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:37.477714 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 581/1167] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:45:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:45:37.483432 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385c888-4e29-4557-83e5-df615e44c4c8 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:37.483921 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385c888-4e29-4557-83e5-df615e44c4c8 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:37.484017 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385c888-4e29-4557-83e5-df615e44c4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:37.500296 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-6385c888-4e29-4557-83e5-df615e44c4c8 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:45:37.501471 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-6385c888-4e29-4557-83e5-df615e44c4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:45:37.567045 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 587/1168] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:45:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:45:37.590034 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2fc425-cbd7-4932-a068-4ff057adc4e2 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:37.689375 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2fc425-cbd7-4932-a068-4ff057adc4e2 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:37.722680 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c731d741-2b40-4f15-b20f-1dbd7314c6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:37.723333 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731d741-2b40-4f15-b20f-1dbd7314c6ec None admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:37.723647 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731d741-2b40-4f15-b20f-1dbd7314c6ec None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:37.723918 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731d741-2b40-4f15-b20f-1dbd7314c6ec None admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:37.724655 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c731d741-2b40-4f15-b20f-1dbd7314c6ec None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:37.726049 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c731d741-2b40-4f15-b20f-1dbd7314c6ec None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:37.806334 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 582/1169] 10.222.0.46 () {60 vars in 1138 bytes} [Fri Jul 1 03:45:37 2022] POST /identity/v3/domains => generated 267 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 03:45:39.855978 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ccf30-8772-4c6c-a192-d8d050484cd9 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:39.856484 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ccf30-8772-4c6c-a192-d8d050484cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:39.856484 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ccf30-8772-4c6c-a192-d8d050484cd9 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:39.857820 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 588/1170] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:45:39.862829 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244962fd-79c8-46a2-8081-ec2c39d59e17 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:39.863236 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244962fd-79c8-46a2-8081-ec2c39d59e17 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:39.863381 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244962fd-79c8-46a2-8081-ec2c39d59e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:39.879802 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-244962fd-79c8-46a2-8081-ec2c39d59e17 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:45:39.880976 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-244962fd-79c8-46a2-8081-ec2c39d59e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:45:39.929445 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:39.945090 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 583/1171] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:45:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:45:39.968919 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ccf30-8772-4c6c-a192-d8d050484cd9 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:40.047216 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:40.068320 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ccf30-8772-4c6c-a192-d8d050484cd9 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:40.101902 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b603b34-2669-4906-81c7-93d21e99504a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:40.103341 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b603b34-2669-4906-81c7-93d21e99504a None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:40.103341 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b603b34-2669-4906-81c7-93d21e99504a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:40.103341 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b603b34-2669-4906-81c7-93d21e99504a None admin] PATH_INFO: `/v3/domains/d208e0d672ab4444a58510439d3590de` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:40.113604 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b603b34-2669-4906-81c7-93d21e99504a None admin] RBAC: Authorizing `identity:get_domain(domain_id=d208e0d672ab4444a58510439d3590de)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:40.115031 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b603b34-2669-4906-81c7-93d21e99504a None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:40.116715 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 589/1172] 10.222.0.46 () {56 vars in 1183 bytes} [Fri Jul 1 03:45:39 2022] GET /identity/v3/domains/d208e0d672ab4444a58510439d3590de => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:45:40.122687 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244962fd-79c8-46a2-8081-ec2c39d59e17 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:40.218332 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244962fd-79c8-46a2-8081-ec2c39d59e17 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:40.249935 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f5d8d-be2c-4c8a-933a-ace641d8abdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:40.250575 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f5d8d-be2c-4c8a-933a-ace641d8abdc None admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:40.250854 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f5d8d-be2c-4c8a-933a-ace641d8abdc None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:40.251128 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f5d8d-be2c-4c8a-933a-ace641d8abdc None admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:40.251858 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811f5d8d-be2c-4c8a-933a-ace641d8abdc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:40.253270 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811f5d8d-be2c-4c8a-933a-ace641d8abdc None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:40.330195 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 584/1173] 10.222.0.46 () {60 vars in 1141 bytes} [Fri Jul 1 03:45:40 2022] POST /identity/v3/projects => generated 361 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 03:45:42.394104 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f603b6-02e0-4081-9353-648a9d947e03 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:42.394652 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f603b6-02e0-4081-9353-648a9d947e03 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:42.394652 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f603b6-02e0-4081-9353-648a9d947e03 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:42.396047 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 590/1174] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 03:45:42.401785 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33f808-18c3-4aa2-98d0-ccaddf3b1291 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:42.402190 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33f808-18c3-4aa2-98d0-ccaddf3b1291 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:42.402348 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33f808-18c3-4aa2-98d0-ccaddf3b1291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:42.419066 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-0d33f808-18c3-4aa2-98d0-ccaddf3b1291 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:45:42.420284 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-0d33f808-18c3-4aa2-98d0-ccaddf3b1291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:45:42.449087 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:42.485389 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 585/1175] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:45:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:45:42.510144 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f603b6-02e0-4081-9353-648a9d947e03 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:42.612559 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f603b6-02e0-4081-9353-648a9d947e03 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:42.646220 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71ee7e-10c2-431a-ada9-35455b2d527c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:42.647008 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71ee7e-10c2-431a-ada9-35455b2d527c None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:42.647285 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71ee7e-10c2-431a-ada9-35455b2d527c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:42.647586 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71ee7e-10c2-431a-ada9-35455b2d527c None admin] PATH_INFO: `/v3/domains/d208e0d672ab4444a58510439d3590de` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:42.648746 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b71ee7e-10c2-431a-ada9-35455b2d527c None admin] RBAC: Authorizing `identity:get_domain(domain_id=d208e0d672ab4444a58510439d3590de)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:42.650206 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b71ee7e-10c2-431a-ada9-35455b2d527c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:42.651851 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 591/1176] 10.222.0.46 () {56 vars in 1183 bytes} [Fri Jul 1 03:45:42 2022] GET /identity/v3/domains/d208e0d672ab4444a58510439d3590de => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:45:42.657617 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33f808-18c3-4aa2-98d0-ccaddf3b1291 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:42.754661 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33f808-18c3-4aa2-98d0-ccaddf3b1291 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:42.788336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a2dd9-35e1-47b0-ae23-e28e757d7235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:42.788998 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a2dd9-35e1-47b0-ae23-e28e757d7235 None admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:42.789280 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a2dd9-35e1-47b0-ae23-e28e757d7235 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:42.789558 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a2dd9-35e1-47b0-ae23-e28e757d7235 None admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:42.790308 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255a2dd9-35e1-47b0-ae23-e28e757d7235 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:42.791755 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255a2dd9-35e1-47b0-ae23-e28e757d7235 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:42.902152 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 586/1177] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Jul 1 03:45:42 2022] POST /identity/v3/users => generated 311 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 03:45:44.975372 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ffbf5-6fc2-4e68-93db-9b827cdbcccd None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:44.976016 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ffbf5-6fc2-4e68-93db-9b827cdbcccd None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:44.976016 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ffbf5-6fc2-4e68-93db-9b827cdbcccd None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:44.977819 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 592/1178] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:45:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:45:44.983212 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f8700-6d82-4d7e-ac05-7439966bbcba None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:44.983689 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f8700-6d82-4d7e-ac05-7439966bbcba None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:44.983785 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f8700-6d82-4d7e-ac05-7439966bbcba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:45.000851 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-364f8700-6d82-4d7e-ac05-7439966bbcba None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:45:45.002027 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-364f8700-6d82-4d7e-ac05-7439966bbcba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:45:45.019385 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:45.073747 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 587/1179] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:45:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:45:45.098761 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ffbf5-6fc2-4e68-93db-9b827cdbcccd None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:45.108836 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:45.203173 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ffbf5-6fc2-4e68-93db-9b827cdbcccd None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:45.240200 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e48691-5238-4a1c-981a-15a1f54f39e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:45.240938 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e48691-5238-4a1c-981a-15a1f54f39e6 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:45.241222 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e48691-5238-4a1c-981a-15a1f54f39e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:45.241502 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e48691-5238-4a1c-981a-15a1f54f39e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:45.253390 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e48691-5238-4a1c-981a-15a1f54f39e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:45:45.261801 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-61e48691-5238-4a1c-981a-15a1f54f39e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:45:45.261801 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:45:45.261801 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:45:45.261801 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:45:45.261801 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:45:45.261801 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:45:45.261801 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:45:45.261801 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:45:45.261801 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:45:45.261801 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:45:45.261801 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:45:45.261801 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:45:45.261801 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:45:45.261801 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:45:45.261801 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:45:45.261801 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:45:45.262955 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:45:45.262955 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:45:45.262955 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:45:45.262955 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:45:45.262955 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:45:45.262955 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:45:45.262955 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:45:45.262955 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:45:45.262955 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:45:45.262955 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:45:45.262955 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:45:45.262955 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:45:45.262955 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:45:45.262955 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:45:45.262955 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:45:45.262955 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:45:45.264242 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:45:45.264242 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:45:45.264242 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:45:45.264242 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:45:45.264242 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:45:45.264242 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:45:45.264242 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:45:45.264242 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:45:45.264242 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:45:45.264242 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:45:45.264242 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:45:45.264242 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:45:45.264242 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 593/1180] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 1 03:45:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:45:45.269265 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f8700-6d82-4d7e-ac05-7439966bbcba None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:45.370191 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f8700-6d82-4d7e-ac05-7439966bbcba None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:45.403732 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed02401-0e78-42f2-92b3-febb8919b3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:45.404392 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed02401-0e78-42f2-92b3-febb8919b3f1 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:45.404674 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed02401-0e78-42f2-92b3-febb8919b3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:45.404950 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed02401-0e78-42f2-92b3-febb8919b3f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:45.405691 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed02401-0e78-42f2-92b3-febb8919b3f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:45:45.405997 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed02401-0e78-42f2-92b3-febb8919b3f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:45.407357 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed02401-0e78-42f2-92b3-febb8919b3f1 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:45.415654 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 588/1181] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:45:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:45:45.421449 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e48691-5238-4a1c-981a-15a1f54f39e6 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:45.486336 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:45.520284 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e48691-5238-4a1c-981a-15a1f54f39e6 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:45.554344 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07565763-46f0-465a-85cc-08063ade1a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:45.555254 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07565763-46f0-465a-85cc-08063ade1a2c None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:45.555581 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07565763-46f0-465a-85cc-08063ade1a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:45.555863 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07565763-46f0-465a-85cc-08063ade1a2c None admin] PATH_INFO: `/v3/users/ef218fc5e4ea4001a01a52977a980259` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:45.568786 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07565763-46f0-465a-85cc-08063ade1a2c None admin] RBAC: Authorizing `identity:get_user(user_id=ef218fc5e4ea4001a01a52977a980259)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:45.570236 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07565763-46f0-465a-85cc-08063ade1a2c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:45.572490 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 594/1182] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:45:45 2022] GET /identity/v3/users/ef218fc5e4ea4001a01a52977a980259 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:45:45.578216 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed02401-0e78-42f2-92b3-febb8919b3f1 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:45.597161 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:45.678007 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed02401-0e78-42f2-92b3-febb8919b3f1 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:45.710735 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687584f-1d8f-4f29-b41a-f25bf1cb6b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:45.711377 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687584f-1d8f-4f29-b41a-f25bf1cb6b86 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:45.712197 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687584f-1d8f-4f29-b41a-f25bf1cb6b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:45.712472 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687584f-1d8f-4f29-b41a-f25bf1cb6b86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:45.777058 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3687584f-1d8f-4f29-b41a-f25bf1cb6b86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:45.778418 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3687584f-1d8f-4f29-b41a-f25bf1cb6b86 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:45.795413 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:45.873924 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 589/1183] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:45:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 03:45:45.879872 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07565763-46f0-465a-85cc-08063ade1a2c None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:45.974800 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07565763-46f0-465a-85cc-08063ade1a2c None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:45.997307 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:46.007305 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7bbeb5-6c57-49de-a994-0f9711443d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:46.008183 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bbeb5-6c57-49de-a994-0f9711443d2c None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:46.008960 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bbeb5-6c57-49de-a994-0f9711443d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:46.009718 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bbeb5-6c57-49de-a994-0f9711443d2c None admin] PATH_INFO: `/v3/projects/74802cecfebd430f950d3a8157e33b3d` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:46.010542 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7bbeb5-6c57-49de-a994-0f9711443d2c None admin] RBAC: Authorizing `identity:get_project(project_id=74802cecfebd430f950d3a8157e33b3d)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:46.012007 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7bbeb5-6c57-49de-a994-0f9711443d2c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:46.013674 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 595/1184] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:45:45 2022] GET /identity/v3/projects/74802cecfebd430f950d3a8157e33b3d => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:45:46.019965 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687584f-1d8f-4f29-b41a-f25bf1cb6b86 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:46.114480 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687584f-1d8f-4f29-b41a-f25bf1cb6b86 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:46.130127 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:46.147699 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e48c5d0-3c0f-4bdb-bc77-5acc43e8f989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:46.148340 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48c5d0-3c0f-4bdb-bc77-5acc43e8f989 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:46.148619 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48c5d0-3c0f-4bdb-bc77-5acc43e8f989 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:46.148941 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48c5d0-3c0f-4bdb-bc77-5acc43e8f989 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:46.150245 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e48c5d0-3c0f-4bdb-bc77-5acc43e8f989 None admin] RBAC: Adding query filter params (role.id=681755518698445fabd9a8accec13c0f, scope.project.id=74802cecfebd430f950d3a8157e33b3d, user.id=ef218fc5e4ea4001a01a52977a980259) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:45:46.150555 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e48c5d0-3c0f-4bdb-bc77-5acc43e8f989 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:46.152002 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e48c5d0-3c0f-4bdb-bc77-5acc43e8f989 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:46.157555 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 590/1185] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:45:46 2022] GET /identity/v3/role_assignments?user.id=ef218fc5e4ea4001a01a52977a980259&scope.project.id=74802cecfebd430f950d3a8157e33b3d&role.id=681755518698445fabd9a8accec13c0f => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:45:48.167478 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651f11a-3c3a-48f5-a2c9-e4b24c754f04 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:48.168089 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651f11a-3c3a-48f5-a2c9-e4b24c754f04 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:48.168089 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651f11a-3c3a-48f5-a2c9-e4b24c754f04 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:48.169418 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 596/1186] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:45:48.175106 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b288ab1-2a51-42d0-8322-70ffe72f0427 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:48.175629 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b288ab1-2a51-42d0-8322-70ffe72f0427 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:48.175747 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b288ab1-2a51-42d0-8322-70ffe72f0427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:48.192663 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-6b288ab1-2a51-42d0-8322-70ffe72f0427 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:45:48.193858 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-6b288ab1-2a51-42d0-8322-70ffe72f0427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:45:48.264987 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 591/1187] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:45:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:45:48.287968 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651f11a-3c3a-48f5-a2c9-e4b24c754f04 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:48.386263 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651f11a-3c3a-48f5-a2c9-e4b24c754f04 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:48.419441 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb01cce-6661-4ed1-8f4b-62151966fef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:48.420185 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb01cce-6661-4ed1-8f4b-62151966fef8 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:48.420463 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb01cce-6661-4ed1-8f4b-62151966fef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:48.420736 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb01cce-6661-4ed1-8f4b-62151966fef8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:48.430440 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb01cce-6661-4ed1-8f4b-62151966fef8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:45:48.437918 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-5fb01cce-6661-4ed1-8f4b-62151966fef8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:45:48.437918 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:45:48.437918 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:45:48.437918 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:45:48.437918 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:45:48.437918 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:45:48.437918 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:45:48.437918 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:45:48.437918 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:45:48.437918 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:45:48.437918 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:45:48.437918 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:45:48.437918 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:45:48.437918 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:45:48.437918 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:45:48.437918 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:45:48.438915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:45:48.438915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:45:48.438915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:45:48.438915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:45:48.438915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:45:48.438915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:45:48.438915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:45:48.438915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:45:48.438915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:45:48.438915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:45:48.438915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:45:48.438915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:45:48.438915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:45:48.438915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:45:48.438915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:45:48.438915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:45:48.439981 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:45:48.439981 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:45:48.439981 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:45:48.439981 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:45:48.439981 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:45:48.439981 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:45:48.439981 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:45:48.439981 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:45:48.439981 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:45:48.439981 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:45:48.439981 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:45:48.439981 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:45:48.439981 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 597/1188] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 1 03:45:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:45:48.445366 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b288ab1-2a51-42d0-8322-70ffe72f0427 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:48.544215 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b288ab1-2a51-42d0-8322-70ffe72f0427 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:48.554795 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:48.577788 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf046a-e325-4c26-b7c1-1ab3fcb97e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:48.578462 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf046a-e325-4c26-b7c1-1ab3fcb97e37 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:48.578747 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf046a-e325-4c26-b7c1-1ab3fcb97e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:48.579024 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf046a-e325-4c26-b7c1-1ab3fcb97e37 None admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:48.579802 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf046a-e325-4c26-b7c1-1ab3fcb97e37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:45:48.580111 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf046a-e325-4c26-b7c1-1ab3fcb97e37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:48.581480 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf046a-e325-4c26-b7c1-1ab3fcb97e37 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:48.590469 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 592/1189] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:45:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:45:48.596237 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb01cce-6661-4ed1-8f4b-62151966fef8 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:48.648092 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:48.696828 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb01cce-6661-4ed1-8f4b-62151966fef8 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:48.728637 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148581b7-25bd-42f1-8771-bd7114efb2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:48.729501 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148581b7-25bd-42f1-8771-bd7114efb2ce None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:48.729781 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148581b7-25bd-42f1-8771-bd7114efb2ce None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:48.730053 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148581b7-25bd-42f1-8771-bd7114efb2ce None admin] PATH_INFO: `/v3/users/ef218fc5e4ea4001a01a52977a980259` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:48.731203 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148581b7-25bd-42f1-8771-bd7114efb2ce None admin] RBAC: Authorizing `identity:get_user(user_id=ef218fc5e4ea4001a01a52977a980259)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:48.732684 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148581b7-25bd-42f1-8771-bd7114efb2ce None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:48.734327 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 598/1190] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:45:48 2022] GET /identity/v3/users/ef218fc5e4ea4001a01a52977a980259 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:45:48.740181 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf046a-e325-4c26-b7c1-1ab3fcb97e37 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:48.837727 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf046a-e325-4c26-b7c1-1ab3fcb97e37 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:48.869815 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000447eb-5fa0-4a27-9686-040433aced68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:48.870666 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000447eb-5fa0-4a27-9686-040433aced68 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:48.870948 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000447eb-5fa0-4a27-9686-040433aced68 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:48.871225 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000447eb-5fa0-4a27-9686-040433aced68 None admin] PATH_INFO: `/v3/projects/74802cecfebd430f950d3a8157e33b3d` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:48.872420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000447eb-5fa0-4a27-9686-040433aced68 None admin] RBAC: Authorizing `identity:get_project(project_id=74802cecfebd430f950d3a8157e33b3d)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:48.873847 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000447eb-5fa0-4a27-9686-040433aced68 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:48.875555 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 593/1191] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:45:48 2022] GET /identity/v3/projects/74802cecfebd430f950d3a8157e33b3d => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:45:48.881475 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148581b7-25bd-42f1-8771-bd7114efb2ce None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:48.977636 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148581b7-25bd-42f1-8771-bd7114efb2ce None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:48.996634 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:49.009854 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d9a4c-b1d1-4f5b-aae5-cd352adc05d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:49.010738 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d9a4c-b1d1-4f5b-aae5-cd352adc05d6 None admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:49.011018 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d9a4c-b1d1-4f5b-aae5-cd352adc05d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:49.011294 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d9a4c-b1d1-4f5b-aae5-cd352adc05d6 None admin] PATH_INFO: `/v3/projects/74802cecfebd430f950d3a8157e33b3d/users/ef218fc5e4ea4001a01a52977a980259/roles/681755518698445fabd9a8accec13c0f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:49.013262 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8d9a4c-b1d1-4f5b-aae5-cd352adc05d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=74802cecfebd430f950d3a8157e33b3d, user_id=ef218fc5e4ea4001a01a52977a980259, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:49.014705 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8d9a4c-b1d1-4f5b-aae5-cd352adc05d6 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:49.139984 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 599/1192] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 1 03:45:48 2022] PUT /identity/v3/projects/74802cecfebd430f950d3a8157e33b3d/users/ef218fc5e4ea4001a01a52977a980259/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 03:45:51.168481 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65fe31-f26e-45dc-8f72-d73f1d2d34ec None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:51.169010 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65fe31-f26e-45dc-8f72-d73f1d2d34ec None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:51.169010 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65fe31-f26e-45dc-8f72-d73f1d2d34ec None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:51.170386 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 594/1193] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:45:51.175815 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa528370-445b-4011-a24a-a816cab45f05 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:51.176252 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa528370-445b-4011-a24a-a816cab45f05 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:51.176375 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa528370-445b-4011-a24a-a816cab45f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:51.193285 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-fa528370-445b-4011-a24a-a816cab45f05 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:45:51.194682 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-fa528370-445b-4011-a24a-a816cab45f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:45:51.261533 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 600/1194] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:45:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:45:51.286608 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65fe31-f26e-45dc-8f72-d73f1d2d34ec None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:51.332490 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:51.392777 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65fe31-f26e-45dc-8f72-d73f1d2d34ec None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:51.427407 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dad0c3-2db7-4e88-b284-66c6fe9e5e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:51.428133 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dad0c3-2db7-4e88-b284-66c6fe9e5e46 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:51.428406 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dad0c3-2db7-4e88-b284-66c6fe9e5e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:51.428673 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dad0c3-2db7-4e88-b284-66c6fe9e5e46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:51.439239 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dad0c3-2db7-4e88-b284-66c6fe9e5e46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:45:51.447339 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-e2dad0c3-2db7-4e88-b284-66c6fe9e5e46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:45:51.447339 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:45:51.447339 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:45:51.447339 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:45:51.447339 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:45:51.447339 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:45:51.447339 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:45:51.447339 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:45:51.447339 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:45:51.447339 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:45:51.447339 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:45:51.447339 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:45:51.447339 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:45:51.447339 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:45:51.447339 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:45:51.447339 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:45:51.448503 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:45:51.448503 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:45:51.448503 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:45:51.448503 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:45:51.448503 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:45:51.448503 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:45:51.448503 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:45:51.448503 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:45:51.448503 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:45:51.448503 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:45:51.448503 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:45:51.448503 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:45:51.448503 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:45:51.448503 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:45:51.448503 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:45:51.448503 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:45:51.449547 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:45:51.449547 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:45:51.449547 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:45:51.449547 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:45:51.449547 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:45:51.449547 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:45:51.449547 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:45:51.449547 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:45:51.449547 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:45:51.449547 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:45:51.449547 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:45:51.449547 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:45:51.449547 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 595/1195] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 1 03:45:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:45:51.456892 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa528370-445b-4011-a24a-a816cab45f05 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:51.557605 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa528370-445b-4011-a24a-a816cab45f05 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:51.568482 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:51.596389 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ecf1c-9151-4e52-99df-9f01df70c05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:51.597060 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ecf1c-9151-4e52-99df-9f01df70c05f None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:51.597386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ecf1c-9151-4e52-99df-9f01df70c05f None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:51.597651 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ecf1c-9151-4e52-99df-9f01df70c05f None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:51.598598 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007ecf1c-9151-4e52-99df-9f01df70c05f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:45:51.599132 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007ecf1c-9151-4e52-99df-9f01df70c05f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:51.601020 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007ecf1c-9151-4e52-99df-9f01df70c05f None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:51.609403 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 601/1196] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:45:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:45:51.615424 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dad0c3-2db7-4e88-b284-66c6fe9e5e46 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:51.718450 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:51.721288 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dad0c3-2db7-4e88-b284-66c6fe9e5e46 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:51.756175 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e73de-afb1-48c9-bcf7-69fdc6797b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:51.757067 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e73de-afb1-48c9-bcf7-69fdc6797b37 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:51.757350 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e73de-afb1-48c9-bcf7-69fdc6797b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:51.757630 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e73de-afb1-48c9-bcf7-69fdc6797b37 None admin] PATH_INFO: `/v3/users/ef218fc5e4ea4001a01a52977a980259` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:51.759794 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e73de-afb1-48c9-bcf7-69fdc6797b37 None admin] RBAC: Authorizing `identity:get_user(user_id=ef218fc5e4ea4001a01a52977a980259)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:51.761233 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e73de-afb1-48c9-bcf7-69fdc6797b37 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:51.762858 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 596/1197] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Jul 1 03:45:51 2022] GET /identity/v3/users/ef218fc5e4ea4001a01a52977a980259 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:45:51.769495 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ecf1c-9151-4e52-99df-9f01df70c05f None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:51.873416 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ecf1c-9151-4e52-99df-9f01df70c05f None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:51.906463 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5c3e0-1e33-4004-88ae-14315031411a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:51.907109 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5c3e0-1e33-4004-88ae-14315031411a None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:51.907386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5c3e0-1e33-4004-88ae-14315031411a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:51.907942 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5c3e0-1e33-4004-88ae-14315031411a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:51.949354 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:51.975110 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb5c3e0-1e33-4004-88ae-14315031411a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:51.977136 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb5c3e0-1e33-4004-88ae-14315031411a None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:52.074411 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 602/1198] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:45:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 03:45:52.080355 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e73de-afb1-48c9-bcf7-69fdc6797b37 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:52.177511 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e73de-afb1-48c9-bcf7-69fdc6797b37 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:52.210631 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a4db9-c70d-42c5-9731-d5d631d18197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:52.211546 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a4db9-c70d-42c5-9731-d5d631d18197 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:52.211833 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a4db9-c70d-42c5-9731-d5d631d18197 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:52.212108 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a4db9-c70d-42c5-9731-d5d631d18197 None admin] PATH_INFO: `/v3/projects/74802cecfebd430f950d3a8157e33b3d` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:52.213277 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a4db9-c70d-42c5-9731-d5d631d18197 None admin] RBAC: Authorizing `identity:get_project(project_id=74802cecfebd430f950d3a8157e33b3d)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:52.214714 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a4db9-c70d-42c5-9731-d5d631d18197 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:52.216424 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 597/1199] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Jul 1 03:45:52 2022] GET /identity/v3/projects/74802cecfebd430f950d3a8157e33b3d => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:45:52.222581 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5c3e0-1e33-4004-88ae-14315031411a None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:45:52.291301 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:45:52.320090 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5c3e0-1e33-4004-88ae-14315031411a None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:45:52.353461 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94bde2-32d5-40ae-88e9-2b9309a8193e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:45:52.354116 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94bde2-32d5-40ae-88e9-2b9309a8193e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:45:52.354392 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94bde2-32d5-40ae-88e9-2b9309a8193e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:45:52.354664 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94bde2-32d5-40ae-88e9-2b9309a8193e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:45:52.355507 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94bde2-32d5-40ae-88e9-2b9309a8193e None admin] RBAC: Adding query filter params (role.id=681755518698445fabd9a8accec13c0f, scope.project.id=74802cecfebd430f950d3a8157e33b3d, user.id=ef218fc5e4ea4001a01a52977a980259) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:45:52.355822 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94bde2-32d5-40ae-88e9-2b9309a8193e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:45:52.357261 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94bde2-32d5-40ae-88e9-2b9309a8193e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:45:52.363468 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 603/1200] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:45:52 2022] GET /identity/v3/role_assignments?user.id=ef218fc5e4ea4001a01a52977a980259&scope.project.id=74802cecfebd430f950d3a8157e33b3d&role.id=681755518698445fabd9a8accec13c0f => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:46:02.206444 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=82 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:46:02.360594 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=32 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:14.298295 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179c6cd-192a-4e08-9577-d93d94d5ca8a None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:14.298884 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179c6cd-192a-4e08-9577-d93d94d5ca8a None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:14.298884 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179c6cd-192a-4e08-9577-d93d94d5ca8a None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:14.300250 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 598/1201] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:47:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:47:14.306029 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5640c0-8bfe-49fc-a56f-9dea6d9a8cdd None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:14.306503 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5640c0-8bfe-49fc-a56f-9dea6d9a8cdd None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:14.306601 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5640c0-8bfe-49fc-a56f-9dea6d9a8cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:14.323260 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-df5640c0-8bfe-49fc-a56f-9dea6d9a8cdd None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:47:14.324487 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-df5640c0-8bfe-49fc-a56f-9dea6d9a8cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:47:14.392205 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 604/1202] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:47:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:47:14.417853 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179c6cd-192a-4e08-9577-d93d94d5ca8a None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:14.527104 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179c6cd-192a-4e08-9577-d93d94d5ca8a None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:14.566677 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2911156-cd41-4030-8471-751126331969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:14.567396 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2911156-cd41-4030-8471-751126331969 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:14.567704 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2911156-cd41-4030-8471-751126331969 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:14.567978 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2911156-cd41-4030-8471-751126331969 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:14.579340 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2911156-cd41-4030-8471-751126331969 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:14.580896 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2911156-cd41-4030-8471-751126331969 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:14.598578 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-c2911156-cd41-4030-8471-751126331969 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:47:14.598578 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:47:14.598578 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:47:14.598578 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:47:14.598578 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:47:14.598578 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:47:14.598578 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:47:14.598578 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:47:14.598578 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:47:14.598578 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:47:14.598578 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:47:14.598578 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:47:14.598578 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:47:14.598578 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:47:14.598578 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:47:14.600723 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:47:14.600723 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:47:14.600723 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:47:14.600723 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:47:14.600723 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:47:14.600723 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:47:14.600723 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:47:14.600723 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:47:14.600723 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:47:14.600723 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:47:14.600723 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:47:14.600723 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:47:14.600723 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:47:14.600723 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:47:14.600723 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:47:14.600723 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:47:14.600723 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:47:14.601898 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:47:14.601898 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:47:14.601898 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:47:14.601898 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:47:14.601898 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 599/1203] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:47:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:47:14.606025 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5640c0-8bfe-49fc-a56f-9dea6d9a8cdd None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:14.710396 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5640c0-8bfe-49fc-a56f-9dea6d9a8cdd None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:14.745704 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:14.751733 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f6ebec-37cd-40f5-af2f-b9e27d3bc944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:14.752397 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6ebec-37cd-40f5-af2f-b9e27d3bc944 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:14.752676 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6ebec-37cd-40f5-af2f-b9e27d3bc944 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:14.752947 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6ebec-37cd-40f5-af2f-b9e27d3bc944 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:14.753662 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f6ebec-37cd-40f5-af2f-b9e27d3bc944 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:47:14.753967 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f6ebec-37cd-40f5-af2f-b9e27d3bc944 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:14.755348 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f6ebec-37cd-40f5-af2f-b9e27d3bc944 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:14.767274 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 605/1204] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:47:14.774219 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2911156-cd41-4030-8471-751126331969 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:14.832324 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:14.884875 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2911156-cd41-4030-8471-751126331969 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:14.919798 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc6aa1-246b-4e03-9a22-cecdb9e6bdfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:14.920459 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc6aa1-246b-4e03-9a22-cecdb9e6bdfb None admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:14.920736 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc6aa1-246b-4e03-9a22-cecdb9e6bdfb None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:14.921007 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc6aa1-246b-4e03-9a22-cecdb9e6bdfb None admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:14.921709 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fc6aa1-246b-4e03-9a22-cecdb9e6bdfb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:14.923160 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fc6aa1-246b-4e03-9a22-cecdb9e6bdfb None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:15.050603 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 600/1205] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Jul 1 03:47:14 2022] POST /identity/v3/users => generated 251 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 03:47:17.127577 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3175d-361a-49d2-baec-b403e083d1a4 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:17.128159 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3175d-361a-49d2-baec-b403e083d1a4 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:17.128159 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3175d-361a-49d2-baec-b403e083d1a4 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:17.129500 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 606/1206] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:47:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:47:17.135320 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d979d4-db33-4678-94a1-f1b5dab39630 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:17.140240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d979d4-db33-4678-94a1-f1b5dab39630 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:17.140240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d979d4-db33-4678-94a1-f1b5dab39630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:17.153017 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-b9d979d4-db33-4678-94a1-f1b5dab39630 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:47:17.154195 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-b9d979d4-db33-4678-94a1-f1b5dab39630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:47:17.222014 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 601/1207] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:47:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:47:17.246447 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b3175d-361a-49d2-baec-b403e083d1a4 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:17.349382 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b3175d-361a-49d2-baec-b403e083d1a4 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:17.384057 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68fd788-9fc1-4fc6-af4b-31765ff198ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:17.384791 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68fd788-9fc1-4fc6-af4b-31765ff198ed None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:17.385071 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68fd788-9fc1-4fc6-af4b-31765ff198ed None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:17.385345 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68fd788-9fc1-4fc6-af4b-31765ff198ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:17.396721 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68fd788-9fc1-4fc6-af4b-31765ff198ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:47:17.405224 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-f68fd788-9fc1-4fc6-af4b-31765ff198ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 03:47:17.405224 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:47:17.405224 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:47:17.405224 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:47:17.405224 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:47:17.405224 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:47:17.405224 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:47:17.405224 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:47:17.405224 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:47:17.405224 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:47:17.405224 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:47:17.405224 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:47:17.405224 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:47:17.405224 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:47:17.405224 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:47:17.405224 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:47:17.406508 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:47:17.406508 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:47:17.406508 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:47:17.406508 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:47:17.406508 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:47:17.406508 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:47:17.406508 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:47:17.406508 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:47:17.406508 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:47:17.406508 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:47:17.406508 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:47:17.406508 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:47:17.406508 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:47:17.406508 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:47:17.406508 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:47:17.406508 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:47:17.407751 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:47:17.407751 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:47:17.407751 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:47:17.407751 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:47:17.407751 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:47:17.407751 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:47:17.407751 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:47:17.407751 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:47:17.407751 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:47:17.407751 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:47:17.407751 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 03:47:17.407751 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:47:17.407751 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 607/1208] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Jul 1 03:47:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:47:17.412670 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d979d4-db33-4678-94a1-f1b5dab39630 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:17.452230 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:17.513268 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d979d4-db33-4678-94a1-f1b5dab39630 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:17.547108 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011fcd03-db2c-4878-83fa-de0745991bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:17.547804 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fcd03-db2c-4878-83fa-de0745991bed None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:17.548089 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fcd03-db2c-4878-83fa-de0745991bed None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:17.548367 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fcd03-db2c-4878-83fa-de0745991bed None admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:17.549116 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011fcd03-db2c-4878-83fa-de0745991bed None admin] RBAC: Adding query filter params (name=service) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:47:17.549425 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011fcd03-db2c-4878-83fa-de0745991bed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:17.550787 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011fcd03-db2c-4878-83fa-de0745991bed None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:17.559719 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 602/1209] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Jul 1 03:47:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:47:17.565218 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68fd788-9fc1-4fc6-af4b-31765ff198ed None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:17.616014 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:17.664800 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68fd788-9fc1-4fc6-af4b-31765ff198ed None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:17.698952 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0dd72-7809-4de1-89b0-fddd77946c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:17.699795 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0dd72-7809-4de1-89b0-fddd77946c30 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:17.700080 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0dd72-7809-4de1-89b0-fddd77946c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:17.700360 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0dd72-7809-4de1-89b0-fddd77946c30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:17.710348 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e0dd72-7809-4de1-89b0-fddd77946c30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:17.715614 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e0dd72-7809-4de1-89b0-fddd77946c30 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:17.729051 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-e3e0dd72-7809-4de1-89b0-fddd77946c30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:47:17.729051 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:47:17.729051 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:47:17.729051 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:47:17.729051 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:47:17.729051 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:47:17.729051 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:47:17.729051 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:47:17.729051 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:47:17.729051 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:47:17.729051 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:47:17.729051 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:47:17.729051 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:47:17.729051 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:47:17.729051 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:47:17.729987 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:47:17.729987 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:47:17.729987 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:47:17.729987 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:47:17.729987 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:47:17.729987 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:47:17.729987 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:47:17.729987 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:47:17.729987 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:47:17.729987 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:47:17.729987 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:47:17.729987 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:47:17.729987 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:47:17.729987 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:47:17.729987 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:47:17.729987 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:47:17.729987 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:47:17.730909 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:47:17.730909 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:47:17.730909 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:47:17.730909 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:47:17.730909 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 608/1210] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:47:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:47:17.736106 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011fcd03-db2c-4878-83fa-de0745991bed None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:17.835573 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:17.838431 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011fcd03-db2c-4878-83fa-de0745991bed None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:17.873891 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f18afe-e8dd-49c4-9eee-ed6f7c70196b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:17.874539 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f18afe-e8dd-49c4-9eee-ed6f7c70196b None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:17.874824 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f18afe-e8dd-49c4-9eee-ed6f7c70196b None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:17.875103 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f18afe-e8dd-49c4-9eee-ed6f7c70196b None admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:17.875856 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f18afe-e8dd-49c4-9eee-ed6f7c70196b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:47:17.876165 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f18afe-e8dd-49c4-9eee-ed6f7c70196b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:17.877518 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f18afe-e8dd-49c4-9eee-ed6f7c70196b None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:17.889223 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 603/1211] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:47:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:47:17.895325 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0dd72-7809-4de1-89b0-fddd77946c30 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:17.995663 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0dd72-7809-4de1-89b0-fddd77946c30 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:17.997115 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:18.029696 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc0208-54c7-416b-b6cd-ce89c3a7d139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:18.030499 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc0208-54c7-416b-b6cd-ce89c3a7d139 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:18.030775 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc0208-54c7-416b-b6cd-ce89c3a7d139 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:18.031044 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc0208-54c7-416b-b6cd-ce89c3a7d139 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:18.038827 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc0208-54c7-416b-b6cd-ce89c3a7d139 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:18.043495 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc0208-54c7-416b-b6cd-ce89c3a7d139 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:18.055519 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-8dbc0208-54c7-416b-b6cd-ce89c3a7d139 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 01 03:47:18.055519 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:47:18.055519 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:47:18.055519 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:47:18.055519 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:47:18.055519 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:47:18.055519 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:47:18.055519 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:47:18.055519 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:47:18.055519 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:47:18.055519 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:47:18.055519 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:47:18.055519 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 03:47:18.055519 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 03:47:18.055519 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 03:47:18.055519 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 03:47:18.056757 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:47:18.056757 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:47:18.056757 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 03:47:18.056757 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:47:18.056757 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 03:47:18.056757 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:47:18.056757 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:47:18.056757 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:47:18.056757 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:47:18.056757 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:47:18.056757 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:47:18.056757 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:47:18.056757 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:47:18.056757 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:47:18.056757 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:47:18.056757 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:47:18.056757 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:47:18.056757 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:47:18.057974 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:47:18.057974 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:47:18.057974 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 03:47:18.057974 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 03:47:18.057974 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 03:47:18.057974 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 03:47:18.057974 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 03:47:18.057974 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 03:47:18.057974 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 01 03:47:18.057974 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:47:18.057974 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 609/1212] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:47:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:47:18.062865 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f18afe-e8dd-49c4-9eee-ed6f7c70196b None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:18.163916 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f18afe-e8dd-49c4-9eee-ed6f7c70196b None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:18.198720 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84dcb8-fe59-4e84-b776-36340c48b420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:18.199396 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84dcb8-fe59-4e84-b776-36340c48b420 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:18.199703 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84dcb8-fe59-4e84-b776-36340c48b420 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:18.199979 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84dcb8-fe59-4e84-b776-36340c48b420 None admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:18.200825 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84dcb8-fe59-4e84-b776-36340c48b420 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:47:18.201134 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84dcb8-fe59-4e84-b776-36340c48b420 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:18.202567 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84dcb8-fe59-4e84-b776-36340c48b420 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:18.224318 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 604/1213] 10.222.0.46 () {56 vars in 1143 bytes} [Fri Jul 1 03:47:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:47:18.230850 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc0208-54c7-416b-b6cd-ce89c3a7d139 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:18.331064 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc0208-54c7-416b-b6cd-ce89c3a7d139 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:18.366094 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258e197-63f9-4b0b-89d8-212f760c1306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:18.366786 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258e197-63f9-4b0b-89d8-212f760c1306 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:18.367064 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258e197-63f9-4b0b-89d8-212f760c1306 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:18.367338 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258e197-63f9-4b0b-89d8-212f760c1306 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:18.397464 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:18.436145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e258e197-63f9-4b0b-89d8-212f760c1306 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:18.437608 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e258e197-63f9-4b0b-89d8-212f760c1306 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:18.538168 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 610/1214] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:47:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 01 03:47:18.544153 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84dcb8-fe59-4e84-b776-36340c48b420 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:18.564485 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:18.646049 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84dcb8-fe59-4e84-b776-36340c48b420 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:18.680158 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac36ec-1196-45f0-8f53-24b87cc51709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:18.680958 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac36ec-1196-45f0-8f53-24b87cc51709 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:18.681238 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac36ec-1196-45f0-8f53-24b87cc51709 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:18.681510 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac36ec-1196-45f0-8f53-24b87cc51709 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:18.691761 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac36ec-1196-45f0-8f53-24b87cc51709 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:18.693227 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac36ec-1196-45f0-8f53-24b87cc51709 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:18.711622 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-8dac36ec-1196-45f0-8f53-24b87cc51709 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:47:18.711622 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:47:18.711622 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:47:18.711622 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:47:18.711622 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:47:18.711622 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:47:18.711622 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:47:18.711622 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:47:18.711622 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:47:18.711622 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:47:18.711622 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:47:18.711622 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:47:18.711622 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:47:18.711622 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:47:18.711622 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:47:18.714266 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:47:18.714266 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:47:18.714266 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:47:18.714266 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:47:18.714266 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:47:18.714266 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:47:18.714266 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:47:18.714266 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:47:18.714266 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:47:18.714266 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:47:18.714266 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:47:18.714266 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:47:18.714266 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:47:18.714266 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:47:18.714266 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:47:18.714266 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:47:18.714266 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:47:18.715373 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:47:18.715373 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:47:18.715373 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:47:18.715373 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:47:18.715373 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 605/1215] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:47:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:47:18.719443 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258e197-63f9-4b0b-89d8-212f760c1306 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:18.782637 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:18.822603 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258e197-63f9-4b0b-89d8-212f760c1306 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:18.857751 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e2245-7859-4a6e-8e30-362c12aefe5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:18.858772 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e2245-7859-4a6e-8e30-362c12aefe5c None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:18.858772 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e2245-7859-4a6e-8e30-362c12aefe5c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:18.858956 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e2245-7859-4a6e-8e30-362c12aefe5c None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:18.859687 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e2245-7859-4a6e-8e30-362c12aefe5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:47:18.859993 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e2245-7859-4a6e-8e30-362c12aefe5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:18.861468 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e2245-7859-4a6e-8e30-362c12aefe5c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:18.874173 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 611/1216] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:47:18.879942 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac36ec-1196-45f0-8f53-24b87cc51709 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:18.959713 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:18.991229 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac36ec-1196-45f0-8f53-24b87cc51709 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:19.026155 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d77a3-be50-45a9-a5be-7e8896a9f75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:19.026950 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d77a3-be50-45a9-a5be-7e8896a9f75e None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:19.027236 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d77a3-be50-45a9-a5be-7e8896a9f75e None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:19.027529 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d77a3-be50-45a9-a5be-7e8896a9f75e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:19.034736 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d77a3-be50-45a9-a5be-7e8896a9f75e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:19.036203 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d77a3-be50-45a9-a5be-7e8896a9f75e None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:19.051475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-597d77a3-be50-45a9-a5be-7e8896a9f75e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:47:19.051475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:47:19.051475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:47:19.051475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:47:19.051475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:47:19.051475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:47:19.051475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:47:19.051475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:47:19.051475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:47:19.051475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:47:19.051475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:47:19.051475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:47:19.051475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 03:47:19.051475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 03:47:19.051475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 03:47:19.052589 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 03:47:19.052589 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:47:19.052589 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:47:19.052589 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:47:19.052589 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:47:19.052589 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:47:19.052589 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:47:19.052589 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:47:19.052589 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:47:19.052589 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:47:19.052589 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:47:19.052589 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:47:19.052589 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:47:19.052589 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:47:19.052589 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:47:19.052589 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:47:19.052589 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:47:19.053936 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 03:47:19.053936 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 03:47:19.053936 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 03:47:19.053936 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 03:47:19.053936 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 03:47:19.053936 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 03:47:19.053936 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:47:19.053936 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:47:19.053936 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 606/1217] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:47:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:47:19.058641 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e2245-7859-4a6e-8e30-362c12aefe5c None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:19.162566 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e2245-7859-4a6e-8e30-362c12aefe5c None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:19.187649 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:19.198604 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a569df-d819-4957-963b-85e33bf38b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:19.199264 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a569df-d819-4957-963b-85e33bf38b54 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:19.199572 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a569df-d819-4957-963b-85e33bf38b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:19.199854 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a569df-d819-4957-963b-85e33bf38b54 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:19.200622 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a569df-d819-4957-963b-85e33bf38b54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:47:19.200926 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a569df-d819-4957-963b-85e33bf38b54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:19.202375 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a569df-d819-4957-963b-85e33bf38b54 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:19.214795 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 612/1218] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 1 03:47:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:47:19.220928 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d77a3-be50-45a9-a5be-7e8896a9f75e None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:19.331131 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d77a3-be50-45a9-a5be-7e8896a9f75e None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:19.361257 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:19.367680 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4966971b-3243-4712-ae69-c4b8ed7ecbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:19.368388 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966971b-3243-4712-ae69-c4b8ed7ecbe2 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:19.368675 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966971b-3243-4712-ae69-c4b8ed7ecbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:19.369043 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966971b-3243-4712-ae69-c4b8ed7ecbe2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:19.369968 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4966971b-3243-4712-ae69-c4b8ed7ecbe2 None admin] RBAC: Adding query filter params (role.id=66426d7dd6f64f6ebfcb1cbb8188b0d2, scope.project.id=da83db15a312499fb627691ae442f233, user.id=4efe4a6dd11047688892641a936e2914) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:47:19.370289 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4966971b-3243-4712-ae69-c4b8ed7ecbe2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:19.371753 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4966971b-3243-4712-ae69-c4b8ed7ecbe2 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:19.377591 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 607/1219] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:47:19 2022] GET /identity/v3/role_assignments?user.id=4efe4a6dd11047688892641a936e2914&scope.project.id=da83db15a312499fb627691ae442f233&role.id=66426d7dd6f64f6ebfcb1cbb8188b0d2 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:47:21.439721 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5068ad5-0378-4627-a94f-de211debf526 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:21.440272 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5068ad5-0378-4627-a94f-de211debf526 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:21.440272 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5068ad5-0378-4627-a94f-de211debf526 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:21.441642 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 613/1220] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:47:21.447102 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aac790-f84f-4437-a147-546c8ed97f40 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:21.447544 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aac790-f84f-4437-a147-546c8ed97f40 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:21.447684 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aac790-f84f-4437-a147-546c8ed97f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:21.464563 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-25aac790-f84f-4437-a147-546c8ed97f40 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:47:21.465821 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-25aac790-f84f-4437-a147-546c8ed97f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:47:21.534554 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 608/1221] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:47:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:47:21.561193 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5068ad5-0378-4627-a94f-de211debf526 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:21.662715 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5068ad5-0378-4627-a94f-de211debf526 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:21.698372 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b2ece-ecad-416b-8f46-9867e71cb573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:21.699133 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b2ece-ecad-416b-8f46-9867e71cb573 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:21.699492 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b2ece-ecad-416b-8f46-9867e71cb573 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:21.699811 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b2ece-ecad-416b-8f46-9867e71cb573 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:21.709841 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b2ece-ecad-416b-8f46-9867e71cb573 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:47:21.718235 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-764b2ece-ecad-416b-8f46-9867e71cb573 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 03:47:21.718235 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:47:21.718235 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:47:21.718235 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:47:21.718235 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:47:21.718235 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:47:21.718235 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:47:21.718235 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:47:21.718235 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:47:21.718235 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:47:21.718235 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:47:21.718235 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:47:21.718235 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:47:21.718235 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:47:21.718235 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:47:21.718235 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:47:21.722369 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:47:21.722369 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:47:21.722369 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:47:21.722369 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:47:21.722369 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:47:21.722369 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:47:21.722369 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:47:21.722369 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:47:21.722369 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:47:21.722369 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:47:21.722369 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:47:21.722369 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:47:21.722369 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:47:21.722369 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:47:21.722369 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:47:21.722369 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:47:21.723392 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:47:21.723392 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:47:21.723392 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:47:21.723392 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:47:21.723392 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:47:21.723392 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:47:21.723392 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:47:21.723392 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:47:21.723392 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:47:21.723392 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:47:21.723392 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 03:47:21.723392 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:47:21.723392 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 614/1222] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Jul 1 03:47:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:47:21.725701 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aac790-f84f-4437-a147-546c8ed97f40 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:21.824487 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aac790-f84f-4437-a147-546c8ed97f40 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:21.848723 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:21.859401 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38842164-4305-4d9b-a192-4e1252056ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:21.860103 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38842164-4305-4d9b-a192-4e1252056ab8 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:21.860407 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38842164-4305-4d9b-a192-4e1252056ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:21.860644 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38842164-4305-4d9b-a192-4e1252056ab8 None admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:21.861399 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38842164-4305-4d9b-a192-4e1252056ab8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:47:21.861707 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38842164-4305-4d9b-a192-4e1252056ab8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:21.863068 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38842164-4305-4d9b-a192-4e1252056ab8 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:21.871733 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 609/1223] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Jul 1 03:47:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:47:21.878379 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b2ece-ecad-416b-8f46-9867e71cb573 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:21.922985 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:21.978546 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b2ece-ecad-416b-8f46-9867e71cb573 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:22.011800 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941cb524-4bf4-40ac-9109-34f77deb2821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:22.012631 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cb524-4bf4-40ac-9109-34f77deb2821 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:22.012909 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cb524-4bf4-40ac-9109-34f77deb2821 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:22.013182 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cb524-4bf4-40ac-9109-34f77deb2821 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:22.024305 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941cb524-4bf4-40ac-9109-34f77deb2821 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:22.025827 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941cb524-4bf4-40ac-9109-34f77deb2821 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:22.042826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-941cb524-4bf4-40ac-9109-34f77deb2821 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:47:22.042826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:47:22.042826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:47:22.042826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:47:22.042826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:47:22.042826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:47:22.042826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:47:22.042826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:47:22.042826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:47:22.042826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:47:22.042826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:47:22.042826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:47:22.042826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:47:22.042826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:47:22.042826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:47:22.059153 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:47:22.059153 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:47:22.059153 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:47:22.059153 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:47:22.059153 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:47:22.059153 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:47:22.059153 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:47:22.059153 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:47:22.059153 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:47:22.059153 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:47:22.059153 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:47:22.059153 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:47:22.059153 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:47:22.059153 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:47:22.059153 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:47:22.059153 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:47:22.059153 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:47:22.060291 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:47:22.060291 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:47:22.060291 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:47:22.060291 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:47:22.060291 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 615/1224] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:47:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:47:22.060631 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38842164-4305-4d9b-a192-4e1252056ab8 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:22.152006 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38842164-4305-4d9b-a192-4e1252056ab8 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:22.186317 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344cbb8-4f82-4695-a385-b39add070548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:22.186979 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344cbb8-4f82-4695-a385-b39add070548 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:22.187259 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344cbb8-4f82-4695-a385-b39add070548 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:22.187559 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344cbb8-4f82-4695-a385-b39add070548 None admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:22.188275 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344cbb8-4f82-4695-a385-b39add070548 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:47:22.188576 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344cbb8-4f82-4695-a385-b39add070548 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:22.189931 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344cbb8-4f82-4695-a385-b39add070548 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:22.202207 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 610/1225] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:47:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:47:22.207966 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941cb524-4bf4-40ac-9109-34f77deb2821 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:22.301509 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:22.308656 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941cb524-4bf4-40ac-9109-34f77deb2821 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:22.341758 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04444bf5-6382-4aaf-b6c6-64bcb8c345bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:22.342593 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04444bf5-6382-4aaf-b6c6-64bcb8c345bf None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:22.342875 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04444bf5-6382-4aaf-b6c6-64bcb8c345bf None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:22.343151 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04444bf5-6382-4aaf-b6c6-64bcb8c345bf None admin] PATH_INFO: `/v3/users/placement` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:22.350448 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04444bf5-6382-4aaf-b6c6-64bcb8c345bf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:22.352514 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04444bf5-6382-4aaf-b6c6-64bcb8c345bf None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:22.368819 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-04444bf5-6382-4aaf-b6c6-64bcb8c345bf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 01 03:47:22.368819 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:47:22.368819 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:47:22.368819 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:47:22.368819 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:47:22.368819 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:47:22.368819 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:47:22.368819 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:47:22.368819 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:47:22.368819 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:47:22.368819 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:47:22.368819 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:47:22.368819 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 03:47:22.368819 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 03:47:22.368819 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 03:47:22.368819 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 03:47:22.369940 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:47:22.369940 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:47:22.369940 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 03:47:22.369940 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:47:22.369940 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 03:47:22.369940 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:47:22.369940 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:47:22.369940 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:47:22.369940 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:47:22.369940 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:47:22.369940 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:47:22.369940 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:47:22.369940 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:47:22.369940 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:47:22.369940 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:47:22.369940 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:47:22.369940 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:47:22.369940 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:47:22.371277 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:47:22.371277 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:47:22.371277 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 03:47:22.371277 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 03:47:22.371277 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 03:47:22.371277 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 03:47:22.371277 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 03:47:22.371277 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 03:47:22.371277 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 01 03:47:22.371277 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:47:22.371277 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 616/1226] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:47:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:47:22.376074 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344cbb8-4f82-4695-a385-b39add070548 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:22.425694 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:22.477429 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344cbb8-4f82-4695-a385-b39add070548 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:22.511629 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67b0a5-219b-4c01-8568-7ef0700fd6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:22.512418 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67b0a5-219b-4c01-8568-7ef0700fd6e1 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:22.512676 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67b0a5-219b-4c01-8568-7ef0700fd6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:22.512946 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67b0a5-219b-4c01-8568-7ef0700fd6e1 None admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:22.513806 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d67b0a5-219b-4c01-8568-7ef0700fd6e1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:47:22.514112 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d67b0a5-219b-4c01-8568-7ef0700fd6e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:22.515595 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d67b0a5-219b-4c01-8568-7ef0700fd6e1 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:22.534109 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 611/1227] 10.222.0.46 () {56 vars in 1143 bytes} [Fri Jul 1 03:47:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:47:22.539823 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04444bf5-6382-4aaf-b6c6-64bcb8c345bf None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:22.640365 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04444bf5-6382-4aaf-b6c6-64bcb8c345bf None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:22.675804 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43267761-4185-4ab4-ad64-35dd2268fd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:22.676606 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43267761-4185-4ab4-ad64-35dd2268fd7e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:22.676946 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43267761-4185-4ab4-ad64-35dd2268fd7e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:22.677217 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43267761-4185-4ab4-ad64-35dd2268fd7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:22.687845 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43267761-4185-4ab4-ad64-35dd2268fd7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:22.689346 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43267761-4185-4ab4-ad64-35dd2268fd7e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:22.707192 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-43267761-4185-4ab4-ad64-35dd2268fd7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:47:22.707192 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:47:22.707192 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:47:22.707192 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:47:22.707192 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:47:22.707192 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:47:22.707192 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:47:22.707192 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:47:22.707192 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:47:22.707192 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:47:22.707192 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:47:22.707192 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:47:22.707192 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:47:22.707192 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:47:22.707192 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:47:22.708381 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:47:22.708381 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:47:22.708381 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:47:22.708381 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:47:22.708381 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:47:22.708381 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:47:22.708381 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:47:22.708381 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:47:22.708381 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:47:22.708381 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:47:22.708381 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:47:22.708381 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:47:22.708381 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:47:22.708381 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:47:22.708381 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:47:22.708381 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:47:22.708381 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:47:22.709323 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:47:22.709323 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:47:22.709323 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:47:22.709323 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:47:22.709323 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 617/1228] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:47:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:47:22.714777 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67b0a5-219b-4c01-8568-7ef0700fd6e1 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:22.817431 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67b0a5-219b-4c01-8568-7ef0700fd6e1 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:22.820041 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:22.852384 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0395dd2-b081-45f2-af51-0d3742339e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:22.853049 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0395dd2-b081-45f2-af51-0d3742339e27 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:22.853332 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0395dd2-b081-45f2-af51-0d3742339e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:22.853606 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0395dd2-b081-45f2-af51-0d3742339e27 None admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:22.854336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0395dd2-b081-45f2-af51-0d3742339e27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:47:22.854644 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0395dd2-b081-45f2-af51-0d3742339e27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:22.856048 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0395dd2-b081-45f2-af51-0d3742339e27 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:22.867428 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 612/1229] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:47:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:47:22.873289 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43267761-4185-4ab4-ad64-35dd2268fd7e None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:22.882585 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:22.979483 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43267761-4185-4ab4-ad64-35dd2268fd7e None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:23.013958 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a623cf3c-8178-4ddb-9f92-397f1d8cd908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:23.014759 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623cf3c-8178-4ddb-9f92-397f1d8cd908 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:23.015039 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623cf3c-8178-4ddb-9f92-397f1d8cd908 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:23.015311 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623cf3c-8178-4ddb-9f92-397f1d8cd908 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:23.024706 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a623cf3c-8178-4ddb-9f92-397f1d8cd908 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:23.026161 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a623cf3c-8178-4ddb-9f92-397f1d8cd908 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:23.040039 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-a623cf3c-8178-4ddb-9f92-397f1d8cd908 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:47:23.040039 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:47:23.040039 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:47:23.040039 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:47:23.040039 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:47:23.040039 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:47:23.040039 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:47:23.040039 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:47:23.040039 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:47:23.040039 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:47:23.040039 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:47:23.040039 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:47:23.040039 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 03:47:23.040039 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 03:47:23.040039 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 03:47:23.041145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 03:47:23.041145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:47:23.041145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:47:23.041145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:47:23.041145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:47:23.041145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:47:23.041145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:47:23.041145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:47:23.041145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:47:23.041145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:47:23.041145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:47:23.041145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:47:23.041145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:47:23.041145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:47:23.041145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:47:23.041145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:47:23.041145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:47:23.042228 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 03:47:23.042228 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 03:47:23.042228 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 03:47:23.042228 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 03:47:23.042228 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 03:47:23.042228 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 03:47:23.042228 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:47:23.042228 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:47:23.042228 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 618/1230] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:47:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:47:23.047371 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0395dd2-b081-45f2-af51-0d3742339e27 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:23.151002 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0395dd2-b081-45f2-af51-0d3742339e27 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:23.184537 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2105ba1-dafe-464d-98fc-90250462fd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:23.185199 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2105ba1-dafe-464d-98fc-90250462fd6b None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:23.185494 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2105ba1-dafe-464d-98fc-90250462fd6b None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:23.185766 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2105ba1-dafe-464d-98fc-90250462fd6b None admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:23.186563 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2105ba1-dafe-464d-98fc-90250462fd6b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:47:23.186875 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2105ba1-dafe-464d-98fc-90250462fd6b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:23.188403 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2105ba1-dafe-464d-98fc-90250462fd6b None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:23.201251 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 613/1231] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 1 03:47:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:47:23.207541 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a623cf3c-8178-4ddb-9f92-397f1d8cd908 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:23.276489 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:23.311790 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a623cf3c-8178-4ddb-9f92-397f1d8cd908 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:23.346064 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda2f72-357c-4f6f-b3cc-5f06f18599fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:23.347010 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda2f72-357c-4f6f-b3cc-5f06f18599fc None admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:23.347292 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda2f72-357c-4f6f-b3cc-5f06f18599fc None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:23.347614 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda2f72-357c-4f6f-b3cc-5f06f18599fc None admin] PATH_INFO: `/v3/projects/da83db15a312499fb627691ae442f233/users/4efe4a6dd11047688892641a936e2914/roles/66426d7dd6f64f6ebfcb1cbb8188b0d2` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:23.362322 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eda2f72-357c-4f6f-b3cc-5f06f18599fc None admin] RBAC: Authorizing `identity:create_grant(project_id=da83db15a312499fb627691ae442f233, user_id=4efe4a6dd11047688892641a936e2914, role_id=66426d7dd6f64f6ebfcb1cbb8188b0d2)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:23.366954 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eda2f72-357c-4f6f-b3cc-5f06f18599fc None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:23.496148 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 619/1232] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 1 03:47:23 2022] PUT /identity/v3/projects/da83db15a312499fb627691ae442f233/users/4efe4a6dd11047688892641a936e2914/roles/66426d7dd6f64f6ebfcb1cbb8188b0d2 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 03:47:25.498235 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8eca8b-15d6-4ac0-94d6-807a06bf489c None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:25.498788 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8eca8b-15d6-4ac0-94d6-807a06bf489c None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:25.498788 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8eca8b-15d6-4ac0-94d6-807a06bf489c None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:25.500177 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 614/1233] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:47:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 03:47:25.505342 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2350e63-152e-465d-a875-1dbcab41c04f None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:25.505794 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2350e63-152e-465d-a875-1dbcab41c04f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:25.505896 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2350e63-152e-465d-a875-1dbcab41c04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:25.529725 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-c2350e63-152e-465d-a875-1dbcab41c04f None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:47:25.534833 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c2350e63-152e-465d-a875-1dbcab41c04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:47:25.625190 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 620/1234] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:47:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:47:25.648606 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8eca8b-15d6-4ac0-94d6-807a06bf489c None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:25.677621 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:25.753749 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8eca8b-15d6-4ac0-94d6-807a06bf489c None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:25.788268 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734470b-2281-4c82-8c83-3c80d49b90fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:25.789592 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734470b-2281-4c82-8c83-3c80d49b90fd None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:25.789874 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734470b-2281-4c82-8c83-3c80d49b90fd None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:25.790148 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734470b-2281-4c82-8c83-3c80d49b90fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:25.800136 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4734470b-2281-4c82-8c83-3c80d49b90fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:47:25.808174 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-4734470b-2281-4c82-8c83-3c80d49b90fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 03:47:25.808174 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:47:25.808174 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:47:25.808174 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:47:25.808174 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:47:25.808174 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:47:25.808174 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:47:25.808174 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:47:25.808174 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:47:25.808174 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:47:25.808174 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:47:25.808174 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:47:25.808174 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:47:25.808174 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:47:25.808174 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:47:25.808174 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:47:25.809306 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:47:25.809306 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:47:25.809306 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:47:25.809306 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:47:25.809306 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:47:25.809306 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:47:25.809306 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:47:25.809306 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:47:25.809306 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:47:25.809306 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:47:25.809306 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:47:25.809306 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:47:25.809306 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:47:25.809306 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:47:25.809306 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:47:25.809306 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:47:25.810313 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:47:25.810313 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:47:25.810313 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:47:25.810313 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:47:25.810313 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:47:25.810313 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:47:25.810313 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:47:25.810313 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:47:25.810313 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:47:25.810313 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:47:25.810313 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 03:47:25.810313 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:47:25.810313 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 615/1235] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Jul 1 03:47:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:47:25.815775 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2350e63-152e-465d-a875-1dbcab41c04f None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:25.862249 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:25.916200 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2350e63-152e-465d-a875-1dbcab41c04f None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:25.950124 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95397cc-48b3-4c8c-9dd6-a7608473e083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:25.950800 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95397cc-48b3-4c8c-9dd6-a7608473e083 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:25.951079 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95397cc-48b3-4c8c-9dd6-a7608473e083 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:25.951354 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95397cc-48b3-4c8c-9dd6-a7608473e083 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:25.952135 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95397cc-48b3-4c8c-9dd6-a7608473e083 None admin] RBAC: Adding query filter params (name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:47:25.952444 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95397cc-48b3-4c8c-9dd6-a7608473e083 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:25.953830 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95397cc-48b3-4c8c-9dd6-a7608473e083 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:25.964641 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 621/1236] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Jul 1 03:47:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:47:25.970727 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734470b-2281-4c82-8c83-3c80d49b90fd None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:26.056334 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:26.071914 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734470b-2281-4c82-8c83-3c80d49b90fd None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:26.104383 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4b7c3-7667-472f-9065-1d96c3f86d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:26.105171 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4b7c3-7667-472f-9065-1d96c3f86d28 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:26.105449 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4b7c3-7667-472f-9065-1d96c3f86d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:26.105716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4b7c3-7667-472f-9065-1d96c3f86d28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:26.116091 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df4b7c3-7667-472f-9065-1d96c3f86d28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:26.117918 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df4b7c3-7667-472f-9065-1d96c3f86d28 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:26.135707 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-2df4b7c3-7667-472f-9065-1d96c3f86d28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:47:26.135707 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:47:26.135707 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:47:26.135707 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:47:26.135707 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:47:26.135707 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:47:26.135707 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:47:26.135707 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:47:26.135707 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:47:26.135707 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:47:26.135707 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:47:26.135707 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:47:26.135707 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:47:26.135707 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:47:26.135707 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:47:26.136874 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:47:26.136874 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:47:26.136874 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:47:26.136874 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:47:26.136874 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:47:26.136874 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:47:26.136874 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:47:26.136874 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:47:26.136874 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:47:26.136874 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:47:26.136874 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:47:26.136874 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:47:26.136874 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:47:26.136874 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:47:26.136874 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:47:26.136874 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:47:26.136874 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:47:26.137993 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:47:26.137993 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:47:26.137993 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:47:26.137993 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:47:26.137993 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 616/1237] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:47:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:47:26.142736 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95397cc-48b3-4c8c-9dd6-a7608473e083 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:26.241996 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95397cc-48b3-4c8c-9dd6-a7608473e083 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:26.250996 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:26.276309 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be190964-e4b1-4aee-8e48-be1699f179c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:26.276974 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be190964-e4b1-4aee-8e48-be1699f179c6 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:26.277258 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be190964-e4b1-4aee-8e48-be1699f179c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:26.277534 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be190964-e4b1-4aee-8e48-be1699f179c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:26.278251 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be190964-e4b1-4aee-8e48-be1699f179c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:47:26.278558 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be190964-e4b1-4aee-8e48-be1699f179c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:26.280232 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be190964-e4b1-4aee-8e48-be1699f179c6 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:26.291588 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 622/1238] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:47:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:47:26.297251 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4b7c3-7667-472f-9065-1d96c3f86d28 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:26.397813 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4b7c3-7667-472f-9065-1d96c3f86d28 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:26.432581 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54f641-6262-4110-b644-97ec1495ed01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:26.433396 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54f641-6262-4110-b644-97ec1495ed01 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:26.433682 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54f641-6262-4110-b644-97ec1495ed01 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:26.433963 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54f641-6262-4110-b644-97ec1495ed01 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:26.436775 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:26.441849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54f641-6262-4110-b644-97ec1495ed01 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:26.455424 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54f641-6262-4110-b644-97ec1495ed01 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:26.457533 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-de54f641-6262-4110-b644-97ec1495ed01 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 01 03:47:26.457533 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:47:26.457533 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:47:26.457533 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:47:26.457533 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:47:26.457533 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:47:26.457533 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:47:26.457533 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:47:26.457533 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:47:26.457533 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:47:26.457533 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:47:26.457533 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:47:26.457533 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 03:47:26.457533 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 03:47:26.457533 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 03:47:26.457533 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 03:47:26.458644 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:47:26.458644 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:47:26.458644 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 03:47:26.458644 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:47:26.458644 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 03:47:26.458644 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:47:26.458644 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:47:26.458644 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:47:26.458644 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:47:26.458644 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:47:26.458644 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:47:26.458644 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:47:26.458644 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:47:26.458644 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:47:26.458644 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:47:26.458644 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:47:26.458644 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:47:26.458644 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:47:26.459655 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:47:26.459655 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:47:26.459655 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 03:47:26.459655 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 03:47:26.459655 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 03:47:26.459655 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 03:47:26.459655 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 03:47:26.459655 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 03:47:26.459655 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 01 03:47:26.459655 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:47:26.459655 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 617/1239] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:47:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:47:26.465125 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be190964-e4b1-4aee-8e48-be1699f179c6 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:26.569712 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be190964-e4b1-4aee-8e48-be1699f179c6 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:26.604359 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76727c-4b92-4d06-a514-352e4ca4b4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:26.605030 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76727c-4b92-4d06-a514-352e4ca4b4eb None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:26.605310 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76727c-4b92-4d06-a514-352e4ca4b4eb None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:26.605583 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76727c-4b92-4d06-a514-352e4ca4b4eb None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:26.606406 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f76727c-4b92-4d06-a514-352e4ca4b4eb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:47:26.606712 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f76727c-4b92-4d06-a514-352e4ca4b4eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:26.608177 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f76727c-4b92-4d06-a514-352e4ca4b4eb None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:26.625404 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 623/1240] 10.222.0.46 () {56 vars in 1143 bytes} [Fri Jul 1 03:47:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:47:26.631109 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54f641-6262-4110-b644-97ec1495ed01 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:26.730648 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54f641-6262-4110-b644-97ec1495ed01 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:26.764364 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e4d858-ce8d-45f8-97d9-de38ab68b825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:26.765017 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4d858-ce8d-45f8-97d9-de38ab68b825 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:26.765303 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4d858-ce8d-45f8-97d9-de38ab68b825 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:26.765579 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4d858-ce8d-45f8-97d9-de38ab68b825 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:26.828978 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:26.836345 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e4d858-ce8d-45f8-97d9-de38ab68b825 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:26.837793 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e4d858-ce8d-45f8-97d9-de38ab68b825 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:26.937678 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 618/1241] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:47:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 03:47:26.943739 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76727c-4b92-4d06-a514-352e4ca4b4eb None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:26.972382 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:27.047122 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76727c-4b92-4d06-a514-352e4ca4b4eb None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:27.082152 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a340583a-058d-47a6-b74c-484a3c519012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:27.082944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340583a-058d-47a6-b74c-484a3c519012 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:27.083231 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340583a-058d-47a6-b74c-484a3c519012 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:27.083527 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340583a-058d-47a6-b74c-484a3c519012 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:27.093539 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a340583a-058d-47a6-b74c-484a3c519012 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:27.094981 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a340583a-058d-47a6-b74c-484a3c519012 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:27.112815 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-a340583a-058d-47a6-b74c-484a3c519012 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:47:27.112815 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:47:27.112815 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:47:27.112815 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:47:27.112815 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:47:27.112815 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:47:27.112815 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:47:27.112815 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:47:27.112815 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:47:27.112815 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:47:27.112815 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:47:27.112815 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:47:27.112815 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:47:27.112815 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:47:27.112815 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:47:27.113915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:47:27.113915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:47:27.113915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:47:27.113915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:47:27.113915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:47:27.113915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:47:27.113915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:47:27.113915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:47:27.113915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:47:27.113915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:47:27.113915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:47:27.113915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:47:27.113915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:47:27.113915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:47:27.113915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:47:27.113915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:47:27.113915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:47:27.114840 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:47:27.114840 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:47:27.114840 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:47:27.114840 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:47:27.114840 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 624/1242] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:47:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:47:27.120405 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e4d858-ce8d-45f8-97d9-de38ab68b825 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:27.223268 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:27.229686 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e4d858-ce8d-45f8-97d9-de38ab68b825 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:27.262848 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23672da8-e61f-435f-8f46-4811c355abeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:27.263531 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23672da8-e61f-435f-8f46-4811c355abeb None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:27.263814 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23672da8-e61f-435f-8f46-4811c355abeb None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:27.264089 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23672da8-e61f-435f-8f46-4811c355abeb None admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:27.264806 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23672da8-e61f-435f-8f46-4811c355abeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:47:27.265109 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23672da8-e61f-435f-8f46-4811c355abeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:27.266465 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23672da8-e61f-435f-8f46-4811c355abeb None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:27.277944 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 619/1243] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:47:27.283893 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a340583a-058d-47a6-b74c-484a3c519012 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:27.365480 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:27.391668 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a340583a-058d-47a6-b74c-484a3c519012 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:27.427839 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c81b4c9-b739-442c-9d49-c7f2c1e3bd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:27.428639 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81b4c9-b739-442c-9d49-c7f2c1e3bd12 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:27.428925 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81b4c9-b739-442c-9d49-c7f2c1e3bd12 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:27.429203 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81b4c9-b739-442c-9d49-c7f2c1e3bd12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:27.436143 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c81b4c9-b739-442c-9d49-c7f2c1e3bd12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:27.437663 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c81b4c9-b739-442c-9d49-c7f2c1e3bd12 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:27.452641 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-7c81b4c9-b739-442c-9d49-c7f2c1e3bd12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:47:27.452641 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:47:27.452641 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:47:27.452641 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:47:27.452641 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:47:27.452641 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:47:27.452641 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:47:27.452641 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:47:27.452641 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:47:27.452641 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:47:27.452641 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:47:27.452641 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:47:27.452641 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 03:47:27.452641 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 03:47:27.452641 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 03:47:27.453749 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 03:47:27.453749 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:47:27.453749 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:47:27.453749 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:47:27.453749 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:47:27.453749 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:47:27.453749 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:47:27.453749 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:47:27.453749 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:47:27.453749 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:47:27.453749 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:47:27.453749 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:47:27.453749 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:47:27.453749 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:47:27.453749 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:47:27.453749 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:47:27.453749 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:47:27.454763 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 03:47:27.454763 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 03:47:27.454763 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 03:47:27.454763 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 03:47:27.454763 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 03:47:27.454763 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 03:47:27.454763 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:47:27.454763 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:47:27.454763 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 625/1244] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:47:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:47:27.459981 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23672da8-e61f-435f-8f46-4811c355abeb None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:27.563885 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23672da8-e61f-435f-8f46-4811c355abeb None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:27.598465 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc316b3-a4ba-401e-8c15-69154ddd957f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:27.599196 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc316b3-a4ba-401e-8c15-69154ddd957f None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:27.599497 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc316b3-a4ba-401e-8c15-69154ddd957f None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:27.599886 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc316b3-a4ba-401e-8c15-69154ddd957f None admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:27.600542 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc316b3-a4ba-401e-8c15-69154ddd957f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:47:27.600846 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc316b3-a4ba-401e-8c15-69154ddd957f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:27.602300 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc316b3-a4ba-401e-8c15-69154ddd957f None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:27.614258 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 620/1245] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 1 03:47:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:47:27.620532 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c81b4c9-b739-442c-9d49-c7f2c1e3bd12 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:27.723958 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c81b4c9-b739-442c-9d49-c7f2c1e3bd12 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:27.758076 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb3239-9d94-487f-9f31-d46af2dcc924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:27.758769 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb3239-9d94-487f-9f31-d46af2dcc924 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:27.759129 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb3239-9d94-487f-9f31-d46af2dcc924 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:27.759402 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb3239-9d94-487f-9f31-d46af2dcc924 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:27.760255 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb3239-9d94-487f-9f31-d46af2dcc924 None admin] RBAC: Adding query filter params (role.id=66426d7dd6f64f6ebfcb1cbb8188b0d2, scope.project.id=da83db15a312499fb627691ae442f233, user.id=4efe4a6dd11047688892641a936e2914) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:47:27.760567 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb3239-9d94-487f-9f31-d46af2dcc924 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:27.762014 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb3239-9d94-487f-9f31-d46af2dcc924 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:27.768215 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 626/1246] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:47:27 2022] GET /identity/v3/role_assignments?user.id=4efe4a6dd11047688892641a936e2914&scope.project.id=da83db15a312499fb627691ae442f233&role.id=66426d7dd6f64f6ebfcb1cbb8188b0d2 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:47:29.886323 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887bb40-1765-43d3-9b6b-3f812d9bc767 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:29.886859 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887bb40-1765-43d3-9b6b-3f812d9bc767 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:29.886859 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887bb40-1765-43d3-9b6b-3f812d9bc767 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:29.888231 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 621/1247] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:47:29.893806 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3cd69b-89fb-4624-b3ef-7a3f6a148c6b None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:29.894204 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3cd69b-89fb-4624-b3ef-7a3f6a148c6b None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:29.894370 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3cd69b-89fb-4624-b3ef-7a3f6a148c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:29.900009 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:29.912583 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-0a3cd69b-89fb-4624-b3ef-7a3f6a148c6b None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:47:29.913809 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0a3cd69b-89fb-4624-b3ef-7a3f6a148c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:47:29.979546 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 627/1248] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:47:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:47:30.003970 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887bb40-1765-43d3-9b6b-3f812d9bc767 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:30.022136 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:30.104043 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887bb40-1765-43d3-9b6b-3f812d9bc767 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:30.137466 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf13db-a238-4f3d-bc32-630786f1f48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:30.138195 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf13db-a238-4f3d-bc32-630786f1f48f None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:30.138480 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf13db-a238-4f3d-bc32-630786f1f48f None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:30.138759 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf13db-a238-4f3d-bc32-630786f1f48f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:30.149210 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbf13db-a238-4f3d-bc32-630786f1f48f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:47:30.157277 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-7dbf13db-a238-4f3d-bc32-630786f1f48f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:47:30.157277 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:47:30.157277 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:47:30.157277 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:47:30.157277 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:47:30.157277 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:47:30.157277 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:47:30.157277 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:47:30.157277 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:47:30.157277 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:47:30.157277 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:47:30.157277 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:47:30.157277 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:47:30.157277 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:47:30.157277 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:47:30.157277 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:47:30.160234 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:47:30.160234 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:47:30.160234 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:47:30.160234 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:47:30.160234 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:47:30.160234 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:47:30.160234 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:47:30.160234 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:47:30.160234 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:47:30.160234 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:47:30.160234 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:47:30.160234 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:47:30.160234 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:47:30.160234 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:47:30.160234 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:47:30.160234 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:47:30.161301 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:47:30.161301 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:47:30.161301 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:47:30.161301 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:47:30.161301 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:47:30.161301 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:47:30.161301 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:47:30.161301 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:47:30.161301 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:47:30.161301 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:47:30.161301 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:47:30.161301 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:47:30.161301 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 622/1249] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 1 03:47:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:47:30.165345 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3cd69b-89fb-4624-b3ef-7a3f6a148c6b None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:30.264036 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3cd69b-89fb-4624-b3ef-7a3f6a148c6b None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:30.295309 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:30.300523 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d482f-e284-4b32-aa1d-efb7e5cf1862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:30.301215 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d482f-e284-4b32-aa1d-efb7e5cf1862 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:30.301502 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d482f-e284-4b32-aa1d-efb7e5cf1862 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:30.301781 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d482f-e284-4b32-aa1d-efb7e5cf1862 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:30.302544 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8d482f-e284-4b32-aa1d-efb7e5cf1862 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:47:30.302859 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8d482f-e284-4b32-aa1d-efb7e5cf1862 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:30.304409 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8d482f-e284-4b32-aa1d-efb7e5cf1862 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:30.313610 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 628/1250] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:47:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:47:30.319443 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf13db-a238-4f3d-bc32-630786f1f48f None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:30.397354 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:30.419632 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf13db-a238-4f3d-bc32-630786f1f48f None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:30.452296 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47004bbf-8d22-4ef2-89d7-453de9bf25b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:30.453099 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47004bbf-8d22-4ef2-89d7-453de9bf25b2 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:30.453374 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47004bbf-8d22-4ef2-89d7-453de9bf25b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:30.453644 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47004bbf-8d22-4ef2-89d7-453de9bf25b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:30.464143 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47004bbf-8d22-4ef2-89d7-453de9bf25b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:30.465655 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47004bbf-8d22-4ef2-89d7-453de9bf25b2 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:30.482164 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-47004bbf-8d22-4ef2-89d7-453de9bf25b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:47:30.482164 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:47:30.482164 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:47:30.482164 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:47:30.482164 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:47:30.482164 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:47:30.482164 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:47:30.482164 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:47:30.482164 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:47:30.482164 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:47:30.482164 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:47:30.482164 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:47:30.482164 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:47:30.482164 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:47:30.482164 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:47:30.483261 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:47:30.483261 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:47:30.483261 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:47:30.483261 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:47:30.483261 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:47:30.483261 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:47:30.483261 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:47:30.483261 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:47:30.483261 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:47:30.483261 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:47:30.483261 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:47:30.483261 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:47:30.483261 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:47:30.483261 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:47:30.483261 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:47:30.483261 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:47:30.483261 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:47:30.484421 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:47:30.484421 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:47:30.484421 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:47:30.484421 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:47:30.487602 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 623/1251] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:47:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:47:30.489167 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d482f-e284-4b32-aa1d-efb7e5cf1862 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:30.589429 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d482f-e284-4b32-aa1d-efb7e5cf1862 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:30.622676 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1f536-4838-46a0-889d-be0d24d881a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:30.623347 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1f536-4838-46a0-889d-be0d24d881a3 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:30.623633 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1f536-4838-46a0-889d-be0d24d881a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:30.623908 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1f536-4838-46a0-889d-be0d24d881a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:30.624623 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1f536-4838-46a0-889d-be0d24d881a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:47:30.624928 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1f536-4838-46a0-889d-be0d24d881a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:30.626298 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1f536-4838-46a0-889d-be0d24d881a3 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:30.638627 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 629/1252] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:47:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:47:30.644665 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47004bbf-8d22-4ef2-89d7-453de9bf25b2 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:30.751147 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47004bbf-8d22-4ef2-89d7-453de9bf25b2 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:30.776002 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:30.783717 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14027a0e-cd66-4d3f-9425-f97875de91db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:30.784517 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14027a0e-cd66-4d3f-9425-f97875de91db None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:30.784797 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14027a0e-cd66-4d3f-9425-f97875de91db None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:30.785067 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14027a0e-cd66-4d3f-9425-f97875de91db None admin] PATH_INFO: `/v3/users/placement` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:30.793127 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14027a0e-cd66-4d3f-9425-f97875de91db None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:30.795240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14027a0e-cd66-4d3f-9425-f97875de91db None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:30.809240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-14027a0e-cd66-4d3f-9425-f97875de91db None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 01 03:47:30.809240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:47:30.809240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:47:30.809240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:47:30.809240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:47:30.809240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:47:30.809240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:47:30.809240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:47:30.809240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:47:30.809240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:47:30.809240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:47:30.809240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:47:30.809240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 03:47:30.809240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 03:47:30.809240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 03:47:30.809240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 03:47:30.810233 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:47:30.810233 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:47:30.810233 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 03:47:30.810233 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:47:30.810233 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 03:47:30.810233 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:47:30.810233 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:47:30.810233 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:47:30.810233 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:47:30.810233 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:47:30.810233 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:47:30.810233 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:47:30.810233 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:47:30.810233 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:47:30.810233 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:47:30.810233 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:47:30.810233 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:47:30.810233 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:47:30.811243 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:47:30.811243 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:47:30.811243 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 03:47:30.811243 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 03:47:30.811243 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 03:47:30.811243 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 03:47:30.811243 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 03:47:30.811243 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 03:47:30.811243 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 01 03:47:30.811243 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:47:30.811243 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 624/1253] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:47:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:47:30.816356 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1f536-4838-46a0-889d-be0d24d881a3 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:30.872391 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:30.916660 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1f536-4838-46a0-889d-be0d24d881a3 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:30.950063 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c11bc-c48d-420d-9437-910bc3a54195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:30.950738 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c11bc-c48d-420d-9437-910bc3a54195 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:30.951017 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c11bc-c48d-420d-9437-910bc3a54195 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:30.951292 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c11bc-c48d-420d-9437-910bc3a54195 None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:30.952148 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46c11bc-c48d-420d-9437-910bc3a54195 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:47:30.952456 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46c11bc-c48d-420d-9437-910bc3a54195 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:30.953901 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46c11bc-c48d-420d-9437-910bc3a54195 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:30.971082 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 630/1254] 10.222.0.46 () {56 vars in 1143 bytes} [Fri Jul 1 03:47:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:47:30.976967 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14027a0e-cd66-4d3f-9425-f97875de91db None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:31.077979 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14027a0e-cd66-4d3f-9425-f97875de91db None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:31.112072 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74f47b-0e0e-43c0-8278-fe031b6b82a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:31.112719 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74f47b-0e0e-43c0-8278-fe031b6b82a1 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:31.113003 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74f47b-0e0e-43c0-8278-fe031b6b82a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:31.113279 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74f47b-0e0e-43c0-8278-fe031b6b82a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:31.168516 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:31.180481 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b74f47b-0e0e-43c0-8278-fe031b6b82a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:31.181913 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b74f47b-0e0e-43c0-8278-fe031b6b82a1 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:31.277630 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 625/1255] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:47:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 03:47:31.283973 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c11bc-c48d-420d-9437-910bc3a54195 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:31.388813 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c11bc-c48d-420d-9437-910bc3a54195 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:31.405764 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:31.427028 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c22a8-4c5d-4d17-bb4a-19a4cdc68c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:31.427856 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c22a8-4c5d-4d17-bb4a-19a4cdc68c75 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:31.431794 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c22a8-4c5d-4d17-bb4a-19a4cdc68c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:31.431794 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c22a8-4c5d-4d17-bb4a-19a4cdc68c75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:31.441892 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c22a8-4c5d-4d17-bb4a-19a4cdc68c75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:31.443352 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c22a8-4c5d-4d17-bb4a-19a4cdc68c75 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:31.462014 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-476c22a8-4c5d-4d17-bb4a-19a4cdc68c75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:47:31.462014 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:47:31.462014 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:47:31.462014 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:47:31.462014 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:47:31.462014 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:47:31.462014 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:47:31.462014 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:47:31.462014 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:47:31.462014 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:47:31.462014 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:47:31.462014 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:47:31.462014 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:47:31.462014 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:47:31.462014 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:47:31.463135 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:47:31.463135 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:47:31.463135 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:47:31.463135 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:47:31.463135 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:47:31.463135 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:47:31.463135 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:47:31.463135 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:47:31.463135 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:47:31.463135 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:47:31.463135 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:47:31.463135 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:47:31.463135 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:47:31.463135 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:47:31.463135 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:47:31.463135 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:47:31.463135 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:47:31.464429 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:47:31.464429 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:47:31.464429 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:47:31.464429 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:47:31.464429 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 631/1256] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:47:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:47:31.469119 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74f47b-0e0e-43c0-8278-fe031b6b82a1 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:31.568134 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:31.580438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74f47b-0e0e-43c0-8278-fe031b6b82a1 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:31.614427 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd0fb6c-c389-453a-a45f-6800a40fbd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:31.615100 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0fb6c-c389-453a-a45f-6800a40fbd62 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:31.615385 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0fb6c-c389-453a-a45f-6800a40fbd62 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:31.615750 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0fb6c-c389-453a-a45f-6800a40fbd62 None admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:31.616479 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd0fb6c-c389-453a-a45f-6800a40fbd62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:47:31.617303 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd0fb6c-c389-453a-a45f-6800a40fbd62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:31.618672 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd0fb6c-c389-453a-a45f-6800a40fbd62 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:31.629958 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 626/1257] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:47:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:47:31.636233 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c22a8-4c5d-4d17-bb4a-19a4cdc68c75 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:31.740159 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c22a8-4c5d-4d17-bb4a-19a4cdc68c75 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:31.776543 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2f1bd-7209-4508-ae53-694e4afbbaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:31.779416 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2f1bd-7209-4508-ae53-694e4afbbaee None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:31.779416 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2f1bd-7209-4508-ae53-694e4afbbaee None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:31.779416 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2f1bd-7209-4508-ae53-694e4afbbaee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:31.785288 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e2f1bd-7209-4508-ae53-694e4afbbaee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:31.786885 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e2f1bd-7209-4508-ae53-694e4afbbaee None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:31.801207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-05e2f1bd-7209-4508-ae53-694e4afbbaee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:47:31.801207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:47:31.801207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:47:31.801207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:47:31.801207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:47:31.801207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:47:31.801207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:47:31.801207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:47:31.801207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:47:31.801207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:47:31.801207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:47:31.801207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:47:31.801207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 03:47:31.801207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 03:47:31.801207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 03:47:31.802127 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 03:47:31.802127 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:47:31.802127 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:47:31.802127 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:47:31.802127 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:47:31.802127 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:47:31.802127 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:47:31.802127 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:47:31.802127 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:47:31.802127 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:47:31.802127 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:47:31.802127 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:47:31.802127 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:47:31.802127 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:47:31.802127 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:47:31.802127 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:47:31.802127 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:47:31.803028 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 03:47:31.803028 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 03:47:31.803028 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 03:47:31.803028 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 03:47:31.803028 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 03:47:31.803028 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 03:47:31.803028 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:47:31.803028 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:47:31.803028 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 632/1258] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:47:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:47:31.809407 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd0fb6c-c389-453a-a45f-6800a40fbd62 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:31.914666 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd0fb6c-c389-453a-a45f-6800a40fbd62 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:31.947432 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badcc8dd-3751-4c93-9570-ba8985f17757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:31.948137 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcc8dd-3751-4c93-9570-ba8985f17757 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:31.948420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcc8dd-3751-4c93-9570-ba8985f17757 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:31.948684 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcc8dd-3751-4c93-9570-ba8985f17757 None admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:31.949465 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badcc8dd-3751-4c93-9570-ba8985f17757 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:47:31.949766 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badcc8dd-3751-4c93-9570-ba8985f17757 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:31.951178 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badcc8dd-3751-4c93-9570-ba8985f17757 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:31.963610 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 627/1259] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 1 03:47:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:47:31.970144 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2f1bd-7209-4508-ae53-694e4afbbaee None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:32.001101 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:32.077592 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2f1bd-7209-4508-ae53-694e4afbbaee None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:32.114231 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2389c18-6a47-4458-94ba-d1873b2570a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:32.114892 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2389c18-6a47-4458-94ba-d1873b2570a9 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:32.115175 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2389c18-6a47-4458-94ba-d1873b2570a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:32.115483 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2389c18-6a47-4458-94ba-d1873b2570a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:32.116312 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2389c18-6a47-4458-94ba-d1873b2570a9 None admin] RBAC: Adding query filter params (role.id=681755518698445fabd9a8accec13c0f, scope.project.id=da83db15a312499fb627691ae442f233, user.id=4efe4a6dd11047688892641a936e2914) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:47:32.116627 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2389c18-6a47-4458-94ba-d1873b2570a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:32.118118 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2389c18-6a47-4458-94ba-d1873b2570a9 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:32.124085 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 633/1260] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:47:31 2022] GET /identity/v3/role_assignments?user.id=4efe4a6dd11047688892641a936e2914&scope.project.id=da83db15a312499fb627691ae442f233&role.id=681755518698445fabd9a8accec13c0f => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:47:34.145283 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619ee9d-31b6-4e61-bc31-77abd55841c9 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:34.146020 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619ee9d-31b6-4e61-bc31-77abd55841c9 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:34.146020 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619ee9d-31b6-4e61-bc31-77abd55841c9 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:34.147302 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 628/1261] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:47:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:47:34.153378 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd889d1f-bed0-4ca1-8348-5be08af1e3c3 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:34.153788 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd889d1f-bed0-4ca1-8348-5be08af1e3c3 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:34.153969 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd889d1f-bed0-4ca1-8348-5be08af1e3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:34.171661 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-dd889d1f-bed0-4ca1-8348-5be08af1e3c3 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:47:34.172862 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-dd889d1f-bed0-4ca1-8348-5be08af1e3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:47:34.241043 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 634/1262] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:47:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:47:34.264661 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619ee9d-31b6-4e61-bc31-77abd55841c9 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:34.276261 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:34.367211 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619ee9d-31b6-4e61-bc31-77abd55841c9 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:34.403659 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a344266-a35f-4159-9e49-125848d8e098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:34.404450 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a344266-a35f-4159-9e49-125848d8e098 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:34.404736 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a344266-a35f-4159-9e49-125848d8e098 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:34.405013 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a344266-a35f-4159-9e49-125848d8e098 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:34.415768 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a344266-a35f-4159-9e49-125848d8e098 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:47:34.423667 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-6a344266-a35f-4159-9e49-125848d8e098 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:47:34.423667 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:47:34.423667 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:47:34.423667 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:47:34.423667 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:47:34.423667 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:47:34.423667 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:47:34.423667 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:47:34.423667 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:47:34.423667 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:47:34.423667 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:47:34.423667 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:47:34.423667 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:47:34.423667 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:47:34.423667 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:47:34.423667 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:47:34.424905 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:47:34.424905 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:47:34.424905 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:47:34.424905 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:47:34.424905 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:47:34.424905 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:47:34.424905 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:47:34.424905 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:47:34.424905 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:47:34.424905 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:47:34.424905 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:47:34.424905 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:47:34.424905 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:47:34.424905 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:47:34.424905 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:47:34.424905 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:47:34.425827 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:47:34.425827 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:47:34.425827 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:47:34.425827 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:47:34.425827 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:47:34.425827 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:47:34.425827 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:47:34.425827 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:47:34.425827 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:47:34.425827 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:47:34.425827 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:47:34.425827 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:47:34.425827 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 629/1263] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 1 03:47:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:47:34.431504 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd889d1f-bed0-4ca1-8348-5be08af1e3c3 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:34.450852 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:34.532133 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd889d1f-bed0-4ca1-8348-5be08af1e3c3 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:34.566061 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac754c-94df-4892-86e3-29c5aed19e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:34.566731 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac754c-94df-4892-86e3-29c5aed19e04 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:34.567016 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac754c-94df-4892-86e3-29c5aed19e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:34.567294 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac754c-94df-4892-86e3-29c5aed19e04 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:34.568089 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac754c-94df-4892-86e3-29c5aed19e04 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:47:34.568405 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac754c-94df-4892-86e3-29c5aed19e04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:34.569789 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac754c-94df-4892-86e3-29c5aed19e04 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:34.579333 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 635/1264] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:47:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:47:34.585261 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a344266-a35f-4159-9e49-125848d8e098 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:34.651620 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:34.685152 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a344266-a35f-4159-9e49-125848d8e098 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:34.717682 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46011307-ea0b-4d65-adb5-766abe577d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:34.718474 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46011307-ea0b-4d65-adb5-766abe577d27 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:34.718752 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46011307-ea0b-4d65-adb5-766abe577d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:34.719022 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46011307-ea0b-4d65-adb5-766abe577d27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:34.729382 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46011307-ea0b-4d65-adb5-766abe577d27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:34.730815 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46011307-ea0b-4d65-adb5-766abe577d27 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:34.748299 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-46011307-ea0b-4d65-adb5-766abe577d27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:47:34.748299 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:47:34.748299 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:47:34.748299 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:47:34.748299 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:47:34.748299 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:47:34.748299 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:47:34.748299 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:47:34.748299 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:47:34.748299 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:47:34.748299 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:47:34.748299 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:47:34.748299 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:47:34.748299 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:47:34.748299 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:47:34.749423 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:47:34.749423 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:47:34.749423 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:47:34.749423 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:47:34.749423 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:47:34.749423 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:47:34.749423 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:47:34.749423 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:47:34.749423 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:47:34.749423 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:47:34.749423 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:47:34.749423 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:47:34.749423 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:47:34.749423 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:47:34.749423 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:47:34.749423 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:47:34.749423 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:47:34.750345 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:47:34.750345 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:47:34.750345 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:47:34.750345 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:47:34.750345 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 630/1265] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:47:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 03:47:34.755336 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac754c-94df-4892-86e3-29c5aed19e04 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:34.837885 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:34.856374 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac754c-94df-4892-86e3-29c5aed19e04 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:34.895673 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4fbfd-1816-4f09-b371-9c7c939cdad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:34.896341 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4fbfd-1816-4f09-b371-9c7c939cdad6 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:34.896649 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4fbfd-1816-4f09-b371-9c7c939cdad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:34.897074 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4fbfd-1816-4f09-b371-9c7c939cdad6 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:34.897800 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c4fbfd-1816-4f09-b371-9c7c939cdad6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:47:34.898154 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c4fbfd-1816-4f09-b371-9c7c939cdad6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:34.899565 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c4fbfd-1816-4f09-b371-9c7c939cdad6 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:34.912373 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 636/1266] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:47:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:47:34.918200 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46011307-ea0b-4d65-adb5-766abe577d27 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:35.018969 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46011307-ea0b-4d65-adb5-766abe577d27 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:35.039585 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:35.053221 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06c557-e6b3-4255-9952-109e4cbd590c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:35.054021 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06c557-e6b3-4255-9952-109e4cbd590c None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:35.054301 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06c557-e6b3-4255-9952-109e4cbd590c None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:35.055166 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06c557-e6b3-4255-9952-109e4cbd590c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:35.062847 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd06c557-e6b3-4255-9952-109e4cbd590c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:35.064313 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd06c557-e6b3-4255-9952-109e4cbd590c None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:35.078429 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-dd06c557-e6b3-4255-9952-109e4cbd590c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 01 03:47:35.078429 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:47:35.078429 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:47:35.078429 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:47:35.078429 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:47:35.078429 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:47:35.078429 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:47:35.078429 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:47:35.078429 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:47:35.078429 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:47:35.078429 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:47:35.078429 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:47:35.078429 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 03:47:35.078429 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 03:47:35.078429 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 03:47:35.078429 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 03:47:35.080232 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:47:35.080232 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:47:35.080232 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 03:47:35.080232 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:47:35.080232 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 03:47:35.080232 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:47:35.080232 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:47:35.080232 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:47:35.080232 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:47:35.080232 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:47:35.080232 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:47:35.080232 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:47:35.080232 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:47:35.080232 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:47:35.080232 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:47:35.080232 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:47:35.080232 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:47:35.080232 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:47:35.081929 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:47:35.081929 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:47:35.081929 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 03:47:35.081929 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 03:47:35.081929 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 03:47:35.081929 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 03:47:35.081929 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 03:47:35.081929 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 03:47:35.081929 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 01 03:47:35.081929 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:47:35.081929 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 631/1267] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:47:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:47:35.085641 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4fbfd-1816-4f09-b371-9c7c939cdad6 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:35.187936 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4fbfd-1816-4f09-b371-9c7c939cdad6 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:35.221534 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5bd32e-385b-47dd-a5aa-44fd1b6c3197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:35.222321 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5bd32e-385b-47dd-a5aa-44fd1b6c3197 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:35.222604 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5bd32e-385b-47dd-a5aa-44fd1b6c3197 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:35.222880 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5bd32e-385b-47dd-a5aa-44fd1b6c3197 None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:35.223738 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5bd32e-385b-47dd-a5aa-44fd1b6c3197 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:47:35.224049 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5bd32e-385b-47dd-a5aa-44fd1b6c3197 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:35.225474 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5bd32e-385b-47dd-a5aa-44fd1b6c3197 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:35.235165 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:35.244336 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 637/1268] 10.222.0.46 () {56 vars in 1143 bytes} [Fri Jul 1 03:47:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:47:35.250220 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06c557-e6b3-4255-9952-109e4cbd590c None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:35.353814 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06c557-e6b3-4255-9952-109e4cbd590c None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:35.387777 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b148f-95a9-4d94-a5f8-7aa54b1556b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:35.388579 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b148f-95a9-4d94-a5f8-7aa54b1556b8 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:35.388858 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b148f-95a9-4d94-a5f8-7aa54b1556b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:35.389132 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b148f-95a9-4d94-a5f8-7aa54b1556b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:35.400591 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69b148f-95a9-4d94-a5f8-7aa54b1556b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:35.402061 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69b148f-95a9-4d94-a5f8-7aa54b1556b8 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:35.420658 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-a69b148f-95a9-4d94-a5f8-7aa54b1556b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:47:35.420658 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:47:35.420658 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:47:35.420658 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:47:35.420658 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:47:35.420658 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:47:35.420658 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:47:35.420658 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:47:35.420658 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:47:35.420658 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:47:35.420658 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:47:35.420658 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:47:35.420658 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:47:35.420658 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:47:35.420658 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:47:35.421803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:47:35.421803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:47:35.421803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:47:35.421803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:47:35.421803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:47:35.421803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:47:35.421803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:47:35.421803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:47:35.421803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:47:35.421803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:47:35.421803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:47:35.421803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:47:35.421803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:47:35.421803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:47:35.421803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:47:35.421803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:47:35.421803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:47:35.422713 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:47:35.422713 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:47:35.422713 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:47:35.422713 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:47:35.422713 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 632/1269] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:47:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:47:35.427916 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5bd32e-385b-47dd-a5aa-44fd1b6c3197 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:35.532290 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5bd32e-385b-47dd-a5aa-44fd1b6c3197 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:35.567079 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74ffa1-56e7-452d-a8e2-8a4cd41c23ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:35.567780 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74ffa1-56e7-452d-a8e2-8a4cd41c23ba None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:35.568060 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74ffa1-56e7-452d-a8e2-8a4cd41c23ba None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:35.568339 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74ffa1-56e7-452d-a8e2-8a4cd41c23ba None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:35.569100 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a74ffa1-56e7-452d-a8e2-8a4cd41c23ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:47:35.569404 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a74ffa1-56e7-452d-a8e2-8a4cd41c23ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:35.570962 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a74ffa1-56e7-452d-a8e2-8a4cd41c23ba None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:35.582688 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 638/1270] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:47:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:47:35.589125 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b148f-95a9-4d94-a5f8-7aa54b1556b8 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:35.627210 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:35.693467 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b148f-95a9-4d94-a5f8-7aa54b1556b8 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:35.727284 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c271e91-85f7-4ddc-bc94-4b3af0a2f5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:35.728145 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c271e91-85f7-4ddc-bc94-4b3af0a2f5c3 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:35.728506 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c271e91-85f7-4ddc-bc94-4b3af0a2f5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:35.728795 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c271e91-85f7-4ddc-bc94-4b3af0a2f5c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:35.735752 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c271e91-85f7-4ddc-bc94-4b3af0a2f5c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:35.737256 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c271e91-85f7-4ddc-bc94-4b3af0a2f5c3 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:35.753731 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-1c271e91-85f7-4ddc-bc94-4b3af0a2f5c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:47:35.753731 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:47:35.753731 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:47:35.753731 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:47:35.753731 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:47:35.753731 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:47:35.753731 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:47:35.753731 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:47:35.753731 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:47:35.753731 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:47:35.753731 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:47:35.753731 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:47:35.753731 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 03:47:35.753731 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 03:47:35.753731 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 03:47:35.754854 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 03:47:35.754854 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:47:35.754854 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:47:35.754854 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:47:35.754854 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:47:35.754854 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:47:35.754854 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:47:35.754854 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:47:35.754854 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:47:35.754854 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:47:35.754854 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:47:35.754854 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:47:35.754854 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:47:35.754854 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:47:35.754854 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:47:35.754854 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:47:35.754854 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:47:35.755971 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 03:47:35.755971 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 03:47:35.755971 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 03:47:35.755971 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 03:47:35.755971 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 03:47:35.755971 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 03:47:35.755971 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:47:35.755971 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:47:35.755971 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 633/1271] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:47:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:47:35.761704 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74ffa1-56e7-452d-a8e2-8a4cd41c23ba None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:35.822525 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:35.864623 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74ffa1-56e7-452d-a8e2-8a4cd41c23ba None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:35.898767 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532bab3c-7c50-49f8-8cb0-311ce7522ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:35.899365 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532bab3c-7c50-49f8-8cb0-311ce7522ec9 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:35.899660 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532bab3c-7c50-49f8-8cb0-311ce7522ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:35.899934 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532bab3c-7c50-49f8-8cb0-311ce7522ec9 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:35.900716 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532bab3c-7c50-49f8-8cb0-311ce7522ec9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:47:35.901078 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532bab3c-7c50-49f8-8cb0-311ce7522ec9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:35.903612 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532bab3c-7c50-49f8-8cb0-311ce7522ec9 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:35.917503 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 639/1272] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 1 03:47:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:47:35.924638 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c271e91-85f7-4ddc-bc94-4b3af0a2f5c3 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:36.025135 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:36.034386 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c271e91-85f7-4ddc-bc94-4b3af0a2f5c3 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:36.067073 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f72a4-848a-41b3-99ea-1bd48763406f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:36.067985 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f72a4-848a-41b3-99ea-1bd48763406f None admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:36.068271 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f72a4-848a-41b3-99ea-1bd48763406f None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:36.068541 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f72a4-848a-41b3-99ea-1bd48763406f None admin] PATH_INFO: `/v3/projects/da83db15a312499fb627691ae442f233/users/4efe4a6dd11047688892641a936e2914/roles/681755518698445fabd9a8accec13c0f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:36.070953 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6f72a4-848a-41b3-99ea-1bd48763406f None admin] RBAC: Authorizing `identity:create_grant(project_id=da83db15a312499fb627691ae442f233, user_id=4efe4a6dd11047688892641a936e2914, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:36.072405 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6f72a4-848a-41b3-99ea-1bd48763406f None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:36.184140 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 634/1273] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Jul 1 03:47:35 2022] PUT /identity/v3/projects/da83db15a312499fb627691ae442f233/users/4efe4a6dd11047688892641a936e2914/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 03:47:38.243163 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2a764-6ca9-480f-9729-487fad58cdb5 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:38.243740 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2a764-6ca9-480f-9729-487fad58cdb5 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:38.243740 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2a764-6ca9-480f-9729-487fad58cdb5 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:38.245131 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 640/1274] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:47:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:47:38.250352 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd7d80-4728-49f9-98b1-c0b0d67a5c65 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:38.250778 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd7d80-4728-49f9-98b1-c0b0d67a5c65 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:38.250902 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd7d80-4728-49f9-98b1-c0b0d67a5c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:38.268049 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-85fd7d80-4728-49f9-98b1-c0b0d67a5c65 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:47:38.268851 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-85fd7d80-4728-49f9-98b1-c0b0d67a5c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:47:38.335499 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 635/1275] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:47:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:47:38.359272 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2a764-6ca9-480f-9729-487fad58cdb5 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:38.465534 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2a764-6ca9-480f-9729-487fad58cdb5 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:38.484998 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:38.501638 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f3ef7-b7f3-411d-952a-32e8552372c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:38.502390 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f3ef7-b7f3-411d-952a-32e8552372c3 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:38.502675 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f3ef7-b7f3-411d-952a-32e8552372c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:38.502950 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f3ef7-b7f3-411d-952a-32e8552372c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:38.513751 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f3ef7-b7f3-411d-952a-32e8552372c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 03:47:38.521748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-259f3ef7-b7f3-411d-952a-32e8552372c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:47:38.521748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:47:38.521748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:47:38.521748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:47:38.521748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:47:38.521748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:47:38.521748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:47:38.521748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:47:38.521748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:47:38.521748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:47:38.521748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:47:38.521748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:47:38.521748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 03:47:38.521748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 03:47:38.521748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 03:47:38.521748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 03:47:38.522868 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 03:47:38.522868 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 03:47:38.522868 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 03:47:38.522868 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 03:47:38.522868 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:47:38.522868 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:47:38.522868 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:47:38.522868 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:47:38.522868 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:47:38.522868 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:47:38.522868 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:47:38.522868 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:47:38.522868 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:47:38.522868 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:47:38.522868 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:47:38.522868 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:47:38.524510 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:47:38.524510 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:47:38.524510 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:47:38.524510 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:47:38.524510 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 03:47:38.524510 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 03:47:38.524510 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 03:47:38.524510 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 03:47:38.524510 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 03:47:38.524510 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 03:47:38.524510 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 03:47:38.524510 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:47:38.524510 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 641/1276] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Jul 1 03:47:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:47:38.529709 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd7d80-4728-49f9-98b1-c0b0d67a5c65 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:38.611311 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:38.628537 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd7d80-4728-49f9-98b1-c0b0d67a5c65 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:38.661771 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d1ffd-5877-4468-b96d-01f4e93f911b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:38.662428 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d1ffd-5877-4468-b96d-01f4e93f911b None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:38.662709 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d1ffd-5877-4468-b96d-01f4e93f911b None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:38.662986 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d1ffd-5877-4468-b96d-01f4e93f911b None admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:38.663765 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d1ffd-5877-4468-b96d-01f4e93f911b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:47:38.664636 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d1ffd-5877-4468-b96d-01f4e93f911b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:38.666000 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d1ffd-5877-4468-b96d-01f4e93f911b None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:38.674348 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 636/1277] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Jul 1 03:47:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:47:38.680034 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f3ef7-b7f3-411d-952a-32e8552372c3 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:38.778809 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f3ef7-b7f3-411d-952a-32e8552372c3 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:38.811851 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa37d35-b8bd-43c7-8578-39cd1a84a36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:38.812651 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa37d35-b8bd-43c7-8578-39cd1a84a36f None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:38.812932 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa37d35-b8bd-43c7-8578-39cd1a84a36f None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:38.813209 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa37d35-b8bd-43c7-8578-39cd1a84a36f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:38.824959 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa37d35-b8bd-43c7-8578-39cd1a84a36f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:38.826532 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa37d35-b8bd-43c7-8578-39cd1a84a36f None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:38.845281 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-caa37d35-b8bd-43c7-8578-39cd1a84a36f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:47:38.845281 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:47:38.845281 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:47:38.845281 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:47:38.845281 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:47:38.845281 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:47:38.845281 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:47:38.845281 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:47:38.845281 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:47:38.845281 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:47:38.845281 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:47:38.845281 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:47:38.845281 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:47:38.845281 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:47:38.845281 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:47:38.846443 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:47:38.846443 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:47:38.846443 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:47:38.846443 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:47:38.846443 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:47:38.846443 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:47:38.846443 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:47:38.846443 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:47:38.846443 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:47:38.846443 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:47:38.846443 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:47:38.846443 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:47:38.846443 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:47:38.846443 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:47:38.846443 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:47:38.846443 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:47:38.846443 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:47:38.847584 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:47:38.847584 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:47:38.847584 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:47:38.847584 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:47:38.847584 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 642/1278] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:47:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:47:38.852484 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d1ffd-5877-4468-b96d-01f4e93f911b None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:38.951884 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d1ffd-5877-4468-b96d-01f4e93f911b None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:38.985047 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7427da3-e91b-4e8a-b2e3-4bf9aed54856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:38.985705 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7427da3-e91b-4e8a-b2e3-4bf9aed54856 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:38.985987 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7427da3-e91b-4e8a-b2e3-4bf9aed54856 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:38.986263 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7427da3-e91b-4e8a-b2e3-4bf9aed54856 None admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:38.986975 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7427da3-e91b-4e8a-b2e3-4bf9aed54856 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:47:38.987282 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7427da3-e91b-4e8a-b2e3-4bf9aed54856 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:38.988692 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7427da3-e91b-4e8a-b2e3-4bf9aed54856 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:39.000184 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 637/1279] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:47:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:47:39.005810 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa37d35-b8bd-43c7-8578-39cd1a84a36f None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:39.037229 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:39.105214 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa37d35-b8bd-43c7-8578-39cd1a84a36f None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:39.139895 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195dc44-18fb-4e64-958a-1d6132773ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:39.140733 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195dc44-18fb-4e64-958a-1d6132773ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:39.141012 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195dc44-18fb-4e64-958a-1d6132773ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:39.141288 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195dc44-18fb-4e64-958a-1d6132773ee5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:39.149251 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8195dc44-18fb-4e64-958a-1d6132773ee5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:39.150690 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8195dc44-18fb-4e64-958a-1d6132773ee5 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:39.165533 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-8195dc44-18fb-4e64-958a-1d6132773ee5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 01 03:47:39.165533 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:47:39.165533 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:47:39.165533 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:47:39.165533 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:47:39.165533 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:47:39.165533 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:47:39.165533 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:47:39.165533 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:47:39.165533 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:47:39.165533 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:47:39.165533 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:47:39.165533 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 03:47:39.165533 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 03:47:39.165533 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 03:47:39.165533 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 03:47:39.166654 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:47:39.166654 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:47:39.166654 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 03:47:39.166654 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:47:39.166654 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 03:47:39.166654 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 03:47:39.166654 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:47:39.166654 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:47:39.166654 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:47:39.166654 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:47:39.166654 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:47:39.166654 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:47:39.166654 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:47:39.166654 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:47:39.166654 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:47:39.166654 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:47:39.166654 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:47:39.166654 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:47:39.168133 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:47:39.168133 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:47:39.168133 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 03:47:39.168133 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 03:47:39.168133 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 03:47:39.168133 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 03:47:39.168133 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 03:47:39.168133 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 03:47:39.168133 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 01 03:47:39.168133 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:47:39.168133 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 643/1280] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:47:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 03:47:39.172490 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7427da3-e91b-4e8a-b2e3-4bf9aed54856 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:39.176357 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:39.271405 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7427da3-e91b-4e8a-b2e3-4bf9aed54856 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:39.307390 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37378092-dced-49ab-9a32-98b6e7e56b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:39.308007 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37378092-dced-49ab-9a32-98b6e7e56b43 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:39.308285 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37378092-dced-49ab-9a32-98b6e7e56b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:39.308562 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37378092-dced-49ab-9a32-98b6e7e56b43 None admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:39.309388 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37378092-dced-49ab-9a32-98b6e7e56b43 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:47:39.309697 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37378092-dced-49ab-9a32-98b6e7e56b43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:39.311106 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37378092-dced-49ab-9a32-98b6e7e56b43 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:39.328141 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 638/1281] 10.222.0.46 () {56 vars in 1143 bytes} [Fri Jul 1 03:47:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 03:47:39.333957 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195dc44-18fb-4e64-958a-1d6132773ee5 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:39.429495 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:39.438798 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195dc44-18fb-4e64-958a-1d6132773ee5 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:39.471536 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c69dae-a3cf-4e18-a59b-efe10d171422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:39.472241 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c69dae-a3cf-4e18-a59b-efe10d171422 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:39.472549 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c69dae-a3cf-4e18-a59b-efe10d171422 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:39.472788 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c69dae-a3cf-4e18-a59b-efe10d171422 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:39.541719 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c69dae-a3cf-4e18-a59b-efe10d171422 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:39.543758 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c69dae-a3cf-4e18-a59b-efe10d171422 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:39.634476 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:39.644611 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 644/1282] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Jul 1 03:47:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 03:47:39.651130 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37378092-dced-49ab-9a32-98b6e7e56b43 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:39.714637 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:39.753023 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37378092-dced-49ab-9a32-98b6e7e56b43 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:39.787984 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1d623-7d10-4ae7-beb4-6fbe4c838b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:39.788783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1d623-7d10-4ae7-beb4-6fbe4c838b7c None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:39.789564 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1d623-7d10-4ae7-beb4-6fbe4c838b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:39.789837 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1d623-7d10-4ae7-beb4-6fbe4c838b7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:39.800185 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc1d623-7d10-4ae7-beb4-6fbe4c838b7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:39.806209 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc1d623-7d10-4ae7-beb4-6fbe4c838b7c None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:39.820781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-8dc1d623-7d10-4ae7-beb4-6fbe4c838b7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:47:39.820781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:47:39.820781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:47:39.820781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:47:39.820781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:47:39.820781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:47:39.820781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:47:39.820781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:47:39.820781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:47:39.820781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:47:39.820781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:47:39.820781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:47:39.820781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 03:47:39.820781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 03:47:39.820781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 03:47:39.821961 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 03:47:39.821961 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:47:39.821961 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:47:39.821961 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:47:39.821961 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:47:39.821961 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:47:39.821961 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:47:39.821961 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:47:39.821961 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:47:39.821961 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:47:39.821961 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:47:39.821961 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:47:39.821961 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:47:39.821961 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:47:39.821961 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:47:39.821961 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:47:39.821961 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:47:39.823079 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 03:47:39.823079 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 03:47:39.823079 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 03:47:39.823079 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:47:39.823079 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 639/1283] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:47:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:47:39.828109 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c69dae-a3cf-4e18-a59b-efe10d171422 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:39.929414 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c69dae-a3cf-4e18-a59b-efe10d171422 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:39.963349 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef8b49-6986-4ebe-b8c9-1b05422d523b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:39.964032 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef8b49-6986-4ebe-b8c9-1b05422d523b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:39.964313 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef8b49-6986-4ebe-b8c9-1b05422d523b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:39.964585 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef8b49-6986-4ebe-b8c9-1b05422d523b None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:39.965290 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eef8b49-6986-4ebe-b8c9-1b05422d523b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:47:39.965592 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eef8b49-6986-4ebe-b8c9-1b05422d523b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:39.966955 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eef8b49-6986-4ebe-b8c9-1b05422d523b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:39.978049 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 645/1284] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Jul 1 03:47:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:47:39.983690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1d623-7d10-4ae7-beb4-6fbe4c838b7c None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:40.083817 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1d623-7d10-4ae7-beb4-6fbe4c838b7c None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:40.105150 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:40.126316 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0cce6b-dc1e-4b1e-b77f-9373e1a0ab9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:40.127110 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0cce6b-dc1e-4b1e-b77f-9373e1a0ab9f None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:40.127388 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0cce6b-dc1e-4b1e-b77f-9373e1a0ab9f None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:40.127693 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0cce6b-dc1e-4b1e-b77f-9373e1a0ab9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:40.135334 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0cce6b-dc1e-4b1e-b77f-9373e1a0ab9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:40.136815 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0cce6b-dc1e-4b1e-b77f-9373e1a0ab9f None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:40.151425 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application [None req-bf0cce6b-dc1e-4b1e-b77f-9373e1a0ab9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:47:40.151425 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:47:40.151425 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:47:40.151425 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:47:40.151425 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:47:40.151425 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:47:40.151425 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:47:40.151425 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:47:40.151425 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:47:40.151425 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:47:40.151425 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:47:40.151425 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:47:40.151425 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 03:47:40.151425 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 03:47:40.151425 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 03:47:40.152544 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 03:47:40.152544 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:47:40.152544 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:47:40.152544 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:47:40.152544 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:47:40.152544 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:47:40.152544 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:47:40.152544 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:47:40.152544 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application with Lock( Jul 01 03:47:40.152544 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:47:40.152544 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:47:40.152544 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:47:40.152544 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:47:40.152544 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:47:40.152544 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:47:40.152544 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:47:40.152544 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:47:40.153852 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 03:47:40.153852 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 03:47:40.153852 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 03:47:40.153852 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 03:47:40.153852 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 03:47:40.153852 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 03:47:40.153852 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 03:47:40.153852 dv-cinder-846842-8-smb devstack@keystone.service[80376]: ERROR keystone.server.flask.application Jul 01 03:47:40.153852 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 640/1285] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Jul 1 03:47:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:47:40.158821 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef8b49-6986-4ebe-b8c9-1b05422d523b None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:40.210537 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:40.263187 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef8b49-6986-4ebe-b8c9-1b05422d523b None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:40.296879 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc704b25-91c6-4ff4-b04b-cdf9969f293e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:40.297537 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc704b25-91c6-4ff4-b04b-cdf9969f293e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:40.297817 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc704b25-91c6-4ff4-b04b-cdf9969f293e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:40.298097 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc704b25-91c6-4ff4-b04b-cdf9969f293e None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:40.298870 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc704b25-91c6-4ff4-b04b-cdf9969f293e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:47:40.299177 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc704b25-91c6-4ff4-b04b-cdf9969f293e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:40.300686 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc704b25-91c6-4ff4-b04b-cdf9969f293e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:40.314005 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 646/1286] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Jul 1 03:47:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:47:40.320097 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0cce6b-dc1e-4b1e-b77f-9373e1a0ab9f None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:40.425936 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0cce6b-dc1e-4b1e-b77f-9373e1a0ab9f None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:40.464795 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f9d07-64a7-4e7a-8c62-44812124acbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:40.465388 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f9d07-64a7-4e7a-8c62-44812124acbb None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:40.465677 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f9d07-64a7-4e7a-8c62-44812124acbb None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:40.465954 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f9d07-64a7-4e7a-8c62-44812124acbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:40.466803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f9d07-64a7-4e7a-8c62-44812124acbb None admin] RBAC: Adding query filter params (role.id=681755518698445fabd9a8accec13c0f, scope.project.id=da83db15a312499fb627691ae442f233, user.id=4efe4a6dd11047688892641a936e2914) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:47:40.467184 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f9d07-64a7-4e7a-8c62-44812124acbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:40.468695 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f9d07-64a7-4e7a-8c62-44812124acbb None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:40.475531 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 641/1287] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Jul 1 03:47:40 2022] GET /identity/v3/role_assignments?user.id=4efe4a6dd11047688892641a936e2914&scope.project.id=da83db15a312499fb627691ae442f233&role.id=681755518698445fabd9a8accec13c0f => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:47:42.517830 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d929f4a-5f5a-4de7-8431-91410862ff1f None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:42.518213 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d929f4a-5f5a-4de7-8431-91410862ff1f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:42.518409 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d929f4a-5f5a-4de7-8431-91410862ff1f None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:42.519926 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 647/1288] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 03:47:42.526663 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d7726-2c1e-415a-9f75-1fc3b26510c7 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:42.527075 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d7726-2c1e-415a-9f75-1fc3b26510c7 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:42.527296 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d7726-2c1e-415a-9f75-1fc3b26510c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:42.544102 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-627d7726-2c1e-415a-9f75-1fc3b26510c7 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:47:42.545282 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-627d7726-2c1e-415a-9f75-1fc3b26510c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:47:42.576028 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:42.613398 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 642/1289] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:47:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 03:47:42.636615 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d929f4a-5f5a-4de7-8431-91410862ff1f None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:42.743991 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d929f4a-5f5a-4de7-8431-91410862ff1f None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:42.754553 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:42.777965 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cded05e-6994-4d67-ab69-9b08b2920df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:42.778700 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cded05e-6994-4d67-ab69-9b08b2920df1 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:42.778977 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cded05e-6994-4d67-ab69-9b08b2920df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:42.779249 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cded05e-6994-4d67-ab69-9b08b2920df1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:42.779924 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cded05e-6994-4d67-ab69-9b08b2920df1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:42.781537 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cded05e-6994-4d67-ab69-9b08b2920df1 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:42.793666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-4cded05e-6994-4d67-ab69-9b08b2920df1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 01 03:47:42.793666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:47:42.793666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 03:47:42.793666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 03:47:42.793666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 03:47:42.793666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 03:47:42.793666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 03:47:42.793666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:47:42.793666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 01 03:47:42.793666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:47:42.793666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 03:47:42.793666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:47:42.793666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:47:42.793666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:47:42.793666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:47:42.793666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:47:42.793666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:47:42.795078 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:47:42.795078 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:47:42.795078 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:47:42.795078 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:47:42.795078 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:47:42.795078 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:47:42.795078 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 03:47:42.795078 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 03:47:42.795078 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 03:47:42.795078 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 03:47:42.795078 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:47:42.795078 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:47:42.795078 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:47:42.795078 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:47:42.795078 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:47:42.795078 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:47:42.796293 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:47:42.796293 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:47:42.796293 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:47:42.796293 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:47:42.796293 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:47:42.796293 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:47:42.796293 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:47:42.796293 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:47:42.796293 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:47:42.796293 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:47:42.796293 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 03:47:42.796293 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:47:42.796293 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 01 03:47:42.796293 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:47:42.796293 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 648/1290] 10.222.0.46 () {56 vars in 1117 bytes} [Fri Jul 1 03:47:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:47:42.800847 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d7726-2c1e-415a-9f75-1fc3b26510c7 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:42.908375 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d7726-2c1e-415a-9f75-1fc3b26510c7 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:42.944502 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e3e4b-42d5-4b96-8b8d-d38c7df4c787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:42.945182 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e3e4b-42d5-4b96-8b8d-d38c7df4c787 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:42.945495 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e3e4b-42d5-4b96-8b8d-d38c7df4c787 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:42.945772 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e3e4b-42d5-4b96-8b8d-d38c7df4c787 None admin] PATH_INFO: `/v3/services` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:42.946497 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261e3e4b-42d5-4b96-8b8d-d38c7df4c787 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:47:42.946805 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261e3e4b-42d5-4b96-8b8d-d38c7df4c787 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:42.948297 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261e3e4b-42d5-4b96-8b8d-d38c7df4c787 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:42.953894 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 643/1291] 10.222.0.46 () {56 vars in 1116 bytes} [Fri Jul 1 03:47:42 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:47:42.959956 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cded05e-6994-4d67-ab69-9b08b2920df1 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:43.065790 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cded05e-6994-4d67-ab69-9b08b2920df1 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:43.099428 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ec77c-e6ff-47b9-b637-15199e096a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:43.100122 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ec77c-e6ff-47b9-b637-15199e096a39 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:43.100405 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ec77c-e6ff-47b9-b637-15199e096a39 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:43.100679 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ec77c-e6ff-47b9-b637-15199e096a39 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:43.101378 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18ec77c-e6ff-47b9-b637-15199e096a39 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:47:43.102250 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18ec77c-e6ff-47b9-b637-15199e096a39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:43.103645 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18ec77c-e6ff-47b9-b637-15199e096a39 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:43.108276 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 649/1292] 10.222.0.46 () {56 vars in 1116 bytes} [Fri Jul 1 03:47:42 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:47:45.146720 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba6298-93cb-4ecf-a341-32652ca0365d None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:45.147271 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba6298-93cb-4ecf-a341-32652ca0365d None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:45.147389 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba6298-93cb-4ecf-a341-32652ca0365d None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:45.149238 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 644/1293] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:47:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:47:45.154618 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d67a4-2ea6-4652-9bf2-a2f50e5930a5 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:45.155049 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d67a4-2ea6-4652-9bf2-a2f50e5930a5 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:45.155180 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d67a4-2ea6-4652-9bf2-a2f50e5930a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:45.173228 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-d85d67a4-2ea6-4652-9bf2-a2f50e5930a5 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:47:45.174429 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d85d67a4-2ea6-4652-9bf2-a2f50e5930a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:47:45.204531 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:45.245690 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 650/1294] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:47:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:47:45.271170 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba6298-93cb-4ecf-a341-32652ca0365d None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:45.309647 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:45.382585 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba6298-93cb-4ecf-a341-32652ca0365d None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:45.422500 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb54fd8-be96-4d7f-910c-1b0b3ff9e925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:45.422500 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb54fd8-be96-4d7f-910c-1b0b3ff9e925 None admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:45.422500 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb54fd8-be96-4d7f-910c-1b0b3ff9e925 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:45.422500 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb54fd8-be96-4d7f-910c-1b0b3ff9e925 None admin] PATH_INFO: `/v3/services` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:45.422939 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb54fd8-be96-4d7f-910c-1b0b3ff9e925 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:45.422939 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb54fd8-be96-4d7f-910c-1b0b3ff9e925 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:45.532916 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 645/1295] 10.222.0.46 () {60 vars in 1141 bytes} [Fri Jul 1 03:47:45 2022] POST /identity/v3/services => generated 246 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 03:47:47.615525 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c1edb-75cf-485f-a4cc-172a5df55573 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:47.616070 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c1edb-75cf-485f-a4cc-172a5df55573 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:47.616171 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c1edb-75cf-485f-a4cc-172a5df55573 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:47.618091 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 651/1296] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:47:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 03:47:47.623705 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1e874-4c30-4ee7-9dbf-4fe8f393f9b1 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:47.624369 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1e874-4c30-4ee7-9dbf-4fe8f393f9b1 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:47.624369 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1e874-4c30-4ee7-9dbf-4fe8f393f9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:47.642198 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-75f1e874-4c30-4ee7-9dbf-4fe8f393f9b1 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:47:47.643463 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-75f1e874-4c30-4ee7-9dbf-4fe8f393f9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:47:47.721470 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 646/1297] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:47:47 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:47:47.745877 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c1edb-75cf-485f-a4cc-172a5df55573 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:47.857792 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c1edb-75cf-485f-a4cc-172a5df55573 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:47.893082 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf01687-ae78-40cd-889e-130726f948d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:47.894079 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf01687-ae78-40cd-889e-130726f948d9 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:47.894362 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf01687-ae78-40cd-889e-130726f948d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:47.894675 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf01687-ae78-40cd-889e-130726f948d9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:47.895467 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf01687-ae78-40cd-889e-130726f948d9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:47.896870 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf01687-ae78-40cd-889e-130726f948d9 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:47.909308 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-ebf01687-ae78-40cd-889e-130726f948d9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 01 03:47:47.909308 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:47:47.909308 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 03:47:47.909308 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 03:47:47.909308 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 03:47:47.909308 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 03:47:47.909308 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 03:47:47.909308 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:47:47.909308 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 01 03:47:47.909308 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:47:47.909308 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 03:47:47.909308 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:47:47.909308 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:47:47.909308 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:47:47.909308 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:47:47.909308 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:47:47.909308 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:47:47.910406 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:47:47.910406 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:47:47.910406 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:47:47.910406 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:47:47.910406 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:47:47.910406 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:47:47.910406 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 03:47:47.910406 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 03:47:47.910406 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 03:47:47.910406 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 03:47:47.910406 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:47:47.910406 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:47:47.910406 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:47:47.910406 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:47:47.910406 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:47:47.910406 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:47:47.911440 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:47:47.911440 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:47:47.911440 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:47:47.911440 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:47:47.911440 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:47:47.911440 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:47:47.911440 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:47:47.911440 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:47:47.911440 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:47:47.911440 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:47:47.911440 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 03:47:47.911440 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:47:47.911440 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 01 03:47:47.911440 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:47:47.911440 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 652/1298] 10.222.0.46 () {56 vars in 1117 bytes} [Fri Jul 1 03:47:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:47:47.917336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1e874-4c30-4ee7-9dbf-4fe8f393f9b1 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:47.936545 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:48.016165 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1e874-4c30-4ee7-9dbf-4fe8f393f9b1 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:48.050762 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491e27c-a593-4394-9649-7bb601f8e148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:48.051422 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491e27c-a593-4394-9649-7bb601f8e148 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:48.051744 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491e27c-a593-4394-9649-7bb601f8e148 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:48.052016 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491e27c-a593-4394-9649-7bb601f8e148 None admin] PATH_INFO: `/v3/services` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:48.052722 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7491e27c-a593-4394-9649-7bb601f8e148 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:47:48.053031 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7491e27c-a593-4394-9649-7bb601f8e148 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:48.054438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7491e27c-a593-4394-9649-7bb601f8e148 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:48.060208 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 647/1299] 10.222.0.46 () {56 vars in 1116 bytes} [Fri Jul 1 03:47:47 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:47:48.066308 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf01687-ae78-40cd-889e-130726f948d9 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:48.097506 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:48.169063 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf01687-ae78-40cd-889e-130726f948d9 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:48.202681 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3ab05-6c7e-4cf4-b477-8d5c6d314fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:48.203337 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3ab05-6c7e-4cf4-b477-8d5c6d314fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:48.203652 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3ab05-6c7e-4cf4-b477-8d5c6d314fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:48.203930 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3ab05-6c7e-4cf4-b477-8d5c6d314fa9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:48.204725 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b3ab05-6c7e-4cf4-b477-8d5c6d314fa9 None admin] RBAC: Adding query filter params (interface=public, service_id=949f81acb6e84d3f88fd50d2095d2bae, region_id=RegionOne) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:47:48.205058 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b3ab05-6c7e-4cf4-b477-8d5c6d314fa9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:48.206432 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b3ab05-6c7e-4cf4-b477-8d5c6d314fa9 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:48.212197 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 653/1300] 10.222.0.46 () {56 vars in 1251 bytes} [Fri Jul 1 03:47:48 2022] GET /identity/v3/endpoints?service_id=949f81acb6e84d3f88fd50d2095d2bae&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:47:48.218095 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491e27c-a593-4394-9649-7bb601f8e148 None admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:48.306627 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:48.324220 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491e27c-a593-4394-9649-7bb601f8e148 None admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:48.359473 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554cdd53-9069-466e-ad29-be33fb9b1aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:48.360159 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554cdd53-9069-466e-ad29-be33fb9b1aca None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:48.360441 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554cdd53-9069-466e-ad29-be33fb9b1aca None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:48.360716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554cdd53-9069-466e-ad29-be33fb9b1aca None admin] PATH_INFO: `/v3/services` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:48.361395 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554cdd53-9069-466e-ad29-be33fb9b1aca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:48.362756 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554cdd53-9069-466e-ad29-be33fb9b1aca None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:48.369713 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 648/1301] 10.222.0.46 () {56 vars in 1087 bytes} [Fri Jul 1 03:47:48 2022] GET /identity/v3/services => generated 2191 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 03:47:50.427236 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37110799-c76f-451d-b6b9-031a4abc05b1 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:50.427817 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37110799-c76f-451d-b6b9-031a4abc05b1 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:50.427817 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37110799-c76f-451d-b6b9-031a4abc05b1 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:50.429171 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 654/1302] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:47:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:47:50.434473 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4d6d9-7fe8-4477-813c-8f0f7574c607 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:50.434873 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4d6d9-7fe8-4477-813c-8f0f7574c607 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:50.435035 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4d6d9-7fe8-4477-813c-8f0f7574c607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:50.451321 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-9ae4d6d9-7fe8-4477-813c-8f0f7574c607 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:47:50.452573 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-9ae4d6d9-7fe8-4477-813c-8f0f7574c607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:47:50.522929 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 649/1303] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:47:50 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 03:47:50.546883 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37110799-c76f-451d-b6b9-031a4abc05b1 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:50.639417 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:50.646134 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37110799-c76f-451d-b6b9-031a4abc05b1 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:50.679020 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec15444-7e6d-41c3-b6db-78f7f78df2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:50.680306 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec15444-7e6d-41c3-b6db-78f7f78df2af None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:50.691050 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec15444-7e6d-41c3-b6db-78f7f78df2af None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:50.691050 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec15444-7e6d-41c3-b6db-78f7f78df2af None admin] PATH_INFO: `/v3/services/placement` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:50.691050 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec15444-7e6d-41c3-b6db-78f7f78df2af None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:50.691050 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec15444-7e6d-41c3-b6db-78f7f78df2af None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:50.695181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-9ec15444-7e6d-41c3-b6db-78f7f78df2af None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 01 03:47:50.695181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:47:50.695181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 03:47:50.695181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 03:47:50.695181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 03:47:50.695181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 03:47:50.695181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 03:47:50.695181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:47:50.695181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 01 03:47:50.695181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:47:50.695181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 03:47:50.695181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:47:50.695181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 03:47:50.695181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 03:47:50.695181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 03:47:50.695181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 03:47:50.695181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 03:47:50.697038 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 03:47:50.697038 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 03:47:50.697038 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 03:47:50.697038 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 03:47:50.697038 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 03:47:50.697038 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 03:47:50.697038 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 03:47:50.697038 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 03:47:50.697038 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 03:47:50.697038 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 03:47:50.697038 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 03:47:50.697038 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 03:47:50.697038 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 03:47:50.697038 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 03:47:50.697038 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 03:47:50.697038 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 03:47:50.698258 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 03:47:50.698258 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jul 01 03:47:50.698258 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 03:47:50.698258 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jul 01 03:47:50.698258 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 03:47:50.698258 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 03:47:50.698258 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 03:47:50.698258 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jul 01 03:47:50.698258 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 03:47:50.698258 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jul 01 03:47:50.698258 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 03:47:50.698258 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 03:47:50.698258 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 01 03:47:50.698258 dv-cinder-846842-8-smb devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jul 01 03:47:50.698258 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 655/1304] 10.222.0.46 () {56 vars in 1117 bytes} [Fri Jul 1 03:47:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 03:47:50.703159 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae4d6d9-7fe8-4477-813c-8f0f7574c607 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:50.780580 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:47:50.802178 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae4d6d9-7fe8-4477-813c-8f0f7574c607 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:50.833795 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd4f89-d6a9-4b85-9dbe-43b090ed0027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:50.834447 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd4f89-d6a9-4b85-9dbe-43b090ed0027 None admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:50.834721 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd4f89-d6a9-4b85-9dbe-43b090ed0027 None admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:50.834990 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd4f89-d6a9-4b85-9dbe-43b090ed0027 None admin] PATH_INFO: `/v3/services` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:50.835709 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfd4f89-d6a9-4b85-9dbe-43b090ed0027 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 03:47:50.836011 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfd4f89-d6a9-4b85-9dbe-43b090ed0027 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:50.837946 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfd4f89-d6a9-4b85-9dbe-43b090ed0027 None admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:50.842870 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 650/1305] 10.222.0.46 () {56 vars in 1116 bytes} [Fri Jul 1 03:47:50 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 03:47:50.848605 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec15444-7e6d-41c3-b6db-78f7f78df2af None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:47:50.945359 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec15444-7e6d-41c3-b6db-78f7f78df2af None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:47:50.978545 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede9644-e9ae-4957-b2e2-d1a394568e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:47:50.979679 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede9644-e9ae-4957-b2e2-d1a394568e5c None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:47:50.979679 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede9644-e9ae-4957-b2e2-d1a394568e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:47:50.979868 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede9644-e9ae-4957-b2e2-d1a394568e5c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:47:50.980474 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede9644-e9ae-4957-b2e2-d1a394568e5c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:47:50.981911 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede9644-e9ae-4957-b2e2-d1a394568e5c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:47:51.090907 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 656/1306] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Jul 1 03:47:50 2022] POST /identity/v3/endpoints => generated 331 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 03:48:00.926423 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=30 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:48:01.085717 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:55:38.218723 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a3ee8-c53c-462f-9208-e2fa4746c632 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:55:38.218723 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a3ee8-c53c-462f-9208-e2fa4746c632 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:55:38.218723 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a3ee8-c53c-462f-9208-e2fa4746c632 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:55:38.220665 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 651/1307] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:55:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:55:38.227107 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb627c-eea2-4ab8-b333-a271b40ca4ef None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:55:38.227599 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb627c-eea2-4ab8-b333-a271b40ca4ef None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:55:38.227750 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb627c-eea2-4ab8-b333-a271b40ca4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:55:38.389896 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-64fb627c-eea2-4ab8-b333-a271b40ca4ef None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:55:38.390799 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-64fb627c-eea2-4ab8-b333-a271b40ca4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:55:38.628072 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 657/1308] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:55:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 03:55:38.673575 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c872c-f4e6-4edd-ad6e-183947a04e8f None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:55:38.674233 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c872c-f4e6-4edd-ad6e-183947a04e8f None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:55:38.674715 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c872c-f4e6-4edd-ad6e-183947a04e8f None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:55:38.676410 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 652/1309] 10.222.0.46 () {54 vars in 964 bytes} [Fri Jul 1 03:55:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:55:38.683061 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979aec2-4aa2-48ba-a074-9b5a88562438 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:55:38.683905 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979aec2-4aa2-48ba-a074-9b5a88562438 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:55:38.684465 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979aec2-4aa2-48ba-a074-9b5a88562438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:55:38.852743 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-1979aec2-4aa2-48ba-a074-9b5a88562438 None None] MFA Rules not processed for user `93929b81a23c482ca7ce47e7a94682e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:55:38.854768 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1979aec2-4aa2-48ba-a074-9b5a88562438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:55:38.895652 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:55:39.024065 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 658/1310] 10.222.0.46 () {58 vars in 1061 bytes} [Fri Jul 1 03:55:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 03:55:39.025042 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c872c-f4e6-4edd-ad6e-183947a04e8f None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:55:39.026814 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-5d3c872c-f4e6-4edd-ad6e-183947a04e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:55:39.157399 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c872c-f4e6-4edd-ad6e-183947a04e8f None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:55:39.236721 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7bba7-8509-4b09-9f94-72c132dd8fb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:55:39.237745 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7bba7-8509-4b09-9f94-72c132dd8fb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:55:39.237745 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7bba7-8509-4b09-9f94-72c132dd8fb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:55:39.238008 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7bba7-8509-4b09-9f94-72c132dd8fb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:55:39.239746 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-4bc7bba7-8509-4b09-9f94-72c132dd8fb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:55:39.299341 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:55:39.362137 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7bba7-8509-4b09-9f94-72c132dd8fb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:55:39.363612 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7bba7-8509-4b09-9f94-72c132dd8fb4 service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:55:39.386155 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 653/1311] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:55:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 03:55:41.880455 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82caf4c-76c9-493e-80a0-7426e47df714 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:55:41.880960 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82caf4c-76c9-493e-80a0-7426e47df714 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:55:41.880960 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82caf4c-76c9-493e-80a0-7426e47df714 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:55:41.882323 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 659/1312] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:55:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:55:41.887592 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc96a3-bc1a-473f-92cc-228c2009c36c None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:55:41.888011 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc96a3-bc1a-473f-92cc-228c2009c36c None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:55:41.888147 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc96a3-bc1a-473f-92cc-228c2009c36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:55:41.966228 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-74fc96a3-bc1a-473f-92cc-228c2009c36c None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:55:41.967416 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-74fc96a3-bc1a-473f-92cc-228c2009c36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:55:42.060253 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 654/1313] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:55:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 03:55:42.111405 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1fac1-b71a-4a17-bbfa-353217b9a2d2 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:55:42.111726 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1fac1-b71a-4a17-bbfa-353217b9a2d2 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:55:42.112008 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1fac1-b71a-4a17-bbfa-353217b9a2d2 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:55:42.113406 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 660/1314] 10.222.0.46 () {54 vars in 964 bytes} [Fri Jul 1 03:55:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:55:42.119173 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6ee8c-0cea-44f4-8f64-cedddecfcf2f None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:55:42.119483 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6ee8c-0cea-44f4-8f64-cedddecfcf2f None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:55:42.119762 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6ee8c-0cea-44f4-8f64-cedddecfcf2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:55:42.130537 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:55:42.194564 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-e1d6ee8c-0cea-44f4-8f64-cedddecfcf2f None None] MFA Rules not processed for user `93929b81a23c482ca7ce47e7a94682e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:55:42.195788 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-e1d6ee8c-0cea-44f4-8f64-cedddecfcf2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:55:42.269323 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 655/1315] 10.222.0.46 () {58 vars in 1061 bytes} [Fri Jul 1 03:55:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 03:55:42.278430 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1fac1-b71a-4a17-bbfa-353217b9a2d2 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:55:42.279991 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-98e1fac1-b71a-4a17-bbfa-353217b9a2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:55:42.381736 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1fac1-b71a-4a17-bbfa-353217b9a2d2 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:55:42.451733 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:55:42.454294 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de4b07-554c-424b-a02a-edd5e0d98907 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:55:42.454943 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de4b07-554c-424b-a02a-edd5e0d98907 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:55:42.455224 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de4b07-554c-424b-a02a-edd5e0d98907 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:55:42.455515 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de4b07-554c-424b-a02a-edd5e0d98907 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:55:42.457144 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a8de4b07-554c-424b-a02a-edd5e0d98907 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:55:42.565197 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de4b07-554c-424b-a02a-edd5e0d98907 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:55:42.566646 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de4b07-554c-424b-a02a-edd5e0d98907 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:55:42.584498 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 661/1316] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:55:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 03:55:45.374224 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d84f9-f4aa-4909-8609-b11fbeab2e76 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:55:45.374785 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d84f9-f4aa-4909-8609-b11fbeab2e76 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:55:45.374785 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d84f9-f4aa-4909-8609-b11fbeab2e76 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:55:45.376166 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 656/1317] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:55:45.381363 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8cf31-eaa9-452a-8d0f-d878c5a11cd4 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:55:45.381770 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8cf31-eaa9-452a-8d0f-d878c5a11cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:55:45.381907 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8cf31-eaa9-452a-8d0f-d878c5a11cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:55:45.446571 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-66b8cf31-eaa9-452a-8d0f-d878c5a11cd4 None None] MFA Rules not processed for user `ebf9d6d679ef4fc29f52a567ec264b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:55:45.447788 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-66b8cf31-eaa9-452a-8d0f-d878c5a11cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:55:45.506600 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:55:45.554204 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 662/1318] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:55:45 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 03:55:45.595385 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d84f9-f4aa-4909-8609-b11fbeab2e76 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:55:45.596925 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-c95d84f9-f4aa-4909-8609-b11fbeab2e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:55:45.701902 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d84f9-f4aa-4909-8609-b11fbeab2e76 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:55:45.704694 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:55:45.775382 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945d704-88c0-474c-ac80-daee3a51481d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:55:45.776069 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945d704-88c0-474c-ac80-daee3a51481d service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:55:45.776353 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945d704-88c0-474c-ac80-daee3a51481d service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:55:45.776630 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945d704-88c0-474c-ac80-daee3a51481d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:55:45.778314 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-3945d704-88c0-474c-ac80-daee3a51481d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:55:45.888785 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3945d704-88c0-474c-ac80-daee3a51481d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:55:45.890253 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3945d704-88c0-474c-ac80-daee3a51481d service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:55:45.909173 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 657/1319] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:55:45 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 03:55:48.762920 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b2d99-eaaf-4107-af87-e71bf0d6e5e9 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:55:48.763498 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b2d99-eaaf-4107-af87-e71bf0d6e5e9 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:55:48.763498 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b2d99-eaaf-4107-af87-e71bf0d6e5e9 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:55:48.764886 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 663/1320] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:55:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:55:48.770688 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d290931-a39b-432e-8005-e15fd9ad6a0d None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:55:48.779130 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d290931-a39b-432e-8005-e15fd9ad6a0d None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:55:48.779130 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d290931-a39b-432e-8005-e15fd9ad6a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:55:48.814558 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:55:48.843059 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-9d290931-a39b-432e-8005-e15fd9ad6a0d None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:55:48.844322 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-9d290931-a39b-432e-8005-e15fd9ad6a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:55:48.941055 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 658/1321] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:55:48 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 03:55:48.980335 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b2d99-eaaf-4107-af87-e71bf0d6e5e9 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:55:48.981966 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ab4b2d99-eaaf-4107-af87-e71bf0d6e5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:55:49.093379 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b2d99-eaaf-4107-af87-e71bf0d6e5e9 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:55:49.169330 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6092684-e935-4d6f-b514-49b8f14425bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:55:49.169986 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6092684-e935-4d6f-b514-49b8f14425bc service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:55:49.170339 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6092684-e935-4d6f-b514-49b8f14425bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:55:49.170625 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6092684-e935-4d6f-b514-49b8f14425bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:55:49.172330 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d6092684-e935-4d6f-b514-49b8f14425bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:55:49.180322 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:55:49.284421 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6092684-e935-4d6f-b514-49b8f14425bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:55:49.285879 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6092684-e935-4d6f-b514-49b8f14425bc service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:55:49.304521 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 664/1322] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:55:48 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 03:55:52.461419 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4017a-7390-4b29-b5ef-35ef60612c25 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:55:52.462111 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4017a-7390-4b29-b5ef-35ef60612c25 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:55:52.462111 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4017a-7390-4b29-b5ef-35ef60612c25 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:55:52.464516 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 659/1323] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:55:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:55:52.468968 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80094559-e3cd-472a-8dd8-6511abc9866c None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:55:52.469442 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80094559-e3cd-472a-8dd8-6511abc9866c None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:55:52.469657 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80094559-e3cd-472a-8dd8-6511abc9866c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:55:52.541730 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-80094559-e3cd-472a-8dd8-6511abc9866c None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:55:52.543563 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-80094559-e3cd-472a-8dd8-6511abc9866c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:55:52.604502 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:55:52.645893 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 665/1324] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:55:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 03:55:52.683325 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4017a-7390-4b29-b5ef-35ef60612c25 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:55:52.684923 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-15e4017a-7390-4b29-b5ef-35ef60612c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:55:52.822307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4017a-7390-4b29-b5ef-35ef60612c25 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:55:52.837903 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:55:52.918882 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c38a07c-7a9d-49f3-a4e3-2238ed4f078c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:55:52.918882 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38a07c-7a9d-49f3-a4e3-2238ed4f078c service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:55:52.918882 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38a07c-7a9d-49f3-a4e3-2238ed4f078c service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:55:52.918882 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38a07c-7a9d-49f3-a4e3-2238ed4f078c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:55:52.919369 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-6c38a07c-7a9d-49f3-a4e3-2238ed4f078c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:55:53.041116 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c38a07c-7a9d-49f3-a4e3-2238ed4f078c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:55:53.043108 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c38a07c-7a9d-49f3-a4e3-2238ed4f078c service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:55:53.064435 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 660/1325] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:55:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 03:55:55.210718 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302139fd-a9c3-4573-900a-ff7079dc2dd2 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:55:55.211249 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302139fd-a9c3-4573-900a-ff7079dc2dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:55:55.211249 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302139fd-a9c3-4573-900a-ff7079dc2dd2 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:55:55.212687 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 666/1326] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:55:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:55:55.218761 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4606c92-2426-4ca7-b35a-1b232a4c0045 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:55:55.219198 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4606c92-2426-4ca7-b35a-1b232a4c0045 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:55:55.219307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4606c92-2426-4ca7-b35a-1b232a4c0045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:55:55.270476 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:55:55.294152 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-f4606c92-2426-4ca7-b35a-1b232a4c0045 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:55:55.295390 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-f4606c92-2426-4ca7-b35a-1b232a4c0045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:55:55.395912 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 661/1327] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:55:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 03:55:55.432836 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302139fd-a9c3-4573-900a-ff7079dc2dd2 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:55:55.434386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-302139fd-a9c3-4573-900a-ff7079dc2dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:55:55.565264 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302139fd-a9c3-4573-900a-ff7079dc2dd2 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:55:55.652197 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b3c06f-6b00-4cc1-bd61-4f93676c7a99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:55:55.652854 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3c06f-6b00-4cc1-bd61-4f93676c7a99 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:55:55.653136 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3c06f-6b00-4cc1-bd61-4f93676c7a99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:55:55.653414 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3c06f-6b00-4cc1-bd61-4f93676c7a99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:55:55.655093 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a5b3c06f-6b00-4cc1-bd61-4f93676c7a99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:55:55.676274 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:55:55.789003 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b3c06f-6b00-4cc1-bd61-4f93676c7a99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:55:55.790457 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b3c06f-6b00-4cc1-bd61-4f93676c7a99 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:55:55.812475 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 667/1328] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:55:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 03:55:57.959282 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e38001-b280-4f7d-850a-b5f69d8f454f None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:55:57.959865 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e38001-b280-4f7d-850a-b5f69d8f454f None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:55:57.959865 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e38001-b280-4f7d-850a-b5f69d8f454f None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:55:57.961212 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 662/1329] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:55:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:55:57.968102 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f50a7-e099-41b2-a386-095ff47ab09e None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:55:57.968547 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f50a7-e099-41b2-a386-095ff47ab09e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:55:57.968660 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f50a7-e099-41b2-a386-095ff47ab09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:55:58.036826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-dc5f50a7-e099-41b2-a386-095ff47ab09e None None] MFA Rules not processed for user `ebf9d6d679ef4fc29f52a567ec264b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:55:58.038217 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-dc5f50a7-e099-41b2-a386-095ff47ab09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:55:58.110989 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:55:58.146743 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 668/1330] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:55:57 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 03:55:58.184791 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e38001-b280-4f7d-850a-b5f69d8f454f None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:55:58.186392 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-e3e38001-b280-4f7d-850a-b5f69d8f454f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:55:58.290498 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e38001-b280-4f7d-850a-b5f69d8f454f None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:55:58.311350 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:55:58.367373 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe308a0-c599-41c8-b515-0511c94bd600 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:55:58.368047 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe308a0-c599-41c8-b515-0511c94bd600 service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:55:58.368327 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe308a0-c599-41c8-b515-0511c94bd600 service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:55:58.368600 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe308a0-c599-41c8-b515-0511c94bd600 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:55:58.370909 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-afe308a0-c599-41c8-b515-0511c94bd600 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:55:58.477160 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe308a0-c599-41c8-b515-0511c94bd600 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:55:58.478586 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe308a0-c599-41c8-b515-0511c94bd600 service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:55:58.509599 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 663/1331] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:55:58 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 03:56:01.213026 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9549e-5a08-4de8-95a4-1d9edfee4ba8 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:01.213587 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9549e-5a08-4de8-95a4-1d9edfee4ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:01.213587 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9549e-5a08-4de8-95a4-1d9edfee4ba8 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:01.214987 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 669/1332] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:56:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:56:01.220240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9418994-324b-43df-95a0-f3f9587d83ce None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:01.220633 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9418994-324b-43df-95a0-f3f9587d83ce None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:01.220805 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9418994-324b-43df-95a0-f3f9587d83ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:01.283806 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:56:01.286520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-c9418994-324b-43df-95a0-f3f9587d83ce None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:56:01.288015 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-c9418994-324b-43df-95a0-f3f9587d83ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:56:01.386889 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 664/1333] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:56:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 03:56:01.423017 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d9549e-5a08-4de8-95a4-1d9edfee4ba8 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:56:01.424581 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-50d9549e-5a08-4de8-95a4-1d9edfee4ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:56:01.529580 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d9549e-5a08-4de8-95a4-1d9edfee4ba8 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:56:01.602946 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7ba78-455e-4620-885f-b92b81d6f2c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:56:01.603639 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7ba78-455e-4620-885f-b92b81d6f2c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:01.603925 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7ba78-455e-4620-885f-b92b81d6f2c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:01.604788 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7ba78-455e-4620-885f-b92b81d6f2c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:01.609284 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-19e7ba78-455e-4620-885f-b92b81d6f2c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:56:01.636653 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:56:01.723883 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e7ba78-455e-4620-885f-b92b81d6f2c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:56:01.725333 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e7ba78-455e-4620-885f-b92b81d6f2c2 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:56:01.744454 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 670/1334] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:56:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 03:56:03.844070 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118e4e8-2247-41fb-bf5c-b71f9d7a2ffa None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:03.844577 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118e4e8-2247-41fb-bf5c-b71f9d7a2ffa None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:03.844577 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118e4e8-2247-41fb-bf5c-b71f9d7a2ffa None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:03.845920 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 665/1335] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:56:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:56:03.851196 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24efc8-dbec-4be8-8f01-9379d061bccc None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:03.851687 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24efc8-dbec-4be8-8f01-9379d061bccc None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:03.851781 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24efc8-dbec-4be8-8f01-9379d061bccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:03.915106 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-fc24efc8-dbec-4be8-8f01-9379d061bccc None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:56:03.916325 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-fc24efc8-dbec-4be8-8f01-9379d061bccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:56:03.989153 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:56:04.010464 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 671/1336] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:56:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 03:56:04.052114 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118e4e8-2247-41fb-bf5c-b71f9d7a2ffa None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:56:04.053633 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-f118e4e8-2247-41fb-bf5c-b71f9d7a2ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:56:04.155237 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118e4e8-2247-41fb-bf5c-b71f9d7a2ffa None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:56:04.183767 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:56:04.228873 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4259e7-6b33-469d-94ec-c6273ebb5983 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:56:04.230166 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4259e7-6b33-469d-94ec-c6273ebb5983 service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:04.230437 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4259e7-6b33-469d-94ec-c6273ebb5983 service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:04.230712 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4259e7-6b33-469d-94ec-c6273ebb5983 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:04.232400 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-4c4259e7-6b33-469d-94ec-c6273ebb5983 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:56:04.346007 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4259e7-6b33-469d-94ec-c6273ebb5983 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:56:04.347432 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4259e7-6b33-469d-94ec-c6273ebb5983 service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:56:04.365499 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 666/1337] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:56:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 03:56:07.047252 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ae513-90a4-4583-82f8-a454af7aab9b None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:07.047876 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ae513-90a4-4583-82f8-a454af7aab9b None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:07.048001 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ae513-90a4-4583-82f8-a454af7aab9b None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:07.049379 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 672/1338] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:56:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:56:07.055649 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b6358-5603-4086-995f-8255b08bca4a None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:07.056160 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b6358-5603-4086-995f-8255b08bca4a None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:07.056325 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b6358-5603-4086-995f-8255b08bca4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:07.123330 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-829b6358-5603-4086-995f-8255b08bca4a None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:56:07.124596 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-829b6358-5603-4086-995f-8255b08bca4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:56:07.132821 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:56:07.224843 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 667/1339] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:56:07 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 03:56:07.263281 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ae513-90a4-4583-82f8-a454af7aab9b None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:56:07.266004 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ca4ae513-90a4-4583-82f8-a454af7aab9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:56:07.373687 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ae513-90a4-4583-82f8-a454af7aab9b None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:56:07.448988 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cff0bc-e72b-46b3-ad43-c46d1ea127d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:56:07.449643 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cff0bc-e72b-46b3-ad43-c46d1ea127d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:07.449927 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cff0bc-e72b-46b3-ad43-c46d1ea127d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:07.450204 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cff0bc-e72b-46b3-ad43-c46d1ea127d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:07.451871 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-56cff0bc-e72b-46b3-ad43-c46d1ea127d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:56:07.488031 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:56:07.562970 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cff0bc-e72b-46b3-ad43-c46d1ea127d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:56:07.564451 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cff0bc-e72b-46b3-ad43-c46d1ea127d5 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:56:07.583204 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 673/1340] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:56:07 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 03:56:12.010583 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e3b94-8ffd-4c8e-9cca-9dc7a070e183 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:12.011122 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e3b94-8ffd-4c8e-9cca-9dc7a070e183 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:12.011122 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e3b94-8ffd-4c8e-9cca-9dc7a070e183 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:12.016805 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 668/1341] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:56:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:56:12.018645 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88b710-7ab1-41c3-a61c-db04f0e97b8e None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:12.019543 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88b710-7ab1-41c3-a61c-db04f0e97b8e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:12.020009 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88b710-7ab1-41c3-a61c-db04f0e97b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:12.099004 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-ee88b710-7ab1-41c3-a61c-db04f0e97b8e None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:56:12.100319 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ee88b710-7ab1-41c3-a61c-db04f0e97b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:56:12.219280 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:56:12.232799 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 674/1342] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 03:56:12.272386 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e3b94-8ffd-4c8e-9cca-9dc7a070e183 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:56:12.274579 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-4c2e3b94-8ffd-4c8e-9cca-9dc7a070e183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:56:12.373178 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e3b94-8ffd-4c8e-9cca-9dc7a070e183 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:56:12.377035 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a9e27f-7b63-456a-9249-c24bae9ddb61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:56:12.377720 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9e27f-7b63-456a-9249-c24bae9ddb61 service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:12.378219 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9e27f-7b63-456a-9249-c24bae9ddb61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:12.378500 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9e27f-7b63-456a-9249-c24bae9ddb61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:12.389503 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a9e27f-7b63-456a-9249-c24bae9ddb61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:56:12.391024 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a9e27f-7b63-456a-9249-c24bae9ddb61 service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:56:12.401375 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 669/1343] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:56:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 03:56:15.548349 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4be693-6022-40a0-841b-0ac9869f9313 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:15.549100 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4be693-6022-40a0-841b-0ac9869f9313 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:15.549100 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4be693-6022-40a0-841b-0ac9869f9313 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:15.550383 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 675/1344] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:56:15.557090 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4ab67-b17b-40ba-a649-414ac32d4081 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:15.558024 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4ab67-b17b-40ba-a649-414ac32d4081 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:15.558310 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4ab67-b17b-40ba-a649-414ac32d4081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:15.591747 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-36b4ab67-b17b-40ba-a649-414ac32d4081 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:56:15.592945 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-36b4ab67-b17b-40ba-a649-414ac32d4081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:56:15.626141 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:56:15.679835 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 670/1345] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:56:15 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 03:56:15.718339 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4be693-6022-40a0-841b-0ac9869f9313 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:56:15.729806 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4be693-6022-40a0-841b-0ac9869f9313 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:56:15.733627 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176ac82-692d-4de9-8a1f-4e68d8c31bb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:56:15.734271 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176ac82-692d-4de9-8a1f-4e68d8c31bb9 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:15.734552 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176ac82-692d-4de9-8a1f-4e68d8c31bb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:15.734821 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176ac82-692d-4de9-8a1f-4e68d8c31bb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:15.747173 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f176ac82-692d-4de9-8a1f-4e68d8c31bb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:56:15.748661 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f176ac82-692d-4de9-8a1f-4e68d8c31bb9 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:56:15.758659 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 676/1346] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:56:15 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 03:56:20.412661 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a74bb-ca0e-4e3d-b0a4-321198da0e99 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:20.413335 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a74bb-ca0e-4e3d-b0a4-321198da0e99 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:20.413335 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a74bb-ca0e-4e3d-b0a4-321198da0e99 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:20.414696 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 671/1347] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:56:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:56:20.421803 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f6e3b-9d1e-42a8-a64e-83e92faeefde None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:20.422373 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f6e3b-9d1e-42a8-a64e-83e92faeefde None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:20.422373 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f6e3b-9d1e-42a8-a64e-83e92faeefde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:20.448285 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-9e8f6e3b-9d1e-42a8-a64e-83e92faeefde None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:56:20.449446 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9e8f6e3b-9d1e-42a8-a64e-83e92faeefde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:56:20.458130 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 677/1348] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:56:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 03:56:20.497918 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a74bb-ca0e-4e3d-b0a4-321198da0e99 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:56:20.508872 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a74bb-ca0e-4e3d-b0a4-321198da0e99 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:56:20.513190 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5088749-2647-4636-84b2-2af3fc53cb8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:56:20.514475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5088749-2647-4636-84b2-2af3fc53cb8e service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:20.514982 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5088749-2647-4636-84b2-2af3fc53cb8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:20.515436 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5088749-2647-4636-84b2-2af3fc53cb8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:20.533366 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5088749-2647-4636-84b2-2af3fc53cb8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:56:20.534856 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5088749-2647-4636-84b2-2af3fc53cb8e service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:56:20.546284 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 672/1349] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:56:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 03:56:26.375076 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ab2a1-cb44-4834-b13c-d6e5e5e5d758 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:26.375641 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ab2a1-cb44-4834-b13c-d6e5e5e5d758 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:26.375760 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ab2a1-cb44-4834-b13c-d6e5e5e5d758 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:26.377501 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 678/1350] 10.222.0.46 () {54 vars in 921 bytes} [Fri Jul 1 03:56:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 03:56:26.382855 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb31070-8b8a-45fa-86f0-2d1d7e042cca None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:26.383357 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb31070-8b8a-45fa-86f0-2d1d7e042cca None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:26.383471 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb31070-8b8a-45fa-86f0-2d1d7e042cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:26.537994 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-feb31070-8b8a-45fa-86f0-2d1d7e042cca None None] MFA Rules not processed for user `4efe4a6dd11047688892641a936e2914`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:56:26.539330 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-feb31070-8b8a-45fa-86f0-2d1d7e042cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:56:26.626550 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 673/1351] 10.222.0.46 () {58 vars in 1018 bytes} [Fri Jul 1 03:56:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 03:56:30.439406 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=13 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:56:31.827194 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05ae23-a5ff-48c8-8478-12507a504f2f None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:31.828151 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05ae23-a5ff-48c8-8478-12507a504f2f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:31.828431 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05ae23-a5ff-48c8-8478-12507a504f2f None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:31.830041 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 679/1352] 10.222.0.46 () {54 vars in 921 bytes} [Fri Jul 1 03:56:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:56:31.835242 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7d127-a868-4e40-977e-c91d71997a86 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:31.836235 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7d127-a868-4e40-977e-c91d71997a86 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:31.837206 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7d127-a868-4e40-977e-c91d71997a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:31.856954 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-26b7d127-a868-4e40-977e-c91d71997a86 None None] MFA Rules not processed for user `4efe4a6dd11047688892641a936e2914`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:56:31.858261 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-26b7d127-a868-4e40-977e-c91d71997a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:56:31.867323 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 674/1353] 10.222.0.46 () {58 vars in 1018 bytes} [Fri Jul 1 03:56:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 03:56:33.584268 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01d757-df38-4a09-b916-0fa86c318d13 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:33.584789 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01d757-df38-4a09-b916-0fa86c318d13 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:33.584871 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01d757-df38-4a09-b916-0fa86c318d13 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:33.586267 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 680/1354] 10.222.0.46 () {54 vars in 921 bytes} [Fri Jul 1 03:56:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:56:33.594513 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc43f71-252a-4371-8640-c8c463b68fae None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:33.595034 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc43f71-252a-4371-8640-c8c463b68fae None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:33.595116 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc43f71-252a-4371-8640-c8c463b68fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:33.616494 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-3fc43f71-252a-4371-8640-c8c463b68fae None None] MFA Rules not processed for user `4efe4a6dd11047688892641a936e2914`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:56:33.617710 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-3fc43f71-252a-4371-8640-c8c463b68fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:56:33.631667 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 675/1355] 10.222.0.46 () {58 vars in 1018 bytes} [Fri Jul 1 03:56:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 03:56:37.301051 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bcf14-fc56-49d1-af83-ec217cac8437 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:37.301856 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bcf14-fc56-49d1-af83-ec217cac8437 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:37.301856 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bcf14-fc56-49d1-af83-ec217cac8437 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:37.303038 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 681/1356] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:56:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:56:37.309238 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043178f-2823-4d00-948e-fe38e97c2703 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:37.309847 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043178f-2823-4d00-948e-fe38e97c2703 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:37.309847 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043178f-2823-4d00-948e-fe38e97c2703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:37.330451 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-b043178f-2823-4d00-948e-fe38e97c2703 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:56:37.331684 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-b043178f-2823-4d00-948e-fe38e97c2703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:56:37.343488 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 676/1357] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:56:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 03:56:37.419697 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a720f92-c3f9-410d-9863-8127af539776 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:37.419940 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a720f92-c3f9-410d-9863-8127af539776 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:37.420248 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a720f92-c3f9-410d-9863-8127af539776 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:37.422269 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 682/1358] 10.222.0.46 () {54 vars in 961 bytes} [Fri Jul 1 03:56:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 03:56:37.432359 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdba332-acbb-43b2-b06c-1905bcab3983 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:37.433064 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdba332-acbb-43b2-b06c-1905bcab3983 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:37.433566 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdba332-acbb-43b2-b06c-1905bcab3983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:37.509510 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:56:37.544890 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-ccdba332-acbb-43b2-b06c-1905bcab3983 None None] MFA Rules not processed for user `2da466ad31d344898f5c838f77d45181`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:56:37.550584 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-ccdba332-acbb-43b2-b06c-1905bcab3983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:56:37.725169 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 677/1359] 10.222.0.46 () {58 vars in 1058 bytes} [Fri Jul 1 03:56:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 03:56:37.733958 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a720f92-c3f9-410d-9863-8127af539776 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:56:37.749974 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a720f92-c3f9-410d-9863-8127af539776 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:56:37.756326 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78edfa-c987-4ef9-aecd-3d7c783bf9a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:56:37.757038 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78edfa-c987-4ef9-aecd-3d7c783bf9a8 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:37.757318 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78edfa-c987-4ef9-aecd-3d7c783bf9a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:37.757589 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78edfa-c987-4ef9-aecd-3d7c783bf9a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:37.768188 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a78edfa-c987-4ef9-aecd-3d7c783bf9a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:56:37.769792 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a78edfa-c987-4ef9-aecd-3d7c783bf9a8 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:56:37.782865 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 683/1360] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:56:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 03:56:40.443332 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfd3e1-f779-48e1-a14d-84b234386217 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:40.444072 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfd3e1-f779-48e1-a14d-84b234386217 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:40.444189 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfd3e1-f779-48e1-a14d-84b234386217 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:40.446467 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 678/1361] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:56:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:56:40.453958 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed3a59-9c4b-4539-8a47-cd2ebc63195c None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:40.455381 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed3a59-9c4b-4539-8a47-cd2ebc63195c None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:40.455997 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed3a59-9c4b-4539-8a47-cd2ebc63195c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:40.482426 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-e4ed3a59-9c4b-4539-8a47-cd2ebc63195c None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:56:40.484660 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e4ed3a59-9c4b-4539-8a47-cd2ebc63195c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:56:40.500333 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 684/1362] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:56:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 03:56:40.559326 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cfd3e1-f779-48e1-a14d-84b234386217 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:56:40.582511 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cfd3e1-f779-48e1-a14d-84b234386217 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:56:40.589650 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870aab6f-8eb2-409f-b0c3-ee040e1d2c12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:56:40.590468 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870aab6f-8eb2-409f-b0c3-ee040e1d2c12 service nova] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:40.590756 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870aab6f-8eb2-409f-b0c3-ee040e1d2c12 service nova] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:40.591038 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870aab6f-8eb2-409f-b0c3-ee040e1d2c12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:40.603916 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870aab6f-8eb2-409f-b0c3-ee040e1d2c12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:56:40.605906 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870aab6f-8eb2-409f-b0c3-ee040e1d2c12 service nova] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:56:40.618703 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 679/1363] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:56:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 03:56:43.227895 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf77ee3-abd4-43c7-833c-5fc48614715b None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:43.228478 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf77ee3-abd4-43c7-833c-5fc48614715b None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:43.228478 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf77ee3-abd4-43c7-833c-5fc48614715b None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:43.230423 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 685/1364] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:56:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:56:43.236250 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5becc-8d8b-456e-89d7-9de3e1d33597 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:43.236772 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5becc-8d8b-456e-89d7-9de3e1d33597 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:43.236928 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5becc-8d8b-456e-89d7-9de3e1d33597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:43.257086 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-7ba5becc-8d8b-456e-89d7-9de3e1d33597 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:56:43.258425 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-7ba5becc-8d8b-456e-89d7-9de3e1d33597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:56:43.266945 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 680/1365] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:56:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 03:56:43.315413 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fc4fb-671c-40cc-a970-58c3ef4c9e54 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:43.315957 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fc4fb-671c-40cc-a970-58c3ef4c9e54 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:43.316454 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fc4fb-671c-40cc-a970-58c3ef4c9e54 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:43.319018 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 686/1366] 10.222.0.46 () {54 vars in 961 bytes} [Fri Jul 1 03:56:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:56:43.325733 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c279c-cff6-4ab9-a115-6e1d0347e2d5 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:43.331909 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c279c-cff6-4ab9-a115-6e1d0347e2d5 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:43.331909 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c279c-cff6-4ab9-a115-6e1d0347e2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:43.356045 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-c40c279c-cff6-4ab9-a115-6e1d0347e2d5 None None] MFA Rules not processed for user `2da466ad31d344898f5c838f77d45181`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:56:43.358046 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-c40c279c-cff6-4ab9-a115-6e1d0347e2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:56:43.374294 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 681/1367] 10.222.0.46 () {58 vars in 1058 bytes} [Fri Jul 1 03:56:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 03:56:43.382546 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fc4fb-671c-40cc-a970-58c3ef4c9e54 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:56:43.398517 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fc4fb-671c-40cc-a970-58c3ef4c9e54 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:56:43.411931 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae56ac-9343-42e5-8f1c-a5968957afcc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:56:43.412603 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae56ac-9343-42e5-8f1c-a5968957afcc service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:43.412891 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae56ac-9343-42e5-8f1c-a5968957afcc service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:43.413173 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae56ac-9343-42e5-8f1c-a5968957afcc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:43.423589 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae56ac-9343-42e5-8f1c-a5968957afcc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:56:43.425216 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae56ac-9343-42e5-8f1c-a5968957afcc service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:56:43.436576 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 687/1368] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:56:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 03:56:45.858452 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffacfeb5-b14e-48ac-b517-37cda2bcfbcb None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:45.859318 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffacfeb5-b14e-48ac-b517-37cda2bcfbcb None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:45.859890 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffacfeb5-b14e-48ac-b517-37cda2bcfbcb None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:45.861271 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 682/1369] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:56:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 03:56:45.867715 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5a5d4-57a0-44d9-a3fc-20628cb44358 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:45.868451 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5a5d4-57a0-44d9-a3fc-20628cb44358 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:45.868451 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5a5d4-57a0-44d9-a3fc-20628cb44358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:45.891596 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-cbf5a5d4-57a0-44d9-a3fc-20628cb44358 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:56:45.893307 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-cbf5a5d4-57a0-44d9-a3fc-20628cb44358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:56:45.903666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 688/1370] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 03:56:45.952302 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffacfeb5-b14e-48ac-b517-37cda2bcfbcb None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:56:45.969366 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffacfeb5-b14e-48ac-b517-37cda2bcfbcb None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:56:45.975590 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1488f20-233f-46eb-a6cc-2fc65ecff105 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:56:45.976277 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1488f20-233f-46eb-a6cc-2fc65ecff105 service nova] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:45.976551 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1488f20-233f-46eb-a6cc-2fc65ecff105 service nova] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:45.977016 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1488f20-233f-46eb-a6cc-2fc65ecff105 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:45.987057 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1488f20-233f-46eb-a6cc-2fc65ecff105 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:56:45.988870 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1488f20-233f-46eb-a6cc-2fc65ecff105 service nova] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:56:46.000750 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 683/1371] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:56:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 03:56:46.832236 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e577cf2-6b4b-427a-b9b0-0ffad7c747da None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:46.832803 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e577cf2-6b4b-427a-b9b0-0ffad7c747da None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:46.833144 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e577cf2-6b4b-427a-b9b0-0ffad7c747da None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:46.834534 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 689/1372] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:56:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 03:56:46.840766 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6a75d-8c1a-447a-b3e7-620cdc79cce4 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:46.841049 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6a75d-8c1a-447a-b3e7-620cdc79cce4 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:46.841330 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6a75d-8c1a-447a-b3e7-620cdc79cce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:46.862458 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-d7f6a75d-8c1a-447a-b3e7-620cdc79cce4 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:56:46.864452 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-d7f6a75d-8c1a-447a-b3e7-620cdc79cce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:56:46.874341 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 684/1373] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 03:56:47.204696 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063abec5-1f51-477c-aea4-075d896eb7e4 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:47.205210 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063abec5-1f51-477c-aea4-075d896eb7e4 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:47.205308 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063abec5-1f51-477c-aea4-075d896eb7e4 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:47.206876 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 690/1374] 10.222.0.46 () {54 vars in 963 bytes} [Fri Jul 1 03:56:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:56:47.217273 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc54061-fb32-463a-bded-eeb3612f9ed6 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:47.220019 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc54061-fb32-463a-bded-eeb3612f9ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:47.220019 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc54061-fb32-463a-bded-eeb3612f9ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:47.276851 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-3dc54061-fb32-463a-bded-eeb3612f9ed6 None None] MFA Rules not processed for user `418106a8c3104dcfa40fcc6c68356294`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:56:47.278085 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-3dc54061-fb32-463a-bded-eeb3612f9ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:56:47.357061 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 685/1375] 10.222.0.46 () {58 vars in 1060 bytes} [Fri Jul 1 03:56:47 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 03:56:47.367258 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063abec5-1f51-477c-aea4-075d896eb7e4 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:56:47.380023 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063abec5-1f51-477c-aea4-075d896eb7e4 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:56:47.384953 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd12683-e2da-4f51-8e3c-16e8a5666f6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:56:47.385629 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd12683-e2da-4f51-8e3c-16e8a5666f6e service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:47.385933 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd12683-e2da-4f51-8e3c-16e8a5666f6e service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:47.386493 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd12683-e2da-4f51-8e3c-16e8a5666f6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:47.396591 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd12683-e2da-4f51-8e3c-16e8a5666f6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:56:47.398672 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd12683-e2da-4f51-8e3c-16e8a5666f6e service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:56:47.410398 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 691/1376] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:56:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 03:56:48.296630 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2d4e7-24e7-480a-a949-5db53561cf8e None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:48.297168 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2d4e7-24e7-480a-a949-5db53561cf8e None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:48.297168 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2d4e7-24e7-480a-a949-5db53561cf8e None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:48.298634 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 686/1377] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:56:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 03:56:48.305042 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65b89e-a5a7-4707-8cc7-4b454c70fdda None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:48.305829 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65b89e-a5a7-4707-8cc7-4b454c70fdda None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:48.305829 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65b89e-a5a7-4707-8cc7-4b454c70fdda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:48.327612 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-cd65b89e-a5a7-4707-8cc7-4b454c70fdda None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:56:48.334187 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-cd65b89e-a5a7-4707-8cc7-4b454c70fdda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:56:48.337468 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 692/1378] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:56:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 03:56:48.381908 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f2d4e7-24e7-480a-a949-5db53561cf8e None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:56:48.397228 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f2d4e7-24e7-480a-a949-5db53561cf8e None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:56:48.402665 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a54ac-89d1-4a43-a7cf-ff9ba222a803 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:56:48.405834 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a54ac-89d1-4a43-a7cf-ff9ba222a803 service nova] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:48.405834 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a54ac-89d1-4a43-a7cf-ff9ba222a803 service nova] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:48.405834 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a54ac-89d1-4a43-a7cf-ff9ba222a803 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:48.415252 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a54ac-89d1-4a43-a7cf-ff9ba222a803 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:56:48.416894 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a54ac-89d1-4a43-a7cf-ff9ba222a803 service nova] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:56:48.421102 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:56:48.430004 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 687/1379] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:56:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 03:56:50.717959 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063293af-bb81-445e-b4c4-4355bcd311a2 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:50.718493 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063293af-bb81-445e-b4c4-4355bcd311a2 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:50.718493 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063293af-bb81-445e-b4c4-4355bcd311a2 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:50.719837 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 693/1380] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:56:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:56:50.725238 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b9099-d0e4-492e-a1ef-1ac502216e5b None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:50.726503 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b9099-d0e4-492e-a1ef-1ac502216e5b None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:50.726684 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b9099-d0e4-492e-a1ef-1ac502216e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:50.746759 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-e73b9099-d0e4-492e-a1ef-1ac502216e5b None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:56:50.747984 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-e73b9099-d0e4-492e-a1ef-1ac502216e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:56:50.756017 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 688/1381] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:56:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 03:56:50.801778 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063293af-bb81-445e-b4c4-4355bcd311a2 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:56:50.817670 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063293af-bb81-445e-b4c4-4355bcd311a2 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:56:50.823296 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4efbfd2-a6b5-4555-b0ee-8203842fdae5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:56:50.823905 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efbfd2-a6b5-4555-b0ee-8203842fdae5 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:50.824185 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efbfd2-a6b5-4555-b0ee-8203842fdae5 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:50.824461 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efbfd2-a6b5-4555-b0ee-8203842fdae5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:50.834489 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4efbfd2-a6b5-4555-b0ee-8203842fdae5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:56:50.836248 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4efbfd2-a6b5-4555-b0ee-8203842fdae5 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:56:50.847559 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 694/1382] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:56:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 03:56:53.122904 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62632014-2aca-405d-be09-483ebc3560f5 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:53.123440 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62632014-2aca-405d-be09-483ebc3560f5 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:53.123957 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62632014-2aca-405d-be09-483ebc3560f5 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:53.126813 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 689/1383] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:56:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:56:53.134790 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3339b7c-16b3-410e-8be5-806c615d3a92 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:53.135302 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3339b7c-16b3-410e-8be5-806c615d3a92 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:53.135999 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3339b7c-16b3-410e-8be5-806c615d3a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:53.158941 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-d3339b7c-16b3-410e-8be5-806c615d3a92 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:56:53.160431 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d3339b7c-16b3-410e-8be5-806c615d3a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:56:53.170149 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 695/1384] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:56:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 03:56:53.225026 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62632014-2aca-405d-be09-483ebc3560f5 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:56:53.242753 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62632014-2aca-405d-be09-483ebc3560f5 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:56:53.249963 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf706a-3236-4aa1-9583-2574e49588a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:56:53.250620 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf706a-3236-4aa1-9583-2574e49588a3 service nova] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:53.250897 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf706a-3236-4aa1-9583-2574e49588a3 service nova] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:53.251365 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf706a-3236-4aa1-9583-2574e49588a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:53.263722 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf706a-3236-4aa1-9583-2574e49588a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:56:53.265702 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf706a-3236-4aa1-9583-2574e49588a3 service nova] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:56:53.280063 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 690/1385] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:56:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 03:56:55.838853 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26aba77-4d76-4ab5-91ee-443d0bf2ca7f None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:55.839343 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26aba77-4d76-4ab5-91ee-443d0bf2ca7f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:55.839671 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26aba77-4d76-4ab5-91ee-443d0bf2ca7f None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:55.840822 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 696/1386] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:56:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 03:56:55.846341 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9bd39-4808-4256-a5ec-b0d58ae180d4 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:55.846799 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9bd39-4808-4256-a5ec-b0d58ae180d4 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:55.847266 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9bd39-4808-4256-a5ec-b0d58ae180d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:55.866920 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-b0a9bd39-4808-4256-a5ec-b0d58ae180d4 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:56:55.868522 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-b0a9bd39-4808-4256-a5ec-b0d58ae180d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:56:55.876936 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 691/1387] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:56:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 03:56:55.925989 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26aba77-4d76-4ab5-91ee-443d0bf2ca7f None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:56:55.946103 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26aba77-4d76-4ab5-91ee-443d0bf2ca7f None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:56:55.957794 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174d73f-6a88-4034-8e77-4b51a97c2b3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:56:55.958818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174d73f-6a88-4034-8e77-4b51a97c2b3d service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:55.959097 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174d73f-6a88-4034-8e77-4b51a97c2b3d service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:55.959425 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174d73f-6a88-4034-8e77-4b51a97c2b3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:55.971525 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f174d73f-6a88-4034-8e77-4b51a97c2b3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:56:55.972870 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f174d73f-6a88-4034-8e77-4b51a97c2b3d service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:56:55.984714 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 697/1388] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:56:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 03:56:58.346193 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40c5ef-8b53-4f9c-a34b-56f949472726 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:58.346714 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40c5ef-8b53-4f9c-a34b-56f949472726 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:58.346714 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40c5ef-8b53-4f9c-a34b-56f949472726 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:58.348103 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 692/1389] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:56:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:56:58.354380 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40e300-ca23-4324-954a-a92ef569f052 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:58.354852 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40e300-ca23-4324-954a-a92ef569f052 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:58.355034 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40e300-ca23-4324-954a-a92ef569f052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:58.373483 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-8e40e300-ca23-4324-954a-a92ef569f052 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:56:58.374931 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8e40e300-ca23-4324-954a-a92ef569f052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:56:58.384002 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 698/1390] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:56:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 03:56:58.430103 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40c5ef-8b53-4f9c-a34b-56f949472726 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:56:58.445962 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40c5ef-8b53-4f9c-a34b-56f949472726 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:56:58.452112 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaea20e-920d-4385-97d0-1e79364a2f95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:56:58.452766 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaea20e-920d-4385-97d0-1e79364a2f95 service nova] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:56:58.453082 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaea20e-920d-4385-97d0-1e79364a2f95 service nova] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:56:58.453362 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaea20e-920d-4385-97d0-1e79364a2f95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:56:58.463895 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaea20e-920d-4385-97d0-1e79364a2f95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:56:58.465567 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaea20e-920d-4385-97d0-1e79364a2f95 service nova] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:56:58.477484 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 693/1391] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:56:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 03:57:00.782786 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec124b-4641-401d-a2d5-9dd9d79e6b5b None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:00.783367 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec124b-4641-401d-a2d5-9dd9d79e6b5b None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:00.783367 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec124b-4641-401d-a2d5-9dd9d79e6b5b None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:00.784960 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 699/1392] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:57:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:57:00.792686 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca7ebd-17ae-42f0-b404-40ffc63af752 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:00.793160 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca7ebd-17ae-42f0-b404-40ffc63af752 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:00.793284 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca7ebd-17ae-42f0-b404-40ffc63af752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:00.816768 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-16ca7ebd-17ae-42f0-b404-40ffc63af752 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:57:00.818402 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-16ca7ebd-17ae-42f0-b404-40ffc63af752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:57:00.828859 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 694/1393] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:57:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 03:57:00.886626 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec124b-4641-401d-a2d5-9dd9d79e6b5b None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:57:00.894693 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=46 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:57:00.903000 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec124b-4641-401d-a2d5-9dd9d79e6b5b None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:57:00.909423 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f530a-7f7a-40bb-9372-c728fa23c56a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:57:00.910351 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f530a-7f7a-40bb-9372-c728fa23c56a service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:00.910885 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f530a-7f7a-40bb-9372-c728fa23c56a service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:00.911161 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f530a-7f7a-40bb-9372-c728fa23c56a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:00.922910 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f530a-7f7a-40bb-9372-c728fa23c56a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:57:00.925569 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f530a-7f7a-40bb-9372-c728fa23c56a service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:57:00.937881 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 700/1394] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:57:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 03:57:03.312012 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6963c6-9b11-4632-92fb-cf5dfc2a3394 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:03.312549 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6963c6-9b11-4632-92fb-cf5dfc2a3394 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:03.312549 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6963c6-9b11-4632-92fb-cf5dfc2a3394 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:03.313933 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 695/1395] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:57:03.319681 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd0d61-fcda-445f-84c6-f29c6fce4529 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:03.320346 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd0d61-fcda-445f-84c6-f29c6fce4529 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:03.320346 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd0d61-fcda-445f-84c6-f29c6fce4529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:03.338900 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-a2cd0d61-fcda-445f-84c6-f29c6fce4529 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:57:03.340029 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a2cd0d61-fcda-445f-84c6-f29c6fce4529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:57:03.347983 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 701/1396] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 03:57:03.395246 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6963c6-9b11-4632-92fb-cf5dfc2a3394 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:57:03.410562 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6963c6-9b11-4632-92fb-cf5dfc2a3394 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:57:03.419156 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ab62c-e20e-43ad-81c1-f77cf8dee751 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:57:03.420304 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ab62c-e20e-43ad-81c1-f77cf8dee751 service nova] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:03.421116 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ab62c-e20e-43ad-81c1-f77cf8dee751 service nova] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:03.421527 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ab62c-e20e-43ad-81c1-f77cf8dee751 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:03.437456 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5ab62c-e20e-43ad-81c1-f77cf8dee751 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:57:03.440179 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5ab62c-e20e-43ad-81c1-f77cf8dee751 service nova] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:57:03.457855 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 696/1397] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:57:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 03:57:05.852153 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30697f46-8d4f-4830-8fb4-b1413d054627 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:05.852678 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30697f46-8d4f-4830-8fb4-b1413d054627 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:05.852678 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30697f46-8d4f-4830-8fb4-b1413d054627 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:05.853856 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 702/1398] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:57:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:57:05.859334 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460aa07-7a37-4626-a5e2-934ff3c384d8 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:05.859834 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460aa07-7a37-4626-a5e2-934ff3c384d8 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:05.859926 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460aa07-7a37-4626-a5e2-934ff3c384d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:05.879516 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-e460aa07-7a37-4626-a5e2-934ff3c384d8 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:57:05.880738 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-e460aa07-7a37-4626-a5e2-934ff3c384d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:57:05.888968 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 697/1399] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:57:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 03:57:05.933285 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30697f46-8d4f-4830-8fb4-b1413d054627 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:57:05.947529 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30697f46-8d4f-4830-8fb4-b1413d054627 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:57:05.952935 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b48948-7e90-44c2-910f-b65a69a96b4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:57:05.953589 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b48948-7e90-44c2-910f-b65a69a96b4b service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:05.953859 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b48948-7e90-44c2-910f-b65a69a96b4b service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:05.954137 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b48948-7e90-44c2-910f-b65a69a96b4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:05.962520 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b48948-7e90-44c2-910f-b65a69a96b4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:57:05.964184 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b48948-7e90-44c2-910f-b65a69a96b4b service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:57:05.974290 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 703/1400] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:57:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 03:57:07.057265 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eadb58-2cad-4d58-a5cb-16f628853f75 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:07.057851 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eadb58-2cad-4d58-a5cb-16f628853f75 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:07.057851 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eadb58-2cad-4d58-a5cb-16f628853f75 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:07.059188 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 698/1401] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:57:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:57:07.064364 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2186e-0355-4e3b-8b5e-a4a0beace527 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:07.064768 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2186e-0355-4e3b-8b5e-a4a0beace527 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:07.064912 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2186e-0355-4e3b-8b5e-a4a0beace527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:07.082229 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-67a2186e-0355-4e3b-8b5e-a4a0beace527 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:57:07.083433 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-67a2186e-0355-4e3b-8b5e-a4a0beace527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:57:07.092022 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 704/1402] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 03:57:07.153414 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7496a-21b1-4ed6-b8ac-d6ef1dc2b817 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:07.153727 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7496a-21b1-4ed6-b8ac-d6ef1dc2b817 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:07.154005 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7496a-21b1-4ed6-b8ac-d6ef1dc2b817 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:07.155385 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 699/1403] 10.222.0.46 () {54 vars in 962 bytes} [Fri Jul 1 03:57:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:57:07.161186 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662fb51a-88ad-47ea-a273-4f5a106a5f10 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:07.161470 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662fb51a-88ad-47ea-a273-4f5a106a5f10 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:07.161749 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662fb51a-88ad-47ea-a273-4f5a106a5f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:07.213928 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-662fb51a-88ad-47ea-a273-4f5a106a5f10 None None] MFA Rules not processed for user `ff2e6387d102445d963de072c55833d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:57:07.215132 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-662fb51a-88ad-47ea-a273-4f5a106a5f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:57:07.283375 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 705/1404] 10.222.0.46 () {58 vars in 1059 bytes} [Fri Jul 1 03:57:07 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 03:57:07.291534 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7496a-21b1-4ed6-b8ac-d6ef1dc2b817 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:57:07.302428 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7496a-21b1-4ed6-b8ac-d6ef1dc2b817 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:57:07.305904 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a9fd58-3219-44d4-b138-ef87d1466b4c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff2e6387d102445d963de072c55833d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:57:07.306541 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9fd58-3219-44d4-b138-ef87d1466b4c service glance] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:07.306816 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9fd58-3219-44d4-b138-ef87d1466b4c service glance] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:07.307085 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9fd58-3219-44d4-b138-ef87d1466b4c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:07.317323 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a9fd58-3219-44d4-b138-ef87d1466b4c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:57:07.319192 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a9fd58-3219-44d4-b138-ef87d1466b4c service glance] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:57:07.329201 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 700/1405] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:57:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 03:57:08.248223 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d58cf-ebe4-43a8-81a5-66563f6beff8 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:08.253345 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d58cf-ebe4-43a8-81a5-66563f6beff8 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:08.253345 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d58cf-ebe4-43a8-81a5-66563f6beff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:08.298740 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-ef9d58cf-ebe4-43a8-81a5-66563f6beff8 None None] MFA Rules not processed for user `dd41221abea04808bed5ef4ac4528c62`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:57:08.300039 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ef9d58cf-ebe4-43a8-81a5-66563f6beff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:57:08.372781 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 706/1406] 10.222.0.46 () {58 vars in 1009 bytes} [Fri Jul 1 03:57:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 03:57:08.417425 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdefbd-7c7d-496b-8ec2-c780fc8aae37 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:08.417425 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdefbd-7c7d-496b-8ec2-c780fc8aae37 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:08.417425 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdefbd-7c7d-496b-8ec2-c780fc8aae37 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:08.418391 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 701/1407] 10.222.0.46 () {54 vars in 942 bytes} [Fri Jul 1 03:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:57:08.424760 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4a2bd-83f8-4d58-b14f-ea3cc552596e None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:08.425055 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4a2bd-83f8-4d58-b14f-ea3cc552596e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:08.425399 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4a2bd-83f8-4d58-b14f-ea3cc552596e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:08.445110 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:57:08.482386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-19f4a2bd-83f8-4d58-b14f-ea3cc552596e None None] MFA Rules not processed for user `83787880173b459c8975b834bd47a51a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:57:08.484171 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-19f4a2bd-83f8-4d58-b14f-ea3cc552596e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:57:08.572014 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 707/1408] 10.222.0.46 () {58 vars in 1039 bytes} [Fri Jul 1 03:57:08 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 03:57:08.581602 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdefbd-7c7d-496b-8ec2-c780fc8aae37 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:57:08.595678 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdefbd-7c7d-496b-8ec2-c780fc8aae37 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:57:08.601742 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23509f2-7071-4281-bf0c-78ff3a742238 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83787880173b459c8975b834bd47a51a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:57:08.602411 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23509f2-7071-4281-bf0c-78ff3a742238 service swift] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:08.602695 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23509f2-7071-4281-bf0c-78ff3a742238 service swift] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:08.602969 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23509f2-7071-4281-bf0c-78ff3a742238 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:08.612251 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23509f2-7071-4281-bf0c-78ff3a742238 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:57:08.613948 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23509f2-7071-4281-bf0c-78ff3a742238 service swift] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:57:08.645885 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 702/1409] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Jul 1 03:57:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 03:57:18.568761 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=39 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:57:18.619472 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=43 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:57:32.745134 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb264f81-c898-4d79-959d-ceb42af21e8c None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:32.745695 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb264f81-c898-4d79-959d-ceb42af21e8c None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:32.745695 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb264f81-c898-4d79-959d-ceb42af21e8c None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:32.747168 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 708/1410] 10.222.0.46 () {54 vars in 918 bytes} [Fri Jul 1 03:57:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:57:32.752144 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a92374-9ca9-486e-9b05-9bba1b25b682 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:32.752540 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a92374-9ca9-486e-9b05-9bba1b25b682 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:32.752726 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a92374-9ca9-486e-9b05-9bba1b25b682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:32.772161 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-35a92374-9ca9-486e-9b05-9bba1b25b682 None None] MFA Rules not processed for user `4efe4a6dd11047688892641a936e2914`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:57:32.773297 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-35a92374-9ca9-486e-9b05-9bba1b25b682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:57:32.781988 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 703/1411] 10.222.0.46 () {58 vars in 1015 bytes} [Fri Jul 1 03:57:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 03:57:32.796473 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6a3e6-202c-4959-a417-a3bf4cbc621f None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:32.796764 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6a3e6-202c-4959-a417-a3bf4cbc621f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:32.797046 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6a3e6-202c-4959-a417-a3bf4cbc621f None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:32.798462 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 709/1412] 10.222.0.46 () {54 vars in 918 bytes} [Fri Jul 1 03:57:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:57:32.803051 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e99bd0-25b4-4070-898c-e26903c1d40b None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:32.803336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e99bd0-25b4-4070-898c-e26903c1d40b None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:32.803643 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e99bd0-25b4-4070-898c-e26903c1d40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:32.822507 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-14e99bd0-25b4-4070-898c-e26903c1d40b None None] MFA Rules not processed for user `2da466ad31d344898f5c838f77d45181`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:57:32.823743 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-14e99bd0-25b4-4070-898c-e26903c1d40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:57:32.833443 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 704/1413] 10.222.0.46 () {58 vars in 1015 bytes} [Fri Jul 1 03:57:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 03:57:35.361827 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdcf3a4-93dc-4549-9d6a-9d9c282ab46b None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:35.362333 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdcf3a4-93dc-4549-9d6a-9d9c282ab46b None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:35.362333 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdcf3a4-93dc-4549-9d6a-9d9c282ab46b None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:35.364268 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 03:57:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:57:35.369564 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2ab05-29dd-423b-b5f2-95d769d517fc None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:35.369965 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2ab05-29dd-423b-b5f2-95d769d517fc None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:35.370130 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2ab05-29dd-423b-b5f2-95d769d517fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:35.388236 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-d2b2ab05-29dd-423b-b5f2-95d769d517fc None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:57:35.389436 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-d2b2ab05-29dd-423b-b5f2-95d769d517fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:57:35.397401 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 03:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 03:57:35.441885 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdcf3a4-93dc-4549-9d6a-9d9c282ab46b None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:57:35.456855 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdcf3a4-93dc-4549-9d6a-9d9c282ab46b None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:57:35.462230 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976c1fa-0708-4dc1-ab5c-93a58c001a48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:57:35.462908 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976c1fa-0708-4dc1-ab5c-93a58c001a48 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:35.463190 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976c1fa-0708-4dc1-ab5c-93a58c001a48 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:35.463497 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976c1fa-0708-4dc1-ab5c-93a58c001a48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:35.472294 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d976c1fa-0708-4dc1-ab5c-93a58c001a48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:57:35.478141 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d976c1fa-0708-4dc1-ab5c-93a58c001a48 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:57:35.483575 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 711/1416] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:57:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 03:57:36.404352 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83625a2-c6c9-49e9-a9a9-519d75b00e82 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:36.404915 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83625a2-c6c9-49e9-a9a9-519d75b00e82 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:36.404915 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83625a2-c6c9-49e9-a9a9-519d75b00e82 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:36.406235 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 1 03:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:57:36.412312 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce02de0-4cc6-4663-a26f-5205f7ff4232 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:36.412790 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce02de0-4cc6-4663-a26f-5205f7ff4232 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:36.412894 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce02de0-4cc6-4663-a26f-5205f7ff4232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:36.430807 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-6ce02de0-4cc6-4663-a26f-5205f7ff4232 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:57:36.432039 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-6ce02de0-4cc6-4663-a26f-5205f7ff4232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:57:36.440132 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 1 03:57:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 03:57:36.593013 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83625a2-c6c9-49e9-a9a9-519d75b00e82 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:57:36.607945 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83625a2-c6c9-49e9-a9a9-519d75b00e82 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:57:36.614288 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0b3c1-002f-49a9-b701-fa5bb4187f06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:57:36.614932 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0b3c1-002f-49a9-b701-fa5bb4187f06 service nova] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:36.615214 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0b3c1-002f-49a9-b701-fa5bb4187f06 service nova] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:36.615526 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0b3c1-002f-49a9-b701-fa5bb4187f06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:36.624242 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d0b3c1-002f-49a9-b701-fa5bb4187f06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:57:36.625834 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d0b3c1-002f-49a9-b701-fa5bb4187f06 service nova] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:57:36.636090 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 707/1419] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:57:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 03:57:37.523077 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc031984-efb2-4822-a21b-fe06eaeba357 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:37.523708 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc031984-efb2-4822-a21b-fe06eaeba357 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:37.523708 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc031984-efb2-4822-a21b-fe06eaeba357 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:37.525079 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 1 03:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:57:37.530284 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a92d7-00bd-447b-8b0d-dd50c2f31f42 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:37.530749 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a92d7-00bd-447b-8b0d-dd50c2f31f42 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:37.530860 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a92d7-00bd-447b-8b0d-dd50c2f31f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:37.550018 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-861a92d7-00bd-447b-8b0d-dd50c2f31f42 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:57:37.551844 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-861a92d7-00bd-447b-8b0d-dd50c2f31f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:57:37.559722 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 1 03:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 03:57:37.712441 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc031984-efb2-4822-a21b-fe06eaeba357 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:57:37.727587 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc031984-efb2-4822-a21b-fe06eaeba357 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:57:37.733215 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c891bac-1c20-4a84-9b50-c0edc585333f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:57:37.733899 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c891bac-1c20-4a84-9b50-c0edc585333f service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:37.734182 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c891bac-1c20-4a84-9b50-c0edc585333f service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:37.734459 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c891bac-1c20-4a84-9b50-c0edc585333f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:37.743536 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c891bac-1c20-4a84-9b50-c0edc585333f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:57:37.745074 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c891bac-1c20-4a84-9b50-c0edc585333f service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:57:37.754767 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 714/1422] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:57:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 03:57:38.620630 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5298f-b9c2-45dd-b4a2-d2cec28f0121 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:38.621610 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5298f-b9c2-45dd-b4a2-d2cec28f0121 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:38.621610 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5298f-b9c2-45dd-b4a2-d2cec28f0121 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:38.622521 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 1 03:57:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:57:38.627650 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78faa2af-5695-458f-aa1b-47fed59f7934 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:38.628061 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78faa2af-5695-458f-aa1b-47fed59f7934 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:38.628207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78faa2af-5695-458f-aa1b-47fed59f7934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:38.646686 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-78faa2af-5695-458f-aa1b-47fed59f7934 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:57:38.647937 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-78faa2af-5695-458f-aa1b-47fed59f7934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:57:38.655795 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 1 03:57:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 03:57:38.807745 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba5298f-b9c2-45dd-b4a2-d2cec28f0121 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:57:38.821857 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba5298f-b9c2-45dd-b4a2-d2cec28f0121 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:57:38.827127 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bab595-bd51-48e3-93c6-1ed784f0b38e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:57:38.827798 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bab595-bd51-48e3-93c6-1ed784f0b38e service nova] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:38.828075 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bab595-bd51-48e3-93c6-1ed784f0b38e service nova] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:38.828361 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bab595-bd51-48e3-93c6-1ed784f0b38e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:38.837034 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bab595-bd51-48e3-93c6-1ed784f0b38e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:57:38.839261 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bab595-bd51-48e3-93c6-1ed784f0b38e service nova] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:57:38.851779 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 710/1425] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:57:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 03:57:39.728447 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c74105-d2e2-4ba4-a521-9b51528060d5 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:39.728979 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c74105-d2e2-4ba4-a521-9b51528060d5 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:39.728979 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c74105-d2e2-4ba4-a521-9b51528060d5 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:39.730380 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 1 03:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:57:39.735632 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb64dc-382a-4ca3-9d17-78e50c2554a9 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:39.736058 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb64dc-382a-4ca3-9d17-78e50c2554a9 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:39.736196 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb64dc-382a-4ca3-9d17-78e50c2554a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:39.754520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-8edb64dc-382a-4ca3-9d17-78e50c2554a9 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:57:39.755747 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-8edb64dc-382a-4ca3-9d17-78e50c2554a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:57:39.763477 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 1 03:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 03:57:39.919299 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c74105-d2e2-4ba4-a521-9b51528060d5 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:57:39.933553 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c74105-d2e2-4ba4-a521-9b51528060d5 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:57:39.938962 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5f472-0638-41ca-ad5c-86d1544ecf9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:57:39.939640 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5f472-0638-41ca-ad5c-86d1544ecf9f service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:39.939925 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5f472-0638-41ca-ad5c-86d1544ecf9f service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:39.940207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5f472-0638-41ca-ad5c-86d1544ecf9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:39.948845 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b5f472-0638-41ca-ad5c-86d1544ecf9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:57:39.950434 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b5f472-0638-41ca-ad5c-86d1544ecf9f service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:57:39.960465 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 717/1428] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:57:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 03:57:40.855650 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e707331-c446-4eed-8ede-ed8340335c83 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:40.856235 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e707331-c446-4eed-8ede-ed8340335c83 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:40.856235 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e707331-c446-4eed-8ede-ed8340335c83 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:40.857575 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 1 03:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:57:40.863031 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2b9bc-c1d2-4ebd-9588-ba7bc0caf018 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:40.863503 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2b9bc-c1d2-4ebd-9588-ba7bc0caf018 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:40.863616 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2b9bc-c1d2-4ebd-9588-ba7bc0caf018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:40.881673 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-c5f2b9bc-c1d2-4ebd-9588-ba7bc0caf018 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:57:40.882870 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c5f2b9bc-c1d2-4ebd-9588-ba7bc0caf018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:57:40.890693 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 1 03:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 03:57:41.042359 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e707331-c446-4eed-8ede-ed8340335c83 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:57:41.056587 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e707331-c446-4eed-8ede-ed8340335c83 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:57:41.061842 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a928c7e-2131-46db-b063-f621b159b7ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:57:41.062469 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a928c7e-2131-46db-b063-f621b159b7ef service nova] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:41.062770 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a928c7e-2131-46db-b063-f621b159b7ef service nova] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:41.063024 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a928c7e-2131-46db-b063-f621b159b7ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:41.071611 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a928c7e-2131-46db-b063-f621b159b7ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:57:41.073212 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a928c7e-2131-46db-b063-f621b159b7ef service nova] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:57:41.083402 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 713/1431] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:57:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 03:57:41.958157 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f6f14-f4c4-49dc-9535-e8075c0c34df None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:41.958678 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f6f14-f4c4-49dc-9535-e8075c0c34df None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:41.958678 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f6f14-f4c4-49dc-9535-e8075c0c34df None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:41.960036 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 1 03:57:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:57:41.965165 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fb8b8-5f3b-4ea5-b856-6716d5b68abd None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:41.965615 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fb8b8-5f3b-4ea5-b856-6716d5b68abd None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:41.965714 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fb8b8-5f3b-4ea5-b856-6716d5b68abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:41.983515 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-4f2fb8b8-5f3b-4ea5-b856-6716d5b68abd None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:57:41.984701 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-4f2fb8b8-5f3b-4ea5-b856-6716d5b68abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:57:41.992556 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 1 03:57:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 03:57:42.142556 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f6f14-f4c4-49dc-9535-e8075c0c34df None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:57:42.156722 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f6f14-f4c4-49dc-9535-e8075c0c34df None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:57:42.162508 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae3eb4-14ac-4396-8d20-adc455bd9f10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:57:42.163159 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae3eb4-14ac-4396-8d20-adc455bd9f10 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:42.163433 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae3eb4-14ac-4396-8d20-adc455bd9f10 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:42.163754 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae3eb4-14ac-4396-8d20-adc455bd9f10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:42.172688 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae3eb4-14ac-4396-8d20-adc455bd9f10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:57:42.174275 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae3eb4-14ac-4396-8d20-adc455bd9f10 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:57:42.184387 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 720/1434] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:57:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 03:57:43.087725 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4c217-9f42-47ad-a8bf-d33fc75b1060 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:43.088297 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4c217-9f42-47ad-a8bf-d33fc75b1060 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:43.088297 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4c217-9f42-47ad-a8bf-d33fc75b1060 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:43.089619 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 1 03:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 03:57:43.094737 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239ab32-5bc9-4712-9356-8c7340912419 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:43.095171 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239ab32-5bc9-4712-9356-8c7340912419 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:43.095276 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239ab32-5bc9-4712-9356-8c7340912419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:43.113635 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-8239ab32-5bc9-4712-9356-8c7340912419 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:57:43.114819 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8239ab32-5bc9-4712-9356-8c7340912419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:57:43.123175 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 1 03:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 03:57:43.274530 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4c217-9f42-47ad-a8bf-d33fc75b1060 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:57:43.289115 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4c217-9f42-47ad-a8bf-d33fc75b1060 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:57:43.294398 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fef976-27f6-493a-a754-b30fc0289fd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:57:43.295027 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fef976-27f6-493a-a754-b30fc0289fd0 service nova] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:43.295311 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fef976-27f6-493a-a754-b30fc0289fd0 service nova] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:43.295624 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fef976-27f6-493a-a754-b30fc0289fd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:43.304671 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fef976-27f6-493a-a754-b30fc0289fd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:57:43.306249 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fef976-27f6-493a-a754-b30fc0289fd0 service nova] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:57:43.315566 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 716/1437] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:57:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 03:57:44.170185 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c731f-90f9-4f60-855d-6708ff7fb3c6 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:44.170876 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c731f-90f9-4f60-855d-6708ff7fb3c6 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:44.170876 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c731f-90f9-4f60-855d-6708ff7fb3c6 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:44.172282 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 1 03:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:57:44.177510 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e2052-8329-45ec-b077-f22e0f00dc4f None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:44.177956 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e2052-8329-45ec-b077-f22e0f00dc4f None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:44.178073 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e2052-8329-45ec-b077-f22e0f00dc4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:44.196155 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-245e2052-8329-45ec-b077-f22e0f00dc4f None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:57:44.197344 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-245e2052-8329-45ec-b077-f22e0f00dc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:57:44.205075 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 1 03:57:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 03:57:44.355617 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c731f-90f9-4f60-855d-6708ff7fb3c6 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:57:44.370098 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c731f-90f9-4f60-855d-6708ff7fb3c6 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:57:44.375523 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4fe83-2b49-404c-9db3-c6063d5e5674 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:57:44.376175 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4fe83-2b49-404c-9db3-c6063d5e5674 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:44.376467 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4fe83-2b49-404c-9db3-c6063d5e5674 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:44.376743 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4fe83-2b49-404c-9db3-c6063d5e5674 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:44.385227 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4fe83-2b49-404c-9db3-c6063d5e5674 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:57:44.386832 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4fe83-2b49-404c-9db3-c6063d5e5674 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:57:44.396847 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 723/1440] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:57:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 03:57:46.347599 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e855f77-76d0-460b-89c6-8689b1127797 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:46.348158 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e855f77-76d0-460b-89c6-8689b1127797 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:46.348158 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e855f77-76d0-460b-89c6-8689b1127797 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:46.349508 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 03:57:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:57:46.355080 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b38ec-4a11-4c04-a351-d1945d489275 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:46.355538 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b38ec-4a11-4c04-a351-d1945d489275 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:46.355656 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b38ec-4a11-4c04-a351-d1945d489275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:46.373720 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-855b38ec-4a11-4c04-a351-d1945d489275 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:57:46.374927 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-855b38ec-4a11-4c04-a351-d1945d489275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:57:46.383208 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 03:57:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 03:57:46.422079 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e855f77-76d0-460b-89c6-8689b1127797 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:57:46.433638 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e855f77-76d0-460b-89c6-8689b1127797 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:57:46.437335 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c6807-380c-4ae2-904d-ad245693649b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:57:46.437984 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c6807-380c-4ae2-904d-ad245693649b service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:46.438268 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c6807-380c-4ae2-904d-ad245693649b service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:46.438546 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c6807-380c-4ae2-904d-ad245693649b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:46.448137 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4c6807-380c-4ae2-904d-ad245693649b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:57:46.449574 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4c6807-380c-4ae2-904d-ad245693649b service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:57:46.459121 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 719/1443] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:57:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 03:57:48.696765 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316aa58e-ed8e-4491-947d-7a2bc73dd0dd None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:48.697324 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316aa58e-ed8e-4491-947d-7a2bc73dd0dd None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:48.697324 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316aa58e-ed8e-4491-947d-7a2bc73dd0dd None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:48.698622 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 03:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:57:48.703892 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413cd3b-651e-48ea-87f3-4d270358226a None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:48.704308 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413cd3b-651e-48ea-87f3-4d270358226a None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:48.704452 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413cd3b-651e-48ea-87f3-4d270358226a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:48.722276 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-2413cd3b-651e-48ea-87f3-4d270358226a None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:57:48.723471 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-2413cd3b-651e-48ea-87f3-4d270358226a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:57:48.731165 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 03:57:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 03:57:48.769467 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316aa58e-ed8e-4491-947d-7a2bc73dd0dd None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:57:48.779994 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316aa58e-ed8e-4491-947d-7a2bc73dd0dd None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:57:48.783388 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb320989-a3de-4bb4-8e2a-c9f31a8c63d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:57:48.784054 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb320989-a3de-4bb4-8e2a-c9f31a8c63d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:48.784591 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb320989-a3de-4bb4-8e2a-c9f31a8c63d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:48.784861 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb320989-a3de-4bb4-8e2a-c9f31a8c63d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:48.793680 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb320989-a3de-4bb4-8e2a-c9f31a8c63d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:57:48.795103 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb320989-a3de-4bb4-8e2a-c9f31a8c63d0 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:57:48.804490 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 726/1446] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:57:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 03:57:51.220471 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbabe63-87be-4f96-bd06-186f6c58368d None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:51.221050 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbabe63-87be-4f96-bd06-186f6c58368d None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:51.221050 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbabe63-87be-4f96-bd06-186f6c58368d None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:51.222378 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 03:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:57:51.227587 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b1e71-d469-4760-a2cc-3cea80955845 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:51.228039 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b1e71-d469-4760-a2cc-3cea80955845 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:51.228149 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b1e71-d469-4760-a2cc-3cea80955845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:51.246069 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-f55b1e71-d469-4760-a2cc-3cea80955845 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:57:51.247267 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f55b1e71-d469-4760-a2cc-3cea80955845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:57:51.255733 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 03:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 03:57:51.294323 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbabe63-87be-4f96-bd06-186f6c58368d None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:57:51.305552 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbabe63-87be-4f96-bd06-186f6c58368d None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:57:51.309018 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770b078-963b-4230-aad4-1cdc69c40718 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:57:51.309652 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770b078-963b-4230-aad4-1cdc69c40718 service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:51.309942 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770b078-963b-4230-aad4-1cdc69c40718 service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:51.310216 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770b078-963b-4230-aad4-1cdc69c40718 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:51.320089 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5770b078-963b-4230-aad4-1cdc69c40718 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:57:51.321520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5770b078-963b-4230-aad4-1cdc69c40718 service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:57:51.330887 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 722/1449] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:57:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 03:57:53.509007 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5899366-9519-4a7d-8e53-a5ab194fcdf2 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:53.509582 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5899366-9519-4a7d-8e53-a5ab194fcdf2 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:53.509582 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5899366-9519-4a7d-8e53-a5ab194fcdf2 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:53.511209 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 03:57:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:57:53.516677 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e248f4c-2812-4f92-84f4-c6c1cd3cc314 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:53.517086 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e248f4c-2812-4f92-84f4-c6c1cd3cc314 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:53.517230 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e248f4c-2812-4f92-84f4-c6c1cd3cc314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:53.535851 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-2e248f4c-2812-4f92-84f4-c6c1cd3cc314 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:57:53.537055 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-2e248f4c-2812-4f92-84f4-c6c1cd3cc314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:57:53.544791 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 03:57:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 03:57:53.583694 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5899366-9519-4a7d-8e53-a5ab194fcdf2 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:57:53.594484 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5899366-9519-4a7d-8e53-a5ab194fcdf2 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:57:53.598571 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc2ba4c-8133-47c7-a9db-c48a2a2f690a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:57:53.599214 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2ba4c-8133-47c7-a9db-c48a2a2f690a service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:53.599535 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2ba4c-8133-47c7-a9db-c48a2a2f690a service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:53.599813 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2ba4c-8133-47c7-a9db-c48a2a2f690a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:53.609016 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc2ba4c-8133-47c7-a9db-c48a2a2f690a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:57:53.610462 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc2ba4c-8133-47c7-a9db-c48a2a2f690a service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:57:53.620539 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 729/1452] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:57:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 03:57:55.746089 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb62d4-e842-4a88-8aac-5022010bb82d None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:55.746622 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb62d4-e842-4a88-8aac-5022010bb82d None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:55.746745 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb62d4-e842-4a88-8aac-5022010bb82d None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:55.748049 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 03:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:57:55.754072 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6c533-3ab1-4b73-be10-9efdf3a52be6 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:55.754554 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6c533-3ab1-4b73-be10-9efdf3a52be6 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:55.754653 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6c533-3ab1-4b73-be10-9efdf3a52be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:55.772060 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-f6b6c533-3ab1-4b73-be10-9efdf3a52be6 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:57:55.773173 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f6b6c533-3ab1-4b73-be10-9efdf3a52be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:57:55.780894 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 03:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 03:57:55.819108 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb62d4-e842-4a88-8aac-5022010bb82d None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:57:55.829838 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb62d4-e842-4a88-8aac-5022010bb82d None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:57:55.833444 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4bdb7a-d04a-4147-92da-5b19a65c2269 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:57:55.834080 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4bdb7a-d04a-4147-92da-5b19a65c2269 service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:55.834366 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4bdb7a-d04a-4147-92da-5b19a65c2269 service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:55.834644 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4bdb7a-d04a-4147-92da-5b19a65c2269 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:55.843677 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4bdb7a-d04a-4147-92da-5b19a65c2269 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:57:55.845116 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4bdb7a-d04a-4147-92da-5b19a65c2269 service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:57:55.854538 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 725/1455] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:57:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 03:57:57.944625 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e88f5e-ee41-4d11-99ee-df31d0637033 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:57.945150 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e88f5e-ee41-4d11-99ee-df31d0637033 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:57.945150 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e88f5e-ee41-4d11-99ee-df31d0637033 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:57.946496 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 03:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:57:57.951894 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffa6f4-c91f-4bd7-90ed-597e631b9439 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:57.952333 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffa6f4-c91f-4bd7-90ed-597e631b9439 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:57.952451 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffa6f4-c91f-4bd7-90ed-597e631b9439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:57.970539 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-36ffa6f4-c91f-4bd7-90ed-597e631b9439 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:57:57.972295 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-36ffa6f4-c91f-4bd7-90ed-597e631b9439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:57:57.980073 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 03:57:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 03:57:58.018049 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e88f5e-ee41-4d11-99ee-df31d0637033 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:57:58.028712 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e88f5e-ee41-4d11-99ee-df31d0637033 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:57:58.032232 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0d709-0f60-4f1c-a981-f23a1a1a4f69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:57:58.032866 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0d709-0f60-4f1c-a981-f23a1a1a4f69 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:57:58.033775 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0d709-0f60-4f1c-a981-f23a1a1a4f69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:57:58.034319 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0d709-0f60-4f1c-a981-f23a1a1a4f69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:57:58.043606 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c0d709-0f60-4f1c-a981-f23a1a1a4f69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:57:58.045052 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c0d709-0f60-4f1c-a981-f23a1a1a4f69 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:57:58.054642 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 732/1458] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:57:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 03:58:00.168322 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f99e0-1f9a-4eaf-81b0-e546a04d4928 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:58:00.168884 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f99e0-1f9a-4eaf-81b0-e546a04d4928 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:58:00.168884 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f99e0-1f9a-4eaf-81b0-e546a04d4928 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:58:00.170231 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 03:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:58:00.176274 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865e434-4de6-416d-a826-ba66be2c1250 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:58:00.176750 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865e434-4de6-416d-a826-ba66be2c1250 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:58:00.176846 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865e434-4de6-416d-a826-ba66be2c1250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:58:00.183020 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=70 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:58:00.195496 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-f865e434-4de6-416d-a826-ba66be2c1250 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:58:00.196707 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f865e434-4de6-416d-a826-ba66be2c1250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:58:00.204591 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 03:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 03:58:00.247696 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f99e0-1f9a-4eaf-81b0-e546a04d4928 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:58:00.254092 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=73 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:58:00.259953 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f99e0-1f9a-4eaf-81b0-e546a04d4928 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:58:00.272138 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57652f2a-0c9b-4485-bad3-0ccb205216e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:58:00.272138 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57652f2a-0c9b-4485-bad3-0ccb205216e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:58:00.272138 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57652f2a-0c9b-4485-bad3-0ccb205216e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:58:00.272138 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57652f2a-0c9b-4485-bad3-0ccb205216e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:58:00.273846 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57652f2a-0c9b-4485-bad3-0ccb205216e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:58:00.275288 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57652f2a-0c9b-4485-bad3-0ccb205216e7 service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:58:00.285090 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 728/1461] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:58:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 03:58:02.488689 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98210cb6-114f-4cef-964c-9ae894ebda4e None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:58:02.489225 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98210cb6-114f-4cef-964c-9ae894ebda4e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:58:02.489225 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98210cb6-114f-4cef-964c-9ae894ebda4e None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:58:02.490525 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 03:58:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:58:02.495817 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de320b-2444-498c-afd1-b6c1242f9d26 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:58:02.496213 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de320b-2444-498c-afd1-b6c1242f9d26 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:58:02.496375 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de320b-2444-498c-afd1-b6c1242f9d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:58:02.514402 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-d1de320b-2444-498c-afd1-b6c1242f9d26 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:58:02.515726 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-d1de320b-2444-498c-afd1-b6c1242f9d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:58:02.524054 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 03:58:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 03:58:02.561897 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98210cb6-114f-4cef-964c-9ae894ebda4e None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:58:02.573577 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98210cb6-114f-4cef-964c-9ae894ebda4e None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:58:02.577146 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d105d58b-249c-4b2b-aa5e-03b9b292a697 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:58:02.577781 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105d58b-249c-4b2b-aa5e-03b9b292a697 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:58:02.578062 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105d58b-249c-4b2b-aa5e-03b9b292a697 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:58:02.578339 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105d58b-249c-4b2b-aa5e-03b9b292a697 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:58:02.588131 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d105d58b-249c-4b2b-aa5e-03b9b292a697 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:58:02.590197 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d105d58b-249c-4b2b-aa5e-03b9b292a697 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:58:02.602520 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 735/1464] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:58:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 03:58:04.676637 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22380a2b-4248-482f-81fc-7e89d2fb49d2 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:58:04.677194 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22380a2b-4248-482f-81fc-7e89d2fb49d2 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:58:04.677194 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22380a2b-4248-482f-81fc-7e89d2fb49d2 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:58:04.678552 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 03:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:58:04.684351 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842627c-4550-4baa-ad2c-eed82cb53049 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:58:04.684864 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842627c-4550-4baa-ad2c-eed82cb53049 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:58:04.684969 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842627c-4550-4baa-ad2c-eed82cb53049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:58:04.702918 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-f842627c-4550-4baa-ad2c-eed82cb53049 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:58:04.704074 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f842627c-4550-4baa-ad2c-eed82cb53049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:58:04.711857 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 03:58:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 03:58:04.749318 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22380a2b-4248-482f-81fc-7e89d2fb49d2 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:58:04.750983 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-22380a2b-4248-482f-81fc-7e89d2fb49d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:58:04.764137 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22380a2b-4248-482f-81fc-7e89d2fb49d2 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:58:04.767641 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb35191-466a-404f-bf52-c96b4d9c8c9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:58:04.768276 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb35191-466a-404f-bf52-c96b4d9c8c9b service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:58:04.768558 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb35191-466a-404f-bf52-c96b4d9c8c9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:58:04.768831 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb35191-466a-404f-bf52-c96b4d9c8c9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:58:04.778022 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb35191-466a-404f-bf52-c96b4d9c8c9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:58:04.779460 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb35191-466a-404f-bf52-c96b4d9c8c9b service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:58:04.789187 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 731/1467] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:58:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 03:58:06.907949 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981f85b-51cd-4287-bc63-bc36b1ad2c62 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:58:06.908473 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981f85b-51cd-4287-bc63-bc36b1ad2c62 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:58:06.908473 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981f85b-51cd-4287-bc63-bc36b1ad2c62 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:58:06.910114 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 03:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:58:06.915528 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6cea5-489a-4b86-94f7-eb7655890f95 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:58:06.915966 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6cea5-489a-4b86-94f7-eb7655890f95 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:58:06.916092 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6cea5-489a-4b86-94f7-eb7655890f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:58:06.934180 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-3af6cea5-489a-4b86-94f7-eb7655890f95 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:58:06.935385 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-3af6cea5-489a-4b86-94f7-eb7655890f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:58:06.943887 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 03:58:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 03:58:06.979746 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981f85b-51cd-4287-bc63-bc36b1ad2c62 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:58:06.991819 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981f85b-51cd-4287-bc63-bc36b1ad2c62 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:58:06.995621 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7b593-d3ed-4e73-a0a4-d120491db944 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:58:06.996271 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7b593-d3ed-4e73-a0a4-d120491db944 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:58:06.996552 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7b593-d3ed-4e73-a0a4-d120491db944 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:58:06.996830 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7b593-d3ed-4e73-a0a4-d120491db944 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:58:07.006847 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea7b593-d3ed-4e73-a0a4-d120491db944 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:58:07.008688 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea7b593-d3ed-4e73-a0a4-d120491db944 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:58:07.018277 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 738/1470] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:58:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 03:58:16.928995 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=17 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:58:17.014073 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=17 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:58:27.098942 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f27f84-87cc-4856-8769-32a8d8a906f1 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:58:27.099547 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f27f84-87cc-4856-8769-32a8d8a906f1 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:58:27.099547 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f27f84-87cc-4856-8769-32a8d8a906f1 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:58:27.100889 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 733/1471] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:58:27.106441 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf367a7-67cf-4d65-b882-1aedde397dae None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:58:27.106889 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf367a7-67cf-4d65-b882-1aedde397dae None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:58:27.106986 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf367a7-67cf-4d65-b882-1aedde397dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:58:27.125354 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-adf367a7-67cf-4d65-b882-1aedde397dae None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:58:27.126548 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-adf367a7-67cf-4d65-b882-1aedde397dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:58:27.134244 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 739/1472] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:58:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 03:58:27.181324 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38b88d-1962-4ca7-9d7d-29f14ad92e4b None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:58:27.181610 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38b88d-1962-4ca7-9d7d-29f14ad92e4b None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:58:27.181888 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38b88d-1962-4ca7-9d7d-29f14ad92e4b None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:58:27.183222 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 734/1473] 10.222.0.46 () {54 vars in 962 bytes} [Fri Jul 1 03:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:58:27.188671 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ec7dd-7f54-48fa-82b4-af5b7352c183 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:58:27.188956 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ec7dd-7f54-48fa-82b4-af5b7352c183 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:58:27.189236 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ec7dd-7f54-48fa-82b4-af5b7352c183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:58:27.206863 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-ab3ec7dd-7f54-48fa-82b4-af5b7352c183 None None] MFA Rules not processed for user `ff2e6387d102445d963de072c55833d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:58:27.208087 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ab3ec7dd-7f54-48fa-82b4-af5b7352c183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:58:27.214414 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 740/1474] 10.222.0.46 () {58 vars in 1059 bytes} [Fri Jul 1 03:58:27 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 03:58:27.222041 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38b88d-1962-4ca7-9d7d-29f14ad92e4b None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:58:27.232836 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38b88d-1962-4ca7-9d7d-29f14ad92e4b None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:58:27.237959 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d2367-0a1d-4a56-838a-149c067124ca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff2e6387d102445d963de072c55833d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:58:27.238594 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d2367-0a1d-4a56-838a-149c067124ca service glance] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:58:27.238869 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d2367-0a1d-4a56-838a-149c067124ca service glance] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:58:27.239140 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d2367-0a1d-4a56-838a-149c067124ca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:58:27.248373 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9d2367-0a1d-4a56-838a-149c067124ca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:58:27.250425 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9d2367-0a1d-4a56-838a-149c067124ca service glance] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:58:27.259950 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 735/1475] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:58:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 03:58:29.404495 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285ae04-38c2-47ec-9149-50aec6d3e815 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:58:29.405026 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285ae04-38c2-47ec-9149-50aec6d3e815 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:58:29.405026 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285ae04-38c2-47ec-9149-50aec6d3e815 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:58:29.406954 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 741/1476] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:58:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:58:29.412573 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccaafd-1237-46e0-8d1a-7deb70af12df None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:58:29.412992 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccaafd-1237-46e0-8d1a-7deb70af12df None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:58:29.413248 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccaafd-1237-46e0-8d1a-7deb70af12df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:58:29.431585 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-7fccaafd-1237-46e0-8d1a-7deb70af12df None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:58:29.433168 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-7fccaafd-1237-46e0-8d1a-7deb70af12df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:58:29.440831 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 736/1477] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:58:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 03:58:29.465431 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285ae04-38c2-47ec-9149-50aec6d3e815 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:58:29.478643 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285ae04-38c2-47ec-9149-50aec6d3e815 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:58:29.483115 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09930921-dd1b-497e-8c18-3cdd1ba66853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:58:29.483814 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09930921-dd1b-497e-8c18-3cdd1ba66853 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:58:29.484098 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09930921-dd1b-497e-8c18-3cdd1ba66853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:58:29.484375 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09930921-dd1b-497e-8c18-3cdd1ba66853 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:58:29.485113 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09930921-dd1b-497e-8c18-3cdd1ba66853 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:58:29.486912 dv-cinder-846842-8-smb devstack@keystone.service[80377]: WARNING py.warnings [None req-09930921-dd1b-497e-8c18-3cdd1ba66853 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 01 03:58:29.486912 dv-cinder-846842-8-smb devstack@keystone.service[80377]: warnings.warn(msg) Jul 01 03:58:29.486912 dv-cinder-846842-8-smb devstack@keystone.service[80377]: Jul 01 03:58:29.488117 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09930921-dd1b-497e-8c18-3cdd1ba66853 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:58:29.508306 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 742/1478] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Jul 1 03:58:29 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 03:58:31.587181 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd62cc-399e-4715-b01c-65856ef6d6a8 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:58:31.587766 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd62cc-399e-4715-b01c-65856ef6d6a8 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:58:31.587766 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd62cc-399e-4715-b01c-65856ef6d6a8 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:58:31.589161 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 737/1479] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:58:31.595543 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054de813-019d-4613-913a-d81845f6206d None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:58:31.595965 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054de813-019d-4613-913a-d81845f6206d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:58:31.596087 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054de813-019d-4613-913a-d81845f6206d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:58:31.613714 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-054de813-019d-4613-913a-d81845f6206d None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:58:31.614905 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-054de813-019d-4613-913a-d81845f6206d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:58:31.622635 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 743/1480] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 03:58:31.665785 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd62cc-399e-4715-b01c-65856ef6d6a8 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:58:31.680976 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd62cc-399e-4715-b01c-65856ef6d6a8 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:58:31.688045 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a715d7-be7d-4d82-8dff-178707221b12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:58:31.688184 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a715d7-be7d-4d82-8dff-178707221b12 service nova] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:58:31.688478 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a715d7-be7d-4d82-8dff-178707221b12 service nova] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:58:31.688754 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a715d7-be7d-4d82-8dff-178707221b12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:58:31.697590 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a715d7-be7d-4d82-8dff-178707221b12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:58:31.699174 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a715d7-be7d-4d82-8dff-178707221b12 service nova] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:58:31.708957 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 738/1481] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:58:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 03:58:33.921466 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa1d50-1f4d-44cd-9557-cad7bed87a7b None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:58:33.921999 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa1d50-1f4d-44cd-9557-cad7bed87a7b None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:58:33.921999 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa1d50-1f4d-44cd-9557-cad7bed87a7b None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:58:33.923323 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 744/1482] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:58:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:58:33.928801 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25519d-157f-4af8-8f2a-1fc7e756f7cb None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:58:33.929214 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25519d-157f-4af8-8f2a-1fc7e756f7cb None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:58:33.929357 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25519d-157f-4af8-8f2a-1fc7e756f7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:58:33.948229 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-6b25519d-157f-4af8-8f2a-1fc7e756f7cb None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:58:33.949461 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-6b25519d-157f-4af8-8f2a-1fc7e756f7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:58:33.957781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 739/1483] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:58:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 03:58:33.993994 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa1d50-1f4d-44cd-9557-cad7bed87a7b None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:58:34.004831 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa1d50-1f4d-44cd-9557-cad7bed87a7b None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:58:34.008333 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830c666-736b-4e6a-95cd-3255777b83b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:58:34.008972 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830c666-736b-4e6a-95cd-3255777b83b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:58:34.009251 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830c666-736b-4e6a-95cd-3255777b83b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:58:34.009523 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830c666-736b-4e6a-95cd-3255777b83b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:58:34.019011 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7830c666-736b-4e6a-95cd-3255777b83b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:58:34.020480 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7830c666-736b-4e6a-95cd-3255777b83b3 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:58:34.029906 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 745/1484] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:58:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 03:58:36.117482 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d79e22-119e-4e4f-90db-8abdf6f48282 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:58:36.118050 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d79e22-119e-4e4f-90db-8abdf6f48282 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:58:36.118050 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d79e22-119e-4e4f-90db-8abdf6f48282 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:58:36.119298 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 740/1485] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:58:36.125183 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de9ece-27b4-47e7-adc0-704345b7f4ab None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:58:36.125739 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de9ece-27b4-47e7-adc0-704345b7f4ab None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:58:36.125739 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de9ece-27b4-47e7-adc0-704345b7f4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:58:36.143550 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-19de9ece-27b4-47e7-adc0-704345b7f4ab None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:58:36.144755 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-19de9ece-27b4-47e7-adc0-704345b7f4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:58:36.152682 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 746/1486] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:58:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 03:58:36.193033 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d79e22-119e-4e4f-90db-8abdf6f48282 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:58:36.204089 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d79e22-119e-4e4f-90db-8abdf6f48282 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:58:36.207711 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753dbfdb-937e-4f1e-894a-05ef780ec03f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:58:36.209710 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753dbfdb-937e-4f1e-894a-05ef780ec03f service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:58:36.209710 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753dbfdb-937e-4f1e-894a-05ef780ec03f service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:58:36.209710 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753dbfdb-937e-4f1e-894a-05ef780ec03f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:58:36.218543 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753dbfdb-937e-4f1e-894a-05ef780ec03f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:58:36.220007 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753dbfdb-937e-4f1e-894a-05ef780ec03f service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:58:36.229835 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 741/1487] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:58:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 03:58:38.486092 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995faa5f-d945-4607-bca3-a872e0955002 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:58:38.486617 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995faa5f-d945-4607-bca3-a872e0955002 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:58:38.486617 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995faa5f-d945-4607-bca3-a872e0955002 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:58:38.488037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 747/1488] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:58:38.493548 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f631ba-8d5e-45b4-b610-2fde9a80a824 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:58:38.493968 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f631ba-8d5e-45b4-b610-2fde9a80a824 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:58:38.494109 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f631ba-8d5e-45b4-b610-2fde9a80a824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:58:38.511317 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-33f631ba-8d5e-45b4-b610-2fde9a80a824 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:58:38.512572 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-33f631ba-8d5e-45b4-b610-2fde9a80a824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:58:38.520982 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 742/1489] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:58:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 03:58:38.561151 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995faa5f-d945-4607-bca3-a872e0955002 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:58:38.571897 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995faa5f-d945-4607-bca3-a872e0955002 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:58:38.575429 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4256c2-862b-4145-80cf-009a9cb73857 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:58:38.576063 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4256c2-862b-4145-80cf-009a9cb73857 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:58:38.576339 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4256c2-862b-4145-80cf-009a9cb73857 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:58:38.576610 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4256c2-862b-4145-80cf-009a9cb73857 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:58:38.586081 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4256c2-862b-4145-80cf-009a9cb73857 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:58:38.587679 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4256c2-862b-4145-80cf-009a9cb73857 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:58:38.597876 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 748/1490] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:58:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 03:58:41.055258 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace987b2-07f4-41b6-b14f-cd814946e080 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:58:41.055874 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace987b2-07f4-41b6-b14f-cd814946e080 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:58:41.055874 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace987b2-07f4-41b6-b14f-cd814946e080 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:58:41.057193 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 743/1491] 10.222.0.46 () {54 vars in 926 bytes} [Fri Jul 1 03:58:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 03:58:41.063672 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e2834-6382-449a-b114-375aa9140c8a None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:58:41.064174 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e2834-6382-449a-b114-375aa9140c8a None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:58:41.064271 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e2834-6382-449a-b114-375aa9140c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:58:41.082418 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-429e2834-6382-449a-b114-375aa9140c8a None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 03:58:41.083658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-429e2834-6382-449a-b114-375aa9140c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 03:58:41.091796 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 749/1492] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Jul 1 03:58:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 03:58:41.132821 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace987b2-07f4-41b6-b14f-cd814946e080 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 03:58:41.148733 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace987b2-07f4-41b6-b14f-cd814946e080 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 03:58:41.152583 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426990f5-a295-48b1-88b9-eed0ee1a1e4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 03:58:41.153287 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426990f5-a295-48b1-88b9-eed0ee1a1e4f service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 03:58:41.153574 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426990f5-a295-48b1-88b9-eed0ee1a1e4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 03:58:41.153849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426990f5-a295-48b1-88b9-eed0ee1a1e4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 03:58:41.165472 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426990f5-a295-48b1-88b9-eed0ee1a1e4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 03:58:41.167076 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426990f5-a295-48b1-88b9-eed0ee1a1e4f service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 03:58:41.179278 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 744/1493] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 03:58:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 03:58:51.077221 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=33 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 03:58:51.174055 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=33 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:00:46.300055 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd5239-2235-4c18-8f57-fe567fbffa74 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:00:46.300682 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd5239-2235-4c18-8f57-fe567fbffa74 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:00:46.300682 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd5239-2235-4c18-8f57-fe567fbffa74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:00:46.318636 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-93dd5239-2235-4c18-8f57-fe567fbffa74 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:00:46.319874 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-93dd5239-2235-4c18-8f57-fe567fbffa74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:00:46.328201 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 750/1494] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:00:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:00:46.336305 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc18234-66b7-47ad-96f8-d0c43b42dabb None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:00:46.336793 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc18234-66b7-47ad-96f8-d0c43b42dabb None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:00:46.336887 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc18234-66b7-47ad-96f8-d0c43b42dabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:00:46.354671 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-8dc18234-66b7-47ad-96f8-d0c43b42dabb None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:00:46.355890 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-8dc18234-66b7-47ad-96f8-d0c43b42dabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:00:46.363590 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 745/1495] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:00:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:00:46.368321 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd5239-2235-4c18-8f57-fe567fbffa74 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:00:46.378725 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd5239-2235-4c18-8f57-fe567fbffa74 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:00:46.383266 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e9b01f-7faf-4243-9ba7-0088ef4e53c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:00:46.384042 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9b01f-7faf-4243-9ba7-0088ef4e53c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:00:46.384321 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9b01f-7faf-4243-9ba7-0088ef4e53c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:00:46.384607 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9b01f-7faf-4243-9ba7-0088ef4e53c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:00:46.385909 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e9b01f-7faf-4243-9ba7-0088ef4e53c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:00:46.386210 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e9b01f-7faf-4243-9ba7-0088ef4e53c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:00:46.387215 dv-cinder-846842-8-smb devstack@keystone.service[80377]: WARNING py.warnings [None req-16e9b01f-7faf-4243-9ba7-0088ef4e53c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 04:00:46.387215 dv-cinder-846842-8-smb devstack@keystone.service[80377]: warnings.warn(msg) Jul 01 04:00:46.387215 dv-cinder-846842-8-smb devstack@keystone.service[80377]: Jul 01 04:00:46.388130 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e9b01f-7faf-4243-9ba7-0088ef4e53c8 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:00:46.399952 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 751/1496] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:00:46.408461 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc18234-66b7-47ad-96f8-d0c43b42dabb None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:00:46.418038 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc18234-66b7-47ad-96f8-d0c43b42dabb None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:00:46.422582 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b0ebb-9103-47a7-9081-9ba384730df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:00:46.423224 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b0ebb-9103-47a7-9081-9ba384730df9 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:00:46.423535 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b0ebb-9103-47a7-9081-9ba384730df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:00:46.423815 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b0ebb-9103-47a7-9081-9ba384730df9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:00:46.424509 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b0ebb-9103-47a7-9081-9ba384730df9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:00:46.426278 dv-cinder-846842-8-smb devstack@keystone.service[80376]: WARNING py.warnings [None req-a33b0ebb-9103-47a7-9081-9ba384730df9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 01 04:00:46.426278 dv-cinder-846842-8-smb devstack@keystone.service[80376]: warnings.warn(msg) Jul 01 04:00:46.426278 dv-cinder-846842-8-smb devstack@keystone.service[80376]: Jul 01 04:00:46.427490 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b0ebb-9103-47a7-9081-9ba384730df9 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:00:46.544564 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 746/1497] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:00:46 2022] POST /identity/v3/projects => generated 379 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 04:00:46.548601 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e9b01f-7faf-4243-9ba7-0088ef4e53c8 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:00:46.559158 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e9b01f-7faf-4243-9ba7-0088ef4e53c8 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:00:46.613785 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc27e27-ceca-45bd-80ff-4ae9be0a726b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:00:46.614459 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc27e27-ceca-45bd-80ff-4ae9be0a726b admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:00:46.614738 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc27e27-ceca-45bd-80ff-4ae9be0a726b admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:00:46.615009 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc27e27-ceca-45bd-80ff-4ae9be0a726b admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:00:46.615718 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc27e27-ceca-45bd-80ff-4ae9be0a726b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:00:46.616730 dv-cinder-846842-8-smb devstack@keystone.service[80377]: WARNING py.warnings [None req-0fc27e27-ceca-45bd-80ff-4ae9be0a726b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 01 04:00:46.616730 dv-cinder-846842-8-smb devstack@keystone.service[80377]: warnings.warn(msg) Jul 01 04:00:46.616730 dv-cinder-846842-8-smb devstack@keystone.service[80377]: Jul 01 04:00:46.617940 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc27e27-ceca-45bd-80ff-4ae9be0a726b admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:00:46.692861 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 752/1498] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:00:46 2022] POST /identity/v3/users => generated 290 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 04:00:46.696969 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b0ebb-9103-47a7-9081-9ba384730df9 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:00:46.707322 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b0ebb-9103-47a7-9081-9ba384730df9 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:00:46.711839 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2375c2-2ffb-474d-8a4b-fd22e4878fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:00:46.712499 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2375c2-2ffb-474d-8a4b-fd22e4878fbb admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:00:46.717458 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2375c2-2ffb-474d-8a4b-fd22e4878fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:00:46.717458 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2375c2-2ffb-474d-8a4b-fd22e4878fbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:00:46.717458 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2375c2-2ffb-474d-8a4b-fd22e4878fbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:00:46.717458 dv-cinder-846842-8-smb devstack@keystone.service[80376]: WARNING py.warnings [None req-3f2375c2-2ffb-474d-8a4b-fd22e4878fbb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 04:00:46.717458 dv-cinder-846842-8-smb devstack@keystone.service[80376]: warnings.warn(msg) Jul 01 04:00:46.717458 dv-cinder-846842-8-smb devstack@keystone.service[80376]: Jul 01 04:00:46.717458 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2375c2-2ffb-474d-8a4b-fd22e4878fbb admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:00:46.728392 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 747/1499] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:00:46.733007 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc27e27-ceca-45bd-80ff-4ae9be0a726b admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:00:46.742944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc27e27-ceca-45bd-80ff-4ae9be0a726b admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:00:46.748107 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b4ee77-0219-438e-a1a8-7251f0447c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:00:46.748773 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4ee77-0219-438e-a1a8-7251f0447c40 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:00:46.749055 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4ee77-0219-438e-a1a8-7251f0447c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:00:46.749333 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4ee77-0219-438e-a1a8-7251f0447c40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:00:46.750081 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b4ee77-0219-438e-a1a8-7251f0447c40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:00:46.751091 dv-cinder-846842-8-smb devstack@keystone.service[80377]: WARNING py.warnings [None req-46b4ee77-0219-438e-a1a8-7251f0447c40 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 04:00:46.751091 dv-cinder-846842-8-smb devstack@keystone.service[80377]: warnings.warn(msg) Jul 01 04:00:46.751091 dv-cinder-846842-8-smb devstack@keystone.service[80377]: Jul 01 04:00:46.752029 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b4ee77-0219-438e-a1a8-7251f0447c40 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:00:46.765617 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 753/1500] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:00:46.769737 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2375c2-2ffb-474d-8a4b-fd22e4878fbb admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:00:46.779889 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2375c2-2ffb-474d-8a4b-fd22e4878fbb admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:00:46.784366 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0f333-7a4f-4d7c-896c-076bc0164e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:00:46.785245 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0f333-7a4f-4d7c-896c-076bc0164e48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:00:46.785528 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0f333-7a4f-4d7c-896c-076bc0164e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:00:46.785803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0f333-7a4f-4d7c-896c-076bc0164e48 admin admin] PATH_INFO: `/v3/projects/08997ef1b10749869950951cf7111feb/users/d56640b6368a44a29dc1177cd70a82e7/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:00:46.801298 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0f333-7a4f-4d7c-896c-076bc0164e48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08997ef1b10749869950951cf7111feb, user_id=d56640b6368a44a29dc1177cd70a82e7, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:00:46.802313 dv-cinder-846842-8-smb devstack@keystone.service[80376]: WARNING py.warnings [None req-89d0f333-7a4f-4d7c-896c-076bc0164e48 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 01 04:00:46.802313 dv-cinder-846842-8-smb devstack@keystone.service[80376]: warnings.warn(msg) Jul 01 04:00:46.802313 dv-cinder-846842-8-smb devstack@keystone.service[80376]: Jul 01 04:00:46.804287 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0f333-7a4f-4d7c-896c-076bc0164e48 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:00:46.873778 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 748/1501] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:00:46 2022] PUT /identity/v3/projects/08997ef1b10749869950951cf7111feb/users/d56640b6368a44a29dc1177cd70a82e7/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:00:46.885836 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0445b-0eb6-4628-a962-37da25bb44ec None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:00:46.886125 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0445b-0eb6-4628-a962-37da25bb44ec None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:00:46.886404 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0445b-0eb6-4628-a962-37da25bb44ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:00:46.913482 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-f8e0445b-0eb6-4628-a962-37da25bb44ec None None] MFA Rules not processed for user `d56640b6368a44a29dc1177cd70a82e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:00:46.914690 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f8e0445b-0eb6-4628-a962-37da25bb44ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:00:46.979805 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 754/1502] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:00:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:00:46.994027 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3f3b9-157c-4108-9e23-87c0f0a2268d None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:00:46.994326 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3f3b9-157c-4108-9e23-87c0f0a2268d None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:00:46.994609 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3f3b9-157c-4108-9e23-87c0f0a2268d None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:00:46.996025 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 749/1503] 10.222.0.46 () {54 vars in 963 bytes} [Fri Jul 1 04:00:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 04:00:47.001076 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379382c-1240-46fd-b492-52a7a930f7c3 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:00:47.003931 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379382c-1240-46fd-b492-52a7a930f7c3 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:00:47.003931 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379382c-1240-46fd-b492-52a7a930f7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:00:47.019423 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-2379382c-1240-46fd-b492-52a7a930f7c3 None None] MFA Rules not processed for user `418106a8c3104dcfa40fcc6c68356294`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:00:47.020776 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2379382c-1240-46fd-b492-52a7a930f7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:00:47.066348 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:00:47.073858 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 755/1504] 10.222.0.46 () {58 vars in 1060 bytes} [Fri Jul 1 04:00:46 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:00:47.081863 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3f3b9-157c-4108-9e23-87c0f0a2268d None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:00:47.093239 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3f3b9-157c-4108-9e23-87c0f0a2268d None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:00:47.096861 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f15081-251d-440c-b566-4cff63560024 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:00:47.097496 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f15081-251d-440c-b566-4cff63560024 service cinder] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:00:47.097781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f15081-251d-440c-b566-4cff63560024 service cinder] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:00:47.098059 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f15081-251d-440c-b566-4cff63560024 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:00:47.107101 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f15081-251d-440c-b566-4cff63560024 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:00:47.108608 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f15081-251d-440c-b566-4cff63560024 service cinder] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:00:47.117693 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 750/1505] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:00:47 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:00:47.160833 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90898c3-d488-438b-8b7c-41162306cf5f None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:00:47.161119 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90898c3-d488-438b-8b7c-41162306cf5f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:00:47.161395 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90898c3-d488-438b-8b7c-41162306cf5f None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:00:47.162673 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 756/1506] 10.222.0.46 () {52 vars in 829 bytes} [Fri Jul 1 04:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 04:00:47.166753 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f15081-251d-440c-b566-4cff63560024 service cinder] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:00:47.230020 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f15081-251d-440c-b566-4cff63560024 service cinder] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:00:47.234551 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee7d4a-8ed0-479e-9824-36a9c1b4c8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:00:47.235427 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee7d4a-8ed0-479e-9824-36a9c1b4c8a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:00:47.235767 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee7d4a-8ed0-479e-9824-36a9c1b4c8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:00:47.236046 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee7d4a-8ed0-479e-9824-36a9c1b4c8a7 admin admin] PATH_INFO: `/v3/users/d56640b6368a44a29dc1177cd70a82e7` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:00:47.237232 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee7d4a-8ed0-479e-9824-36a9c1b4c8a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d56640b6368a44a29dc1177cd70a82e7)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:00:47.238240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: WARNING py.warnings [None req-29ee7d4a-8ed0-479e-9824-36a9c1b4c8a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 01 04:00:47.238240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: warnings.warn(msg) Jul 01 04:00:47.238240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: Jul 01 04:00:47.239473 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee7d4a-8ed0-479e-9824-36a9c1b4c8a7 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:00:47.464276 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-29ee7d4a-8ed0-479e-9824-36a9c1b4c8a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd56640b6368a44a29dc1177cd70a82e7'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:00:47.464913 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-29ee7d4a-8ed0-479e-9824-36a9c1b4c8a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd56640b6368a44a29dc1177cd70a82e7'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:00:47.521648 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-29ee7d4a-8ed0-479e-9824-36a9c1b4c8a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd56640b6368a44a29dc1177cd70a82e7'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:00:47.522430 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-29ee7d4a-8ed0-479e-9824-36a9c1b4c8a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd56640b6368a44a29dc1177cd70a82e7'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:00:47.536073 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-29ee7d4a-8ed0-479e-9824-36a9c1b4c8a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd56640b6368a44a29dc1177cd70a82e7'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:00:47.552730 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:00:47.561423 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 751/1507] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:00:47 2022] DELETE /identity/v3/users/d56640b6368a44a29dc1177cd70a82e7 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:00:47.565984 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f22ab4-3624-4565-8e11-b6869848f620 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:00:47.566500 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f22ab4-3624-4565-8e11-b6869848f620 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:00:47.566592 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f22ab4-3624-4565-8e11-b6869848f620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:00:47.584103 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-07f22ab4-3624-4565-8e11-b6869848f620 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:00:47.585321 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-07f22ab4-3624-4565-8e11-b6869848f620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:00:47.649610 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 757/1508] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:00:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:00:47.664263 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee7d4a-8ed0-479e-9824-36a9c1b4c8a7 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:00:47.665689 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-29ee7d4a-8ed0-479e-9824-36a9c1b4c8a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:00:47.724476 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee7d4a-8ed0-479e-9824-36a9c1b4c8a7 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:00:47.727966 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6b5d4-3acb-46f6-8823-5969b50d3010 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:00:47.729243 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6b5d4-3acb-46f6-8823-5969b50d3010 service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:00:47.729522 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6b5d4-3acb-46f6-8823-5969b50d3010 service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:00:47.729793 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6b5d4-3acb-46f6-8823-5969b50d3010 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:00:47.739663 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6b5d4-3acb-46f6-8823-5969b50d3010 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:00:47.741091 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6b5d4-3acb-46f6-8823-5969b50d3010 service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:00:47.750513 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 752/1509] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:00:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:00:48.265262 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f22ab4-3624-4565-8e11-b6869848f620 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:00:48.266645 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-07f22ab4-3624-4565-8e11-b6869848f620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:00:48.279627 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f22ab4-3624-4565-8e11-b6869848f620 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:00:48.284529 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fca723-59aa-4280-806b-04d518b77602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:00:48.285447 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fca723-59aa-4280-806b-04d518b77602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:00:48.285734 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fca723-59aa-4280-806b-04d518b77602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:00:48.286013 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fca723-59aa-4280-806b-04d518b77602 admin admin] PATH_INFO: `/v3/projects/08997ef1b10749869950951cf7111feb` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:00:48.287197 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fca723-59aa-4280-806b-04d518b77602 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08997ef1b10749869950951cf7111feb)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:00:48.288261 dv-cinder-846842-8-smb devstack@keystone.service[80377]: WARNING py.warnings [None req-78fca723-59aa-4280-806b-04d518b77602 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 01 04:00:48.288261 dv-cinder-846842-8-smb devstack@keystone.service[80377]: warnings.warn(msg) Jul 01 04:00:48.288261 dv-cinder-846842-8-smb devstack@keystone.service[80377]: Jul 01 04:00:48.289519 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fca723-59aa-4280-806b-04d518b77602 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:00:48.441318 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-78fca723-59aa-4280-806b-04d518b77602 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08997ef1b10749869950951cf7111feb', 'request_id': 'req-78fca723-59aa-4280-806b-04d518b77602'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:00:48.526855 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-78fca723-59aa-4280-806b-04d518b77602 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08997ef1b10749869950951cf7111feb', 'request_id': 'req-78fca723-59aa-4280-806b-04d518b77602'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:00:48.534040 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-78fca723-59aa-4280-806b-04d518b77602 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08997ef1b10749869950951cf7111feb', 'request_id': 'req-78fca723-59aa-4280-806b-04d518b77602'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:00:48.552855 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-78fca723-59aa-4280-806b-04d518b77602 admin admin] The token cache is being invalidate because project 08997ef1b10749869950951cf7111feb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:00:48.553138 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-78fca723-59aa-4280-806b-04d518b77602 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:00:48.553822 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-78fca723-59aa-4280-806b-04d518b77602 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:00:48.555479 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 758/1510] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:00:48 2022] DELETE /identity/v3/projects/08997ef1b10749869950951cf7111feb => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:00:57.746391 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:00:58.549781 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:02:34.856940 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07831416-1a1e-4c44-ae76-069b77023592 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:02:34.857494 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07831416-1a1e-4c44-ae76-069b77023592 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:02:34.857494 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07831416-1a1e-4c44-ae76-069b77023592 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:02:34.858799 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 753/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 1 04:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 04:02:34.864293 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010cdd2-a79e-4f39-80a5-3e5298b580b2 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:02:34.864775 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010cdd2-a79e-4f39-80a5-3e5298b580b2 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:02:34.864921 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010cdd2-a79e-4f39-80a5-3e5298b580b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:02:34.882956 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-1010cdd2-a79e-4f39-80a5-3e5298b580b2 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:02:34.884207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1010cdd2-a79e-4f39-80a5-3e5298b580b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:02:34.944133 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 759/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 1 04:02:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:02:35.098490 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07831416-1a1e-4c44-ae76-069b77023592 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:02:35.100207 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-07831416-1a1e-4c44-ae76-069b77023592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:02:35.177083 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07831416-1a1e-4c44-ae76-069b77023592 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:02:35.182840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2195e-d796-4145-8cd8-875e55b5774d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:02:35.183516 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2195e-d796-4145-8cd8-875e55b5774d service nova] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:02:35.183802 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2195e-d796-4145-8cd8-875e55b5774d service nova] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:02:35.184078 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2195e-d796-4145-8cd8-875e55b5774d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:02:35.192484 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f2195e-d796-4145-8cd8-875e55b5774d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:02:35.194065 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f2195e-d796-4145-8cd8-875e55b5774d service nova] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:02:35.205340 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 754/1513] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:02:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:02:36.038153 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2606f-7ee1-42c9-b6dd-ec7b880e034a None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:02:36.038701 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2606f-7ee1-42c9-b6dd-ec7b880e034a None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:02:36.038812 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2606f-7ee1-42c9-b6dd-ec7b880e034a None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:02:36.040153 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 760/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 1 04:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 04:02:36.045580 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc5d02-883c-4cd4-91b5-7c0ad5c6d04e None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:02:36.045979 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc5d02-883c-4cd4-91b5-7c0ad5c6d04e None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:02:36.046130 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc5d02-883c-4cd4-91b5-7c0ad5c6d04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:02:36.063727 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-cdfc5d02-883c-4cd4-91b5-7c0ad5c6d04e None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:02:36.064968 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-cdfc5d02-883c-4cd4-91b5-7c0ad5c6d04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:02:36.072560 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 755/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 1 04:02:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:02:36.223478 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2606f-7ee1-42c9-b6dd-ec7b880e034a None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:02:36.237590 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2606f-7ee1-42c9-b6dd-ec7b880e034a None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:02:36.242859 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710cd85f-9fad-4cba-a223-72fae618ba2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:02:36.243517 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710cd85f-9fad-4cba-a223-72fae618ba2b service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:02:36.243802 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710cd85f-9fad-4cba-a223-72fae618ba2b service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:02:36.244097 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710cd85f-9fad-4cba-a223-72fae618ba2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:02:36.252269 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710cd85f-9fad-4cba-a223-72fae618ba2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:02:36.253867 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710cd85f-9fad-4cba-a223-72fae618ba2b service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:02:36.263755 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 761/1516] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:02:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:02:36.923220 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbee2b9-860d-40f3-8f6c-139f889399e3 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:02:36.923537 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbee2b9-860d-40f3-8f6c-139f889399e3 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:02:36.923817 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbee2b9-860d-40f3-8f6c-139f889399e3 None None] PATH_INFO: `/v3` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:02:36.925120 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 756/1517] 10.222.0.13 () {54 vars in 925 bytes} [Fri Jul 1 04:02:36 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:02:36.932156 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1050263-1fa1-4893-9bcc-778ff7341774 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:02:36.932446 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1050263-1fa1-4893-9bcc-778ff7341774 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:02:36.932722 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1050263-1fa1-4893-9bcc-778ff7341774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:02:36.950213 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-f1050263-1fa1-4893-9bcc-778ff7341774 None None] MFA Rules not processed for user `4efe4a6dd11047688892641a936e2914`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:02:36.951419 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f1050263-1fa1-4893-9bcc-778ff7341774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:02:37.013936 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 762/1518] 10.222.0.13 () {58 vars in 1015 bytes} [Fri Jul 1 04:02:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:02:41.202103 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf7d03-6464-4b8d-a7b5-e66951f8e094 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:02:41.202622 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf7d03-6464-4b8d-a7b5-e66951f8e094 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:02:41.202622 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf7d03-6464-4b8d-a7b5-e66951f8e094 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:02:41.203960 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 757/1519] 10.222.0.46 () {54 vars in 960 bytes} [Fri Jul 1 04:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 04:02:41.208994 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f28dbe-8317-4b5a-a518-72cbdc9edc9a None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:02:41.209398 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f28dbe-8317-4b5a-a518-72cbdc9edc9a None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:02:41.209620 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f28dbe-8317-4b5a-a518-72cbdc9edc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:02:41.228435 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-d3f28dbe-8317-4b5a-a518-72cbdc9edc9a None None] MFA Rules not processed for user `4efe4a6dd11047688892641a936e2914`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:02:41.230213 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d3f28dbe-8317-4b5a-a518-72cbdc9edc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:02:41.238845 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 763/1520] 10.222.0.46 () {58 vars in 1057 bytes} [Fri Jul 1 04:02:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:02:41.246813 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf7d03-6464-4b8d-a7b5-e66951f8e094 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:02:41.260246 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf7d03-6464-4b8d-a7b5-e66951f8e094 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:02:41.265484 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38087fae-e7dc-4db0-84e2-d14678f85b56 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efe4a6dd11047688892641a936e2914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:02:41.266135 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38087fae-e7dc-4db0-84e2-d14678f85b56 service placement] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:02:41.266418 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38087fae-e7dc-4db0-84e2-d14678f85b56 service placement] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:02:41.266697 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38087fae-e7dc-4db0-84e2-d14678f85b56 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:02:41.275479 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38087fae-e7dc-4db0-84e2-d14678f85b56 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:02:41.277597 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38087fae-e7dc-4db0-84e2-d14678f85b56 service placement] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:02:41.287323 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 758/1521] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:02:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:02:47.497387 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc7c1b-79b1-4ac9-a85d-5844fe1d0159 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:02:47.498343 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc7c1b-79b1-4ac9-a85d-5844fe1d0159 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:02:47.498631 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc7c1b-79b1-4ac9-a85d-5844fe1d0159 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:02:47.500182 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 764/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 1 04:02:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 04:02:47.505330 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a06cc-23da-4509-bf21-2b339fe1bdf8 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:02:47.505815 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a06cc-23da-4509-bf21-2b339fe1bdf8 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:02:47.505929 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a06cc-23da-4509-bf21-2b339fe1bdf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:02:47.525144 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-c75a06cc-23da-4509-bf21-2b339fe1bdf8 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:02:47.526909 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-c75a06cc-23da-4509-bf21-2b339fe1bdf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:02:47.534842 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 759/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 1 04:02:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:02:47.691570 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc7c1b-79b1-4ac9-a85d-5844fe1d0159 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:02:47.707350 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc7c1b-79b1-4ac9-a85d-5844fe1d0159 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:02:47.712797 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767ace1-df4f-4c73-bcce-718481cea3ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:02:47.714067 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767ace1-df4f-4c73-bcce-718481cea3ce service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:02:47.714347 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767ace1-df4f-4c73-bcce-718481cea3ce service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:02:47.714617 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767ace1-df4f-4c73-bcce-718481cea3ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:02:47.723470 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d767ace1-df4f-4c73-bcce-718481cea3ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:02:47.725092 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d767ace1-df4f-4c73-bcce-718481cea3ce service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:02:47.735593 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 765/1524] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:02:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:02:48.570389 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc11fca-8654-4e0a-b7cd-4c18e79b0588 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:02:48.570924 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc11fca-8654-4e0a-b7cd-4c18e79b0588 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:02:48.571028 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc11fca-8654-4e0a-b7cd-4c18e79b0588 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:02:48.572409 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 760/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 1 04:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 04:02:48.577243 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7de41-eb3a-4214-9084-285f64750189 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:02:48.577674 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7de41-eb3a-4214-9084-285f64750189 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:02:48.577784 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7de41-eb3a-4214-9084-285f64750189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:02:48.595800 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-edd7de41-eb3a-4214-9084-285f64750189 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:02:48.596977 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-edd7de41-eb3a-4214-9084-285f64750189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:02:48.605320 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 766/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 1 04:02:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:02:48.756857 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc11fca-8654-4e0a-b7cd-4c18e79b0588 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:02:48.770856 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc11fca-8654-4e0a-b7cd-4c18e79b0588 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:02:48.777016 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229651f-5c88-4dc3-a95a-4105984bb912 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:02:48.777646 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229651f-5c88-4dc3-a95a-4105984bb912 service nova] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:02:48.777926 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229651f-5c88-4dc3-a95a-4105984bb912 service nova] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:02:48.778197 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229651f-5c88-4dc3-a95a-4105984bb912 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:02:48.786723 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3229651f-5c88-4dc3-a95a-4105984bb912 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:02:48.788330 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3229651f-5c88-4dc3-a95a-4105984bb912 service nova] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:02:48.798125 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 761/1527] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:02:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:02:52.850347 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c3d73-1768-4d17-ab65-0142af88b406 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:02:52.850924 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c3d73-1768-4d17-ab65-0142af88b406 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:02:52.850924 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c3d73-1768-4d17-ab65-0142af88b406 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:02:52.852228 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 767/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 04:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 04:02:52.858128 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b61fad-526a-42be-9c71-5f65db6217d7 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:02:52.858575 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b61fad-526a-42be-9c71-5f65db6217d7 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:02:52.858684 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b61fad-526a-42be-9c71-5f65db6217d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:02:52.877462 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-64b61fad-526a-42be-9c71-5f65db6217d7 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:02:52.878638 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-64b61fad-526a-42be-9c71-5f65db6217d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:02:52.886282 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 762/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 04:02:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:02:52.923367 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c3d73-1768-4d17-ab65-0142af88b406 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:02:52.925059 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2d7c3d73-1768-4d17-ab65-0142af88b406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:02:52.983683 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c3d73-1768-4d17-ab65-0142af88b406 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:02:52.987203 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2ee0d-1d46-4cac-91b7-7d5c41317c3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:02:52.987883 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2ee0d-1d46-4cac-91b7-7d5c41317c3c service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:02:52.988172 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2ee0d-1d46-4cac-91b7-7d5c41317c3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:02:52.988454 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2ee0d-1d46-4cac-91b7-7d5c41317c3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:02:52.997567 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b2ee0d-1d46-4cac-91b7-7d5c41317c3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:02:53.004838 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b2ee0d-1d46-4cac-91b7-7d5c41317c3c service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:02:53.009975 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:02:53.014821 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 768/1530] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:02:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:02:55.076197 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1b52f-49f7-4239-b353-6ca232cc0a44 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:02:55.076754 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1b52f-49f7-4239-b353-6ca232cc0a44 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:02:55.076754 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1b52f-49f7-4239-b353-6ca232cc0a44 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:02:55.078176 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 763/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 04:02:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 04:02:55.083422 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92232d8f-4497-47af-9ed5-2e74188d19c6 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:02:55.084015 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92232d8f-4497-47af-9ed5-2e74188d19c6 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:02:55.084153 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92232d8f-4497-47af-9ed5-2e74188d19c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:02:55.101907 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-92232d8f-4497-47af-9ed5-2e74188d19c6 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:02:55.103653 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-92232d8f-4497-47af-9ed5-2e74188d19c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:02:55.113316 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 769/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 04:02:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:02:55.148881 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b1b52f-49f7-4239-b353-6ca232cc0a44 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:02:55.160107 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b1b52f-49f7-4239-b353-6ca232cc0a44 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:02:55.163722 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a5e023-e14c-4a84-94d2-690d0f0856e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:02:55.164354 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5e023-e14c-4a84-94d2-690d0f0856e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:02:55.164633 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5e023-e14c-4a84-94d2-690d0f0856e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:02:55.164905 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5e023-e14c-4a84-94d2-690d0f0856e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:02:55.174433 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a5e023-e14c-4a84-94d2-690d0f0856e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:02:55.175893 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a5e023-e14c-4a84-94d2-690d0f0856e2 service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:02:55.185665 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 764/1533] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:02:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:02:58.745923 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00567363-0e75-4bd1-8f63-e9edfdb507af None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:02:58.746477 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00567363-0e75-4bd1-8f63-e9edfdb507af None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:02:58.746477 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00567363-0e75-4bd1-8f63-e9edfdb507af None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:02:58.747895 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 770/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 04:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 04:02:58.752923 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01d55c-269b-4d8c-915f-456bf9280c1e None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:02:58.753392 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01d55c-269b-4d8c-915f-456bf9280c1e None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:02:58.753528 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01d55c-269b-4d8c-915f-456bf9280c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:02:58.760272 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=62 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:02:58.779873 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-6f01d55c-269b-4d8c-915f-456bf9280c1e None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:02:58.779873 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-6f01d55c-269b-4d8c-915f-456bf9280c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:02:58.781943 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 765/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 04:02:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:02:59.084540 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00567363-0e75-4bd1-8f63-e9edfdb507af None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:02:59.086401 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-00567363-0e75-4bd1-8f63-e9edfdb507af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:02:59.146755 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00567363-0e75-4bd1-8f63-e9edfdb507af None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:02:59.150545 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075979f-9f0d-41b5-8389-16cbd2f9a838 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:02:59.151227 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075979f-9f0d-41b5-8389-16cbd2f9a838 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:02:59.151714 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075979f-9f0d-41b5-8389-16cbd2f9a838 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:02:59.152021 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075979f-9f0d-41b5-8389-16cbd2f9a838 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:02:59.161277 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6075979f-9f0d-41b5-8389-16cbd2f9a838 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:02:59.162831 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6075979f-9f0d-41b5-8389-16cbd2f9a838 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:02:59.172923 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 771/1536] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:02:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:03:01.257913 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99467979-747f-41ba-8378-91305c04b982 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:03:01.258476 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99467979-747f-41ba-8378-91305c04b982 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:03:01.258476 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99467979-747f-41ba-8378-91305c04b982 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:03:01.259921 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 766/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 04:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 04:03:01.265411 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe40969-7a64-49fc-84b6-617482a08f27 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:03:01.265892 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe40969-7a64-49fc-84b6-617482a08f27 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:03:01.265999 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe40969-7a64-49fc-84b6-617482a08f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:03:01.286159 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-ffe40969-7a64-49fc-84b6-617482a08f27 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:03:01.287385 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ffe40969-7a64-49fc-84b6-617482a08f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:03:01.295798 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 772/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 04:03:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:03:01.596421 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99467979-747f-41ba-8378-91305c04b982 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:03:01.598125 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-99467979-747f-41ba-8378-91305c04b982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:03:01.611134 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99467979-747f-41ba-8378-91305c04b982 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:03:01.614695 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6fadfb-6697-4a6d-aee4-1a68ff0e3235 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:03:01.615723 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6fadfb-6697-4a6d-aee4-1a68ff0e3235 service cinder] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:03:01.616027 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6fadfb-6697-4a6d-aee4-1a68ff0e3235 service cinder] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:03:01.616357 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6fadfb-6697-4a6d-aee4-1a68ff0e3235 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:03:01.625214 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6fadfb-6697-4a6d-aee4-1a68ff0e3235 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:03:01.626696 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6fadfb-6697-4a6d-aee4-1a68ff0e3235 service cinder] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:03:01.636511 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 767/1539] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:03:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:03:11.279062 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=32 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:03:11.631880 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=8 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:04:38.729663 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64638984-e9ba-4d11-ae84-9ec0e995d55c None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:38.730440 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64638984-e9ba-4d11-ae84-9ec0e995d55c None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:38.730935 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64638984-e9ba-4d11-ae84-9ec0e995d55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:38.783338 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-64638984-e9ba-4d11-ae84-9ec0e995d55c None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:04:38.785602 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-64638984-e9ba-4d11-ae84-9ec0e995d55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:04:38.810429 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 773/1540] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:04:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:04:38.821041 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74690ba-0921-460b-8cd2-4719bff433be None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:38.821790 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74690ba-0921-460b-8cd2-4719bff433be None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:38.821979 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74690ba-0921-460b-8cd2-4719bff433be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:38.855379 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-c74690ba-0921-460b-8cd2-4719bff433be None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:04:38.856768 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-c74690ba-0921-460b-8cd2-4719bff433be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:04:38.870474 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 768/1541] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:04:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:04:38.876401 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64638984-e9ba-4d11-ae84-9ec0e995d55c None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:38.908584 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64638984-e9ba-4d11-ae84-9ec0e995d55c None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:38.923315 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaccc29c-ba12-46c4-a376-544e118f4cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:38.924618 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccc29c-ba12-46c4-a376-544e118f4cec admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:38.925130 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccc29c-ba12-46c4-a376-544e118f4cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:38.925709 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccc29c-ba12-46c4-a376-544e118f4cec admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:38.927493 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaccc29c-ba12-46c4-a376-544e118f4cec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:04:38.928049 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaccc29c-ba12-46c4-a376-544e118f4cec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:38.931497 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaccc29c-ba12-46c4-a376-544e118f4cec admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:38.969169 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 774/1542] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:04:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:04:38.978082 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74690ba-0921-460b-8cd2-4719bff433be None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:38.994570 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74690ba-0921-460b-8cd2-4719bff433be None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:39.005513 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce2d3d-00bf-4c3e-97e5-bd00d4cb0994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:39.006334 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce2d3d-00bf-4c3e-97e5-bd00d4cb0994 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:39.006620 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce2d3d-00bf-4c3e-97e5-bd00d4cb0994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:39.006896 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce2d3d-00bf-4c3e-97e5-bd00d4cb0994 admin admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:39.007661 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fce2d3d-00bf-4c3e-97e5-bd00d4cb0994 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:39.008812 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cd81c-cde3-4e9a-aaf7-18401d52968b None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:39.009318 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cd81c-cde3-4e9a-aaf7-18401d52968b None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:39.009832 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cd81c-cde3-4e9a-aaf7-18401d52968b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:39.010004 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fce2d3d-00bf-4c3e-97e5-bd00d4cb0994 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:39.097847 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-446cd81c-cde3-4e9a-aaf7-18401d52968b None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:04:39.100112 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-446cd81c-cde3-4e9a-aaf7-18401d52968b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:04:39.130329 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 775/1543] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:04:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 04:04:39.132885 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137a9ef-c5a7-4ce1-96c3-a8ca14ed3e99 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:39.137001 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137a9ef-c5a7-4ce1-96c3-a8ca14ed3e99 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:39.137001 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137a9ef-c5a7-4ce1-96c3-a8ca14ed3e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:39.183976 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 769/1544] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:04:38 2022] POST /identity/v3/projects => generated 375 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:04:39.185232 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f9385-51da-4cf4-84bb-f29bbd035070 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:39.185530 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f9385-51da-4cf4-84bb-f29bbd035070 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:39.185825 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f9385-51da-4cf4-84bb-f29bbd035070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:39.193733 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-9137a9ef-c5a7-4ce1-96c3-a8ca14ed3e99 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:04:39.196456 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9137a9ef-c5a7-4ce1-96c3-a8ca14ed3e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:04:39.229848 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-ee1f9385-51da-4cf4-84bb-f29bbd035070 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:04:39.237299 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-ee1f9385-51da-4cf4-84bb-f29bbd035070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:04:39.347193 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 770/1545] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:04:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:04:39.348531 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 776/1546] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:04:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:04:39.350974 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f9385-51da-4cf4-84bb-f29bbd035070 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:39.351894 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b1b30-37a5-46bc-a19f-31e6aa72a87e None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:39.352199 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b1b30-37a5-46bc-a19f-31e6aa72a87e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:39.352479 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b1b30-37a5-46bc-a19f-31e6aa72a87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:39.375921 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f9385-51da-4cf4-84bb-f29bbd035070 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:39.389442 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ec852-7218-4c88-be95-86db10730852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:39.390205 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ec852-7218-4c88-be95-86db10730852 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:39.390489 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ec852-7218-4c88-be95-86db10730852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:39.394217 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ec852-7218-4c88-be95-86db10730852 admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:39.395630 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ec852-7218-4c88-be95-86db10730852 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:39.397713 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-879b1b30-37a5-46bc-a19f-31e6aa72a87e None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:04:39.399195 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-879b1b30-37a5-46bc-a19f-31e6aa72a87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:04:39.401520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: WARNING py.warnings [None req-c78ec852-7218-4c88-be95-86db10730852 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 01 04:04:39.401520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: warnings.warn(msg) Jul 01 04:04:39.401520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: Jul 01 04:04:39.403287 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ec852-7218-4c88-be95-86db10730852 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:39.421028 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 777/1547] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:04:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:04:39.422595 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc66d6-fe5e-4154-8588-3aed40b3ce1e None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:39.424496 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc66d6-fe5e-4154-8588-3aed40b3ce1e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:39.424681 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc66d6-fe5e-4154-8588-3aed40b3ce1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:39.451251 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-1fbc66d6-fe5e-4154-8588-3aed40b3ce1e None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:04:39.452781 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1fbc66d6-fe5e-4154-8588-3aed40b3ce1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:04:39.462505 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 778/1548] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:04:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:04:39.464184 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc66d6-fe5e-4154-8588-3aed40b3ce1e None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:39.480738 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc66d6-fe5e-4154-8588-3aed40b3ce1e None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:39.486402 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5a2be-5615-4ffb-9f83-45be0bddb0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:39.487249 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5a2be-5615-4ffb-9f83-45be0bddb0ad admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:39.487567 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5a2be-5615-4ffb-9f83-45be0bddb0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:39.487855 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5a2be-5615-4ffb-9f83-45be0bddb0ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:39.495503 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf5a2be-5615-4ffb-9f83-45be0bddb0ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:04:39.495503 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf5a2be-5615-4ffb-9f83-45be0bddb0ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:39.495503 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf5a2be-5615-4ffb-9f83-45be0bddb0ad admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:39.506839 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 771/1549] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:04:39 2022] POST /identity/v3/users => generated 288 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:04:39.508336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b0ad3-1233-405b-be85-e6cf9bfdb315 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:39.508628 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b0ad3-1233-405b-be85-e6cf9bfdb315 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:39.508912 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b0ad3-1233-405b-be85-e6cf9bfdb315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:39.534267 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 779/1550] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:04:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:04:39.538635 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1736b-02de-4b10-b033-ddf998caee1b None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:39.538963 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1736b-02de-4b10-b033-ddf998caee1b None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:39.539191 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1736b-02de-4b10-b033-ddf998caee1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:39.559224 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-c73b0ad3-1233-405b-be85-e6cf9bfdb315 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:04:39.565011 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-c73b0ad3-1233-405b-be85-e6cf9bfdb315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:04:39.586674 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 772/1551] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:04:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:04:39.588675 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056c9dc-813b-47ad-9ca1-c5925f83d3a9 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:39.589039 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056c9dc-813b-47ad-9ca1-c5925f83d3a9 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:39.589402 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056c9dc-813b-47ad-9ca1-c5925f83d3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:39.591437 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-c2b1736b-02de-4b10-b033-ddf998caee1b None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:04:39.592936 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c2b1736b-02de-4b10-b033-ddf998caee1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:04:39.606197 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 780/1552] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:04:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:04:39.607139 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1736b-02de-4b10-b033-ddf998caee1b None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:39.623697 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1736b-02de-4b10-b033-ddf998caee1b None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:39.626361 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-a056c9dc-813b-47ad-9ca1-c5925f83d3a9 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:04:39.628238 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-a056c9dc-813b-47ad-9ca1-c5925f83d3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:04:39.630237 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1625167-bb40-4fc0-8ba8-1f90cc8e76cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:39.631203 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1625167-bb40-4fc0-8ba8-1f90cc8e76cf admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:39.631847 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1625167-bb40-4fc0-8ba8-1f90cc8e76cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:39.632347 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1625167-bb40-4fc0-8ba8-1f90cc8e76cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:39.633526 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1625167-bb40-4fc0-8ba8-1f90cc8e76cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:39.637015 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1625167-bb40-4fc0-8ba8-1f90cc8e76cf admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:39.637489 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 773/1553] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:04:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:04:39.638325 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a056c9dc-813b-47ad-9ca1-c5925f83d3a9 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:39.649282 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a056c9dc-813b-47ad-9ca1-c5925f83d3a9 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:39.652767 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 781/1554] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:04:39 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:04:39.654016 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1625167-bb40-4fc0-8ba8-1f90cc8e76cf admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:39.655422 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9361b-3f8b-44a3-a3e7-eb94293a0e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:39.656424 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9361b-3f8b-44a3-a3e7-eb94293a0e9d admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:39.657069 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9361b-3f8b-44a3-a3e7-eb94293a0e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:39.657649 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9361b-3f8b-44a3-a3e7-eb94293a0e9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:39.658606 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9361b-3f8b-44a3-a3e7-eb94293a0e9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:39.660695 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9361b-3f8b-44a3-a3e7-eb94293a0e9d admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:39.666051 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1625167-bb40-4fc0-8ba8-1f90cc8e76cf admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:39.672607 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05090152-858f-4c1e-b936-db4cefe3d5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:39.672919 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05090152-858f-4c1e-b936-db4cefe3d5fc admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:39.673238 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05090152-858f-4c1e-b936-db4cefe3d5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:39.673511 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05090152-858f-4c1e-b936-db4cefe3d5fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:39.674506 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05090152-858f-4c1e-b936-db4cefe3d5fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:04:39.675059 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05090152-858f-4c1e-b936-db4cefe3d5fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:39.678354 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05090152-858f-4c1e-b936-db4cefe3d5fc admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:39.697255 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 782/1555] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:04:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:04:39.700035 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab803d61-dd2b-493c-a8ee-838672d5cc1b None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:39.700507 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab803d61-dd2b-493c-a8ee-838672d5cc1b None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:39.700918 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab803d61-dd2b-493c-a8ee-838672d5cc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:39.727411 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-ab803d61-dd2b-493c-a8ee-838672d5cc1b None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:04:39.727411 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ab803d61-dd2b-493c-a8ee-838672d5cc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:04:39.731560 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 783/1556] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:04:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:04:39.732598 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab803d61-dd2b-493c-a8ee-838672d5cc1b None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:39.749269 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab803d61-dd2b-493c-a8ee-838672d5cc1b None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:39.754844 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce14c4-4781-4509-ae0e-3d925554b38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:39.762273 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce14c4-4781-4509-ae0e-3d925554b38a admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:39.762273 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce14c4-4781-4509-ae0e-3d925554b38a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:39.762273 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce14c4-4781-4509-ae0e-3d925554b38a admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:39.762273 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce14c4-4781-4509-ae0e-3d925554b38a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:04:39.762273 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce14c4-4781-4509-ae0e-3d925554b38a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:39.762273 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce14c4-4781-4509-ae0e-3d925554b38a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:39.775470 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 784/1557] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:04:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:04:39.776962 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2bd132-f95c-45c1-82f6-f221c641dd82 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:39.777256 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2bd132-f95c-45c1-82f6-f221c641dd82 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:39.777532 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2bd132-f95c-45c1-82f6-f221c641dd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:39.798953 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 774/1558] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:04:39 2022] POST /identity/v3/projects => generated 371 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:04:39.799937 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9361b-3f8b-44a3-a3e7-eb94293a0e9d admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:39.800281 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-2a2bd132-f95c-45c1-82f6-f221c641dd82 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:04:39.803857 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2a2bd132-f95c-45c1-82f6-f221c641dd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:04:39.882594 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9361b-3f8b-44a3-a3e7-eb94293a0e9d admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:39.887419 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:04:39.889895 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59bbf61-657c-4db3-a416-304e2c1db05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:39.890708 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59bbf61-657c-4db3-a416-304e2c1db05a admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:39.890875 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59bbf61-657c-4db3-a416-304e2c1db05a admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:39.891182 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59bbf61-657c-4db3-a416-304e2c1db05a admin admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:39.891933 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59bbf61-657c-4db3-a416-304e2c1db05a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:04:39.892330 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59bbf61-657c-4db3-a416-304e2c1db05a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:39.893392 dv-cinder-846842-8-smb devstack@keystone.service[80376]: WARNING py.warnings [None req-c59bbf61-657c-4db3-a416-304e2c1db05a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 04:04:39.893392 dv-cinder-846842-8-smb devstack@keystone.service[80376]: warnings.warn(msg) Jul 01 04:04:39.893392 dv-cinder-846842-8-smb devstack@keystone.service[80376]: Jul 01 04:04:39.894307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59bbf61-657c-4db3-a416-304e2c1db05a admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:39.910924 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 785/1559] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:04:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:04:39.910924 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2bd132-f95c-45c1-82f6-f221c641dd82 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:39.911520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 775/1560] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:04:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:04:39.911520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59bbf61-657c-4db3-a416-304e2c1db05a admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:39.925062 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59bbf61-657c-4db3-a416-304e2c1db05a admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:39.925383 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2bd132-f95c-45c1-82f6-f221c641dd82 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:39.931058 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74610a26-c667-4045-843b-11d22e1a8020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:39.931266 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74610a26-c667-4045-843b-11d22e1a8020 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:39.931652 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74610a26-c667-4045-843b-11d22e1a8020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:39.932577 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74610a26-c667-4045-843b-11d22e1a8020 admin admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:39.933342 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8751cbf5-fa77-4ba0-a442-d0da5a59b058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:39.933557 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74610a26-c667-4045-843b-11d22e1a8020 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:39.934184 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751cbf5-fa77-4ba0-a442-d0da5a59b058 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:39.934536 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751cbf5-fa77-4ba0-a442-d0da5a59b058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:39.934881 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751cbf5-fa77-4ba0-a442-d0da5a59b058 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:39.935721 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8751cbf5-fa77-4ba0-a442-d0da5a59b058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:39.935925 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74610a26-c667-4045-843b-11d22e1a8020 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:39.938454 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8751cbf5-fa77-4ba0-a442-d0da5a59b058 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:39.948200 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:04:39.953365 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 786/1561] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:04:39 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:04:39.958225 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ed846-52a1-4e29-b475-523e80f52878 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:39.958513 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ed846-52a1-4e29-b475-523e80f52878 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:39.958792 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ed846-52a1-4e29-b475-523e80f52878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:39.984109 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-1e3ed846-52a1-4e29-b475-523e80f52878 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:04:39.984793 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1e3ed846-52a1-4e29-b475-523e80f52878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:04:39.999240 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 787/1562] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:04:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:04:40.001614 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ed846-52a1-4e29-b475-523e80f52878 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:40.018921 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ed846-52a1-4e29-b475-523e80f52878 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:40.024399 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 776/1563] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:04:39 2022] POST /identity/v3/projects => generated 363 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:04:40.026221 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74610a26-c667-4045-843b-11d22e1a8020 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:40.031848 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2e981-ddb6-457e-af4f-ff38e5555ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:40.033010 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2e981-ddb6-457e-af4f-ff38e5555ee0 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:40.033512 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2e981-ddb6-457e-af4f-ff38e5555ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:40.034010 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2e981-ddb6-457e-af4f-ff38e5555ee0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:40.035350 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d2e981-ddb6-457e-af4f-ff38e5555ee0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:40.037559 dv-cinder-846842-8-smb devstack@keystone.service[80377]: WARNING py.warnings [None req-35d2e981-ddb6-457e-af4f-ff38e5555ee0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 01 04:04:40.037559 dv-cinder-846842-8-smb devstack@keystone.service[80377]: warnings.warn(msg) Jul 01 04:04:40.037559 dv-cinder-846842-8-smb devstack@keystone.service[80377]: Jul 01 04:04:40.040023 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d2e981-ddb6-457e-af4f-ff38e5555ee0 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:40.105643 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74610a26-c667-4045-843b-11d22e1a8020 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:40.110686 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d0a4a-ef51-4749-87c1-217d5eb94407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:40.111398 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d0a4a-ef51-4749-87c1-217d5eb94407 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:40.111710 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d0a4a-ef51-4749-87c1-217d5eb94407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:40.111991 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d0a4a-ef51-4749-87c1-217d5eb94407 admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:40.112711 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4d0a4a-ef51-4749-87c1-217d5eb94407 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:40.114691 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4d0a4a-ef51-4749-87c1-217d5eb94407 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:40.144059 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 788/1564] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:04:39 2022] POST /identity/v3/projects => generated 373 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:04:40.147823 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba565b44-8741-4b19-9c13-21d72fd6db6c None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:40.148939 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba565b44-8741-4b19-9c13-21d72fd6db6c None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:40.149320 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba565b44-8741-4b19-9c13-21d72fd6db6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:40.174092 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-ba565b44-8741-4b19-9c13-21d72fd6db6c None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:04:40.176279 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ba565b44-8741-4b19-9c13-21d72fd6db6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:04:40.266824 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 777/1565] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:04:40 2022] POST /identity/v3/users => generated 286 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:04:40.267846 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d0a4a-ef51-4749-87c1-217d5eb94407 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:40.278795 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d0a4a-ef51-4749-87c1-217d5eb94407 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:40.284186 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0d28b-152a-42a7-b1e9-79a92e69cec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:40.284870 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0d28b-152a-42a7-b1e9-79a92e69cec7 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:40.285152 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0d28b-152a-42a7-b1e9-79a92e69cec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:40.285432 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0d28b-152a-42a7-b1e9-79a92e69cec7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:40.286378 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a0d28b-152a-42a7-b1e9-79a92e69cec7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:40.288414 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a0d28b-152a-42a7-b1e9-79a92e69cec7 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:40.291810 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 789/1566] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:04:40.293234 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba565b44-8741-4b19-9c13-21d72fd6db6c None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:40.305538 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba565b44-8741-4b19-9c13-21d72fd6db6c None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:40.318685 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b0769-8896-43e5-b84d-22a5073e2b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:40.319826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b0769-8896-43e5-b84d-22a5073e2b15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:40.320175 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b0769-8896-43e5-b84d-22a5073e2b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:40.330744 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b0769-8896-43e5-b84d-22a5073e2b15 admin admin] PATH_INFO: `/v3/projects/0e009f12cf8e48148dd3b57b9acccb02/users/28988559f6b1460f8f7dac1069c33456/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:40.338106 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986b0769-8896-43e5-b84d-22a5073e2b15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e009f12cf8e48148dd3b57b9acccb02, user_id=28988559f6b1460f8f7dac1069c33456, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:40.339166 dv-cinder-846842-8-smb devstack@keystone.service[80377]: WARNING py.warnings [None req-986b0769-8896-43e5-b84d-22a5073e2b15 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 01 04:04:40.339166 dv-cinder-846842-8-smb devstack@keystone.service[80377]: warnings.warn(msg) Jul 01 04:04:40.339166 dv-cinder-846842-8-smb devstack@keystone.service[80377]: Jul 01 04:04:40.341194 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986b0769-8896-43e5-b84d-22a5073e2b15 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:40.427078 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 778/1567] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:04:40 2022] POST /identity/v3/projects => generated 383 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:04:40.428728 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17f0dc-92fa-4260-8231-0020f5495bfc None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:40.429027 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17f0dc-92fa-4260-8231-0020f5495bfc None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:40.429309 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17f0dc-92fa-4260-8231-0020f5495bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:40.448661 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-7f17f0dc-92fa-4260-8231-0020f5495bfc None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:04:40.449918 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-7f17f0dc-92fa-4260-8231-0020f5495bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:04:40.475904 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 790/1568] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:04:40 2022] PUT /identity/v3/projects/0e009f12cf8e48148dd3b57b9acccb02/users/28988559f6b1460f8f7dac1069c33456/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:04:40.477101 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b0769-8896-43e5-b84d-22a5073e2b15 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:40.538847 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 779/1569] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:04:40.540828 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17f0dc-92fa-4260-8231-0020f5495bfc None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:40.554931 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17f0dc-92fa-4260-8231-0020f5495bfc None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:40.573328 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b0769-8896-43e5-b84d-22a5073e2b15 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:40.580145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c93f0e-acc8-4d17-9e07-ecc8ce27cbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:40.580145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c93f0e-acc8-4d17-9e07-ecc8ce27cbdb admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:40.580543 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c93f0e-acc8-4d17-9e07-ecc8ce27cbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:40.580686 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c93f0e-acc8-4d17-9e07-ecc8ce27cbdb admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:40.581503 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c93f0e-acc8-4d17-9e07-ecc8ce27cbdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:04:40.582009 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c93f0e-acc8-4d17-9e07-ecc8ce27cbdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:40.584203 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c93f0e-acc8-4d17-9e07-ecc8ce27cbdb admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:40.603519 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 791/1570] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:04:40.603519 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c93f0e-acc8-4d17-9e07-ecc8ce27cbdb admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:40.615673 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c93f0e-acc8-4d17-9e07-ecc8ce27cbdb admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:40.623689 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1525d-f6d2-4695-b1c8-220000a9a35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:40.624547 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1525d-f6d2-4695-b1c8-220000a9a35d admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:40.625023 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1525d-f6d2-4695-b1c8-220000a9a35d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:40.625401 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1525d-f6d2-4695-b1c8-220000a9a35d admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:40.626290 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1525d-f6d2-4695-b1c8-220000a9a35d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:40.628703 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1525d-f6d2-4695-b1c8-220000a9a35d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:40.643028 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c149f7-b9cc-4853-90de-df65e8e28d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:40.644035 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c149f7-b9cc-4853-90de-df65e8e28d3a admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:40.644035 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c149f7-b9cc-4853-90de-df65e8e28d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:40.644319 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c149f7-b9cc-4853-90de-df65e8e28d3a admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:40.645025 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c149f7-b9cc-4853-90de-df65e8e28d3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:40.647045 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c149f7-b9cc-4853-90de-df65e8e28d3a admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:40.654662 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:04:40.748853 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 792/1571] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:04:40 2022] POST /identity/v3/users => generated 287 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:04:40.749900 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1525d-f6d2-4695-b1c8-220000a9a35d admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:40.761579 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1525d-f6d2-4695-b1c8-220000a9a35d admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:40.766991 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c435a-11e0-48e9-9868-453632390815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:40.767774 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c435a-11e0-48e9-9868-453632390815 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:40.768015 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c435a-11e0-48e9-9868-453632390815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:40.768378 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c435a-11e0-48e9-9868-453632390815 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:40.769052 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505c435a-11e0-48e9-9868-453632390815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:40.770789 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505c435a-11e0-48e9-9868-453632390815 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:40.778379 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:04:40.785990 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 793/1572] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:04:40.787304 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c435a-11e0-48e9-9868-453632390815 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:40.795058 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 780/1573] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:04:40 2022] POST /identity/v3/users => generated 282 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:04:40.795058 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c149f7-b9cc-4853-90de-df65e8e28d3a admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:40.804011 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c435a-11e0-48e9-9868-453632390815 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:40.808071 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c149f7-b9cc-4853-90de-df65e8e28d3a admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:40.812123 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa97f6e-517e-4f96-9abe-902daa58c4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:40.813208 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa97f6e-517e-4f96-9abe-902daa58c4bf admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:40.813685 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa97f6e-517e-4f96-9abe-902daa58c4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:40.814147 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa97f6e-517e-4f96-9abe-902daa58c4bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:40.815396 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa97f6e-517e-4f96-9abe-902daa58c4bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:04:40.819481 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2944deb4-96a1-45b2-9e67-2c12f93e6d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:40.819728 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa97f6e-517e-4f96-9abe-902daa58c4bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:40.819867 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944deb4-96a1-45b2-9e67-2c12f93e6d7c admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:40.819867 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944deb4-96a1-45b2-9e67-2c12f93e6d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:40.819867 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944deb4-96a1-45b2-9e67-2c12f93e6d7c admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:40.820195 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa97f6e-517e-4f96-9abe-902daa58c4bf admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:40.820282 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2944deb4-96a1-45b2-9e67-2c12f93e6d7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:40.823082 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2944deb4-96a1-45b2-9e67-2c12f93e6d7c admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:40.840201 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 794/1574] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:04:40.842786 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98549a6-ce83-48e3-8935-32f51978c1bf None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:40.843725 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98549a6-ce83-48e3-8935-32f51978c1bf None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:40.844876 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98549a6-ce83-48e3-8935-32f51978c1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:40.866974 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-f98549a6-ce83-48e3-8935-32f51978c1bf None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:04:40.868267 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f98549a6-ce83-48e3-8935-32f51978c1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:04:40.877008 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 795/1575] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:04:40.878623 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a743b9-ed8f-4655-904f-9d854d85eaf4 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:40.878999 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a743b9-ed8f-4655-904f-9d854d85eaf4 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:40.879315 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a743b9-ed8f-4655-904f-9d854d85eaf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:40.902420 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-19a743b9-ed8f-4655-904f-9d854d85eaf4 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:04:40.903861 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-19a743b9-ed8f-4655-904f-9d854d85eaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:04:40.912805 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 796/1576] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:04:40.913655 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a743b9-ed8f-4655-904f-9d854d85eaf4 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:40.924165 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a743b9-ed8f-4655-904f-9d854d85eaf4 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:40.929218 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef9537-44ca-4917-afed-5a9b79c95225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:40.929902 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef9537-44ca-4917-afed-5a9b79c95225 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:40.930187 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef9537-44ca-4917-afed-5a9b79c95225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:40.930464 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef9537-44ca-4917-afed-5a9b79c95225 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:40.931181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef9537-44ca-4917-afed-5a9b79c95225 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:40.933734 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef9537-44ca-4917-afed-5a9b79c95225 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:40.953589 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 781/1577] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:04:40 2022] POST /identity/v3/users => generated 292 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:04:40.953589 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2944deb4-96a1-45b2-9e67-2c12f93e6d7c admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:40.961908 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2944deb4-96a1-45b2-9e67-2c12f93e6d7c admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:40.967241 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb67c7-d882-4b69-b44f-52dc168eebf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:40.967973 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb67c7-d882-4b69-b44f-52dc168eebf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:40.968258 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb67c7-d882-4b69-b44f-52dc168eebf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:40.968540 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb67c7-d882-4b69-b44f-52dc168eebf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:40.969288 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb67c7-d882-4b69-b44f-52dc168eebf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:40.970967 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb67c7-d882-4b69-b44f-52dc168eebf3 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:40.984559 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 782/1578] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:04:40.985940 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb67c7-d882-4b69-b44f-52dc168eebf3 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:40.997984 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb67c7-d882-4b69-b44f-52dc168eebf3 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:41.003667 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc02742-0439-43ae-8458-4720d52c390e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:41.004513 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc02742-0439-43ae-8458-4720d52c390e admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:41.004891 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc02742-0439-43ae-8458-4720d52c390e admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:41.005267 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc02742-0439-43ae-8458-4720d52c390e admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:41.006166 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc02742-0439-43ae-8458-4720d52c390e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:41.008259 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc02742-0439-43ae-8458-4720d52c390e admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:41.020221 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 783/1579] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:04:41.021332 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc02742-0439-43ae-8458-4720d52c390e admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:41.033565 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc02742-0439-43ae-8458-4720d52c390e admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:41.036580 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 797/1580] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:04:40 2022] POST /identity/v3/projects => generated 391 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:04:41.039249 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef9537-44ca-4917-afed-5a9b79c95225 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:41.039637 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46189516-5193-4dc5-8429-10d6a6475677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:41.040520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46189516-5193-4dc5-8429-10d6a6475677 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:41.047130 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46189516-5193-4dc5-8429-10d6a6475677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:41.047130 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46189516-5193-4dc5-8429-10d6a6475677 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:41.047130 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46189516-5193-4dc5-8429-10d6a6475677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:41.047130 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46189516-5193-4dc5-8429-10d6a6475677 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:41.067263 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 784/1581] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:04:41.067263 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46189516-5193-4dc5-8429-10d6a6475677 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:41.145616 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46189516-5193-4dc5-8429-10d6a6475677 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:41.149713 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef9537-44ca-4917-afed-5a9b79c95225 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:41.154509 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7abc9-b619-4935-97c9-bbe3d1fc4d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:41.155194 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7abc9-b619-4935-97c9-bbe3d1fc4d8e admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:41.155510 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7abc9-b619-4935-97c9-bbe3d1fc4d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:41.155796 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7abc9-b619-4935-97c9-bbe3d1fc4d8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:41.156498 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e7abc9-b619-4935-97c9-bbe3d1fc4d8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:41.158476 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e7abc9-b619-4935-97c9-bbe3d1fc4d8e admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:41.237597 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b65cc-0ed6-4b1c-8599-7821ae9a9aba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:41.238702 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b65cc-0ed6-4b1c-8599-7821ae9a9aba service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:41.239194 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b65cc-0ed6-4b1c-8599-7821ae9a9aba service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:41.239721 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b65cc-0ed6-4b1c-8599-7821ae9a9aba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:41.248209 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 798/1582] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:04:41 2022] POST /identity/v3/projects => generated 403 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:04:41.249700 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7abc9-b619-4935-97c9-bbe3d1fc4d8e admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:41.259648 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b65cc-0ed6-4b1c-8599-7821ae9a9aba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:41.263262 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b65cc-0ed6-4b1c-8599-7821ae9a9aba service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:41.283338 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 785/1583] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:04:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:04:41.284805 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b65cc-0ed6-4b1c-8599-7821ae9a9aba service neutron] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:41.303207 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b65cc-0ed6-4b1c-8599-7821ae9a9aba service neutron] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:41.350131 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7abc9-b619-4935-97c9-bbe3d1fc4d8e admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:41.356697 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef66561-2d17-4328-ada8-6f2f50f1d592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:41.357631 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef66561-2d17-4328-ada8-6f2f50f1d592 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:41.358143 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef66561-2d17-4328-ada8-6f2f50f1d592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:41.358633 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef66561-2d17-4328-ada8-6f2f50f1d592 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:41.360052 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef66561-2d17-4328-ada8-6f2f50f1d592 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:04:41.360767 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef66561-2d17-4328-ada8-6f2f50f1d592 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:41.364043 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef66561-2d17-4328-ada8-6f2f50f1d592 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:41.379977 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:04:41.386856 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 799/1584] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:04:41.390622 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef66561-2d17-4328-ada8-6f2f50f1d592 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:41.390859 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af375f-0a5f-4798-9394-a78ac15f057b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:41.390859 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af375f-0a5f-4798-9394-a78ac15f057b admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:41.390859 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af375f-0a5f-4798-9394-a78ac15f057b admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:41.390859 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af375f-0a5f-4798-9394-a78ac15f057b admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:41.391642 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af375f-0a5f-4798-9394-a78ac15f057b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:41.394632 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af375f-0a5f-4798-9394-a78ac15f057b admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:41.399857 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef66561-2d17-4328-ada8-6f2f50f1d592 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:41.405276 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0edaa4-2286-4cb6-ab0d-71e534717832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:41.405983 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0edaa4-2286-4cb6-ab0d-71e534717832 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:41.406267 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0edaa4-2286-4cb6-ab0d-71e534717832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:41.406546 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0edaa4-2286-4cb6-ab0d-71e534717832 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:41.407407 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0edaa4-2286-4cb6-ab0d-71e534717832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:41.409168 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0edaa4-2286-4cb6-ab0d-71e534717832 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:41.417073 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 786/1585] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:04:41.417073 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af375f-0a5f-4798-9394-a78ac15f057b admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:41.426265 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af375f-0a5f-4798-9394-a78ac15f057b admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:41.433749 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 800/1586] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:04:41.433749 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0edaa4-2286-4cb6-ab0d-71e534717832 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:41.437273 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa1de3-d79c-492a-b134-9e08e1277741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:41.438200 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa1de3-d79c-492a-b134-9e08e1277741 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:41.438558 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa1de3-d79c-492a-b134-9e08e1277741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:41.438937 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa1de3-d79c-492a-b134-9e08e1277741 admin admin] PATH_INFO: `/v3/projects/82e4b6ce3f584a9bb4f58e3b90a1b00f/users/fbaf17ac4e204f29b1330ba3c5776f59/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:41.450067 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0edaa4-2286-4cb6-ab0d-71e534717832 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:41.456044 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776a12e-84d5-4ea4-b206-3d3583337c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:41.456840 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776a12e-84d5-4ea4-b206-3d3583337c4f admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:41.457384 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776a12e-84d5-4ea4-b206-3d3583337c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:41.457809 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776a12e-84d5-4ea4-b206-3d3583337c4f admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:41.458870 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0776a12e-84d5-4ea4-b206-3d3583337c4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:41.461186 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0776a12e-84d5-4ea4-b206-3d3583337c4f admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:41.469886 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa1de3-d79c-492a-b134-9e08e1277741 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82e4b6ce3f584a9bb4f58e3b90a1b00f, user_id=fbaf17ac4e204f29b1330ba3c5776f59, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:41.473995 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa1de3-d79c-492a-b134-9e08e1277741 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:41.606846 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 801/1587] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:04:41 2022] POST /identity/v3/users => generated 296 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:04:41.607937 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776a12e-84d5-4ea4-b206-3d3583337c4f admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:41.613371 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:04:41.618902 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776a12e-84d5-4ea4-b206-3d3583337c4f admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:41.624360 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30abad-628a-4baa-81d7-52644bcc51de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:41.625061 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30abad-628a-4baa-81d7-52644bcc51de admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:41.625343 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30abad-628a-4baa-81d7-52644bcc51de admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:41.625626 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30abad-628a-4baa-81d7-52644bcc51de admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:41.626373 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc30abad-628a-4baa-81d7-52644bcc51de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:41.628062 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc30abad-628a-4baa-81d7-52644bcc51de admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:41.642448 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 787/1588] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:04:41 2022] PUT /identity/v3/projects/82e4b6ce3f584a9bb4f58e3b90a1b00f/users/fbaf17ac4e204f29b1330ba3c5776f59/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:04:41.643859 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa1de3-d79c-492a-b134-9e08e1277741 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:41.650212 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 802/1589] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:04:41.652680 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30abad-628a-4baa-81d7-52644bcc51de admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:41.686177 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30abad-628a-4baa-81d7-52644bcc51de admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:41.785281 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa1de3-d79c-492a-b134-9e08e1277741 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:41.794331 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd648b10-53b6-4031-8188-e67e43f78b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:41.795741 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd648b10-53b6-4031-8188-e67e43f78b68 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:41.796187 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd648b10-53b6-4031-8188-e67e43f78b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:41.796687 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd648b10-53b6-4031-8188-e67e43f78b68 admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:41.797973 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd648b10-53b6-4031-8188-e67e43f78b68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:41.802133 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd648b10-53b6-4031-8188-e67e43f78b68 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:41.802714 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27161b67-1699-4999-8012-5af8a3935e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:41.803436 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27161b67-1699-4999-8012-5af8a3935e33 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:41.803752 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27161b67-1699-4999-8012-5af8a3935e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:41.804033 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27161b67-1699-4999-8012-5af8a3935e33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:41.804739 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27161b67-1699-4999-8012-5af8a3935e33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:41.807489 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27161b67-1699-4999-8012-5af8a3935e33 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:41.927497 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 788/1590] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:04:41 2022] POST /identity/v3/users => generated 302 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:04:41.928775 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd648b10-53b6-4031-8188-e67e43f78b68 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:41.946539 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd648b10-53b6-4031-8188-e67e43f78b68 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:41.953254 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ee487-53ed-41ff-bff7-bd1dbc58eaad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:41.954635 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ee487-53ed-41ff-bff7-bd1dbc58eaad admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:41.955245 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ee487-53ed-41ff-bff7-bd1dbc58eaad admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:41.955730 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ee487-53ed-41ff-bff7-bd1dbc58eaad admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:41.957591 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ee487-53ed-41ff-bff7-bd1dbc58eaad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:41.960937 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ee487-53ed-41ff-bff7-bd1dbc58eaad admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:41.967036 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 803/1591] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:04:41 2022] POST /identity/v3/projects => generated 367 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:04:41.968259 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27161b67-1699-4999-8012-5af8a3935e33 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:41.985462 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 789/1592] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:04:41.987313 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ee487-53ed-41ff-bff7-bd1dbc58eaad admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:42.010790 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ee487-53ed-41ff-bff7-bd1dbc58eaad admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:42.118886 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27161b67-1699-4999-8012-5af8a3935e33 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:42.124771 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5ce43-82b6-4c45-954e-c8dc57675b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:42.126213 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5ce43-82b6-4c45-954e-c8dc57675b45 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:42.126677 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5ce43-82b6-4c45-954e-c8dc57675b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:42.127301 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5ce43-82b6-4c45-954e-c8dc57675b45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:42.129371 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db5ce43-82b6-4c45-954e-c8dc57675b45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:42.129615 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e081c6-327c-4940-9ac5-d58147682b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:42.131402 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e081c6-327c-4940-9ac5-d58147682b05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:42.131914 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e081c6-327c-4940-9ac5-d58147682b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:42.132224 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db5ce43-82b6-4c45-954e-c8dc57675b45 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:42.132430 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e081c6-327c-4940-9ac5-d58147682b05 admin admin] PATH_INFO: `/v3/projects/75ae98d33a7f4a25a3fbf6ae92e8461e/users/d66158194ffe49b9b70abdea5e41abd4/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:42.160999 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 790/1593] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:04:42.160999 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5ce43-82b6-4c45-954e-c8dc57675b45 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:42.172698 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e081c6-327c-4940-9ac5-d58147682b05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75ae98d33a7f4a25a3fbf6ae92e8461e, user_id=d66158194ffe49b9b70abdea5e41abd4, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:42.178536 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e081c6-327c-4940-9ac5-d58147682b05 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:42.185034 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5ce43-82b6-4c45-954e-c8dc57675b45 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:42.193833 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75603ae2-6133-41c1-8ad7-79bff6f19ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:42.198184 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75603ae2-6133-41c1-8ad7-79bff6f19ffa admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:42.198184 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75603ae2-6133-41c1-8ad7-79bff6f19ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:42.198184 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75603ae2-6133-41c1-8ad7-79bff6f19ffa admin admin] PATH_INFO: `/v3/projects/e3f110a8ac144bf285d17c2934f6b796/users/e55acb0cf1334916ae20af7cf19d914b/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:42.219362 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75603ae2-6133-41c1-8ad7-79bff6f19ffa admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3f110a8ac144bf285d17c2934f6b796, user_id=e55acb0cf1334916ae20af7cf19d914b, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:42.223581 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75603ae2-6133-41c1-8ad7-79bff6f19ffa admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:42.268527 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 804/1594] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:04:41 2022] PUT /identity/v3/projects/75ae98d33a7f4a25a3fbf6ae92e8461e/users/d66158194ffe49b9b70abdea5e41abd4/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:04:42.270902 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e66cc8-5eeb-47cc-8fc2-8161fb5a6759 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:42.271785 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e66cc8-5eeb-47cc-8fc2-8161fb5a6759 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:42.271979 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e66cc8-5eeb-47cc-8fc2-8161fb5a6759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:42.323553 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-a1e66cc8-5eeb-47cc-8fc2-8161fb5a6759 None None] MFA Rules not processed for user `fbaf17ac4e204f29b1330ba3c5776f59`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:04:42.325480 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a1e66cc8-5eeb-47cc-8fc2-8161fb5a6759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:04:42.330249 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 791/1595] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:04:42 2022] PUT /identity/v3/projects/e3f110a8ac144bf285d17c2934f6b796/users/e55acb0cf1334916ae20af7cf19d914b/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:04:42.331928 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75603ae2-6133-41c1-8ad7-79bff6f19ffa admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:42.376382 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:04:42.417309 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:04:42.437994 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75603ae2-6133-41c1-8ad7-79bff6f19ffa admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:42.442390 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 805/1596] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:04:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:04:42.444173 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e66cc8-5eeb-47cc-8fc2-8161fb5a6759 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:42.447583 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76815de5-b017-4e68-9118-d34e3cabc4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:42.447583 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76815de5-b017-4e68-9118-d34e3cabc4a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:42.447583 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76815de5-b017-4e68-9118-d34e3cabc4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:42.447583 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76815de5-b017-4e68-9118-d34e3cabc4a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:42.448297 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76815de5-b017-4e68-9118-d34e3cabc4a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:42.450028 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76815de5-b017-4e68-9118-d34e3cabc4a7 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:42.475181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e66cc8-5eeb-47cc-8fc2-8161fb5a6759 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:42.476565 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 792/1597] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:04:42.478562 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76815de5-b017-4e68-9118-d34e3cabc4a7 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:42.486227 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6dae19-798d-4d77-a679-b4f94d16ed14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:42.487647 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6dae19-798d-4d77-a679-b4f94d16ed14 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:42.488278 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6dae19-798d-4d77-a679-b4f94d16ed14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:42.488938 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6dae19-798d-4d77-a679-b4f94d16ed14 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:42.490071 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6dae19-798d-4d77-a679-b4f94d16ed14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:42.494060 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6dae19-798d-4d77-a679-b4f94d16ed14 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:42.502508 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76815de5-b017-4e68-9118-d34e3cabc4a7 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:42.511308 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef25c8-d01c-47d6-90f7-33a0abce47c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:42.512701 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef25c8-d01c-47d6-90f7-33a0abce47c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:42.513177 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef25c8-d01c-47d6-90f7-33a0abce47c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:42.513739 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef25c8-d01c-47d6-90f7-33a0abce47c5 admin admin] PATH_INFO: `/v3/projects/902042539e31408f95db82263b40c1df/users/71b72d9b9e3a4eb2ba1aae5d8a924afd/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:42.537391 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef25c8-d01c-47d6-90f7-33a0abce47c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=902042539e31408f95db82263b40c1df, user_id=71b72d9b9e3a4eb2ba1aae5d8a924afd, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:42.542013 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef25c8-d01c-47d6-90f7-33a0abce47c5 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:42.620603 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 806/1598] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:04:42 2022] POST /identity/v3/users => generated 284 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:04:42.621629 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6dae19-798d-4d77-a679-b4f94d16ed14 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:42.633651 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6dae19-798d-4d77-a679-b4f94d16ed14 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:42.639103 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca7226-2267-4c0b-a68f-74cfa96cad36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:42.640364 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca7226-2267-4c0b-a68f-74cfa96cad36 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:42.640692 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca7226-2267-4c0b-a68f-74cfa96cad36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:42.641186 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca7226-2267-4c0b-a68f-74cfa96cad36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:42.642597 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca7226-2267-4c0b-a68f-74cfa96cad36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:42.645779 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca7226-2267-4c0b-a68f-74cfa96cad36 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:42.659089 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 807/1599] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:04:42.679832 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4aa6f-4594-48d9-8bf9-0dd905318e69 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:42.679832 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4aa6f-4594-48d9-8bf9-0dd905318e69 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:42.679832 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4aa6f-4594-48d9-8bf9-0dd905318e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:42.680127 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 793/1600] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:04:42 2022] PUT /identity/v3/projects/902042539e31408f95db82263b40c1df/users/71b72d9b9e3a4eb2ba1aae5d8a924afd/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:04:42.680127 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc06c1-36a8-4c37-8b2e-0ceeb7ac7847 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:42.680127 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc06c1-36a8-4c37-8b2e-0ceeb7ac7847 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:42.680127 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc06c1-36a8-4c37-8b2e-0ceeb7ac7847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:42.695798 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-48a4aa6f-4594-48d9-8bf9-0dd905318e69 None None] MFA Rules not processed for user `d66158194ffe49b9b70abdea5e41abd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:04:42.697069 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-48a4aa6f-4594-48d9-8bf9-0dd905318e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:04:42.710081 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-10dc06c1-36a8-4c37-8b2e-0ceeb7ac7847 None None] MFA Rules not processed for user `e55acb0cf1334916ae20af7cf19d914b`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:04:42.711346 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-10dc06c1-36a8-4c37-8b2e-0ceeb7ac7847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:04:42.795867 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 794/1601] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:04:42 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:04:42.797624 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc06c1-36a8-4c37-8b2e-0ceeb7ac7847 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:42.809923 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 808/1602] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:04:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:04:42.811316 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2566ee-f8b8-4bfd-b666-00558e85cb69 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:42.811665 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2566ee-f8b8-4bfd-b666-00558e85cb69 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:42.811945 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2566ee-f8b8-4bfd-b666-00558e85cb69 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:42.813401 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 809/1603] 10.222.0.46 () {54 vars in 961 bytes} [Fri Jul 1 04:04:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 04:04:42.814361 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2566ee-f8b8-4bfd-b666-00558e85cb69 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:42.935297 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2566ee-f8b8-4bfd-b666-00558e85cb69 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:42.935622 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc06c1-36a8-4c37-8b2e-0ceeb7ac7847 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:42.944233 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779a456-c7fe-48b6-978d-5a8e05079ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:42.945732 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779a456-c7fe-48b6-978d-5a8e05079ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:42.946384 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779a456-c7fe-48b6-978d-5a8e05079ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:42.947011 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779a456-c7fe-48b6-978d-5a8e05079ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:42.948974 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3779a456-c7fe-48b6-978d-5a8e05079ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:42.949082 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e114b-7820-4ac1-a577-131d05b8b602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:42.950410 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e114b-7820-4ac1-a577-131d05b8b602 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:42.951129 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e114b-7820-4ac1-a577-131d05b8b602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:42.951697 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e114b-7820-4ac1-a577-131d05b8b602 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:42.953480 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e114b-7820-4ac1-a577-131d05b8b602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:42.953995 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3779a456-c7fe-48b6-978d-5a8e05079ac6 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:42.957491 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e114b-7820-4ac1-a577-131d05b8b602 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:42.980240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 795/1604] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:04:42.981724 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ec22d-8145-401e-a0f3-3056bbc27886 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:42.982019 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ec22d-8145-401e-a0f3-3056bbc27886 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:42.982302 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ec22d-8145-401e-a0f3-3056bbc27886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:42.989529 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 810/1605] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:04:42.991032 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e114b-7820-4ac1-a577-131d05b8b602 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:43.018193 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e114b-7820-4ac1-a577-131d05b8b602 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:43.019782 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-732ec22d-8145-401e-a0f3-3056bbc27886 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:04:43.022856 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-732ec22d-8145-401e-a0f3-3056bbc27886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:04:43.027064 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08e052-66e8-454a-8fae-16efe6d40dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:43.028234 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08e052-66e8-454a-8fae-16efe6d40dd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:43.028827 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08e052-66e8-454a-8fae-16efe6d40dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:43.029114 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08e052-66e8-454a-8fae-16efe6d40dd4 admin admin] PATH_INFO: `/v3/projects/5b7b3ff91f9d446aae53f7966b7586cd/users/a61e50919a13413c9f641f23f6b30217/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:43.036811 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 796/1606] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:04:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:04:43.042808 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ec22d-8145-401e-a0f3-3056bbc27886 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:43.061931 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ec22d-8145-401e-a0f3-3056bbc27886 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:43.065831 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d08e052-66e8-454a-8fae-16efe6d40dd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b7b3ff91f9d446aae53f7966b7586cd, user_id=a61e50919a13413c9f641f23f6b30217, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:43.069915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d08e052-66e8-454a-8fae-16efe6d40dd4 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:43.078407 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b4734-efbb-4e0c-a98a-b79bbdbc978c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:43.080044 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b4734-efbb-4e0c-a98a-b79bbdbc978c admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:43.080629 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b4734-efbb-4e0c-a98a-b79bbdbc978c admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:43.081194 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b4734-efbb-4e0c-a98a-b79bbdbc978c admin admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:43.082711 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b4734-efbb-4e0c-a98a-b79bbdbc978c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:43.086995 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b4734-efbb-4e0c-a98a-b79bbdbc978c admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:43.103785 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:04:43.172206 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 811/1607] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:04:42 2022] PUT /identity/v3/projects/5b7b3ff91f9d446aae53f7966b7586cd/users/a61e50919a13413c9f641f23f6b30217/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:04:43.173524 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08e052-66e8-454a-8fae-16efe6d40dd4 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:43.210105 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 797/1608] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:04:43 2022] POST /identity/v3/projects => generated 363 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:04:43.212442 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c629d0d-2ae9-4f48-8d70-0e0c933cc7b5 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:43.212914 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c629d0d-2ae9-4f48-8d70-0e0c933cc7b5 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:43.213397 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c629d0d-2ae9-4f48-8d70-0e0c933cc7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:43.216499 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:04:43.242347 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-6c629d0d-2ae9-4f48-8d70-0e0c933cc7b5 None None] MFA Rules not processed for user `2da466ad31d344898f5c838f77d45181`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:04:43.245081 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-6c629d0d-2ae9-4f48-8d70-0e0c933cc7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:04:43.291223 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08e052-66e8-454a-8fae-16efe6d40dd4 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:43.383343 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf5f5d-8da1-4bbc-88d1-9a83848c2f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:43.384329 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf5f5d-8da1-4bbc-88d1-9a83848c2f64 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:43.384715 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf5f5d-8da1-4bbc-88d1-9a83848c2f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:43.385487 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf5f5d-8da1-4bbc-88d1-9a83848c2f64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:43.386258 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf5f5d-8da1-4bbc-88d1-9a83848c2f64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:43.388526 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf5f5d-8da1-4bbc-88d1-9a83848c2f64 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:43.411376 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 798/1609] 10.222.0.46 () {58 vars in 1058 bytes} [Fri Jul 1 04:04:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:04:43.415251 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c629d0d-2ae9-4f48-8d70-0e0c933cc7b5 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:43.429561 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c629d0d-2ae9-4f48-8d70-0e0c933cc7b5 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:43.435525 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da99685-af6d-4557-a8c5-88fd4c9b1a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:43.436430 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da99685-af6d-4557-a8c5-88fd4c9b1a5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:43.436716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da99685-af6d-4557-a8c5-88fd4c9b1a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:43.436993 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da99685-af6d-4557-a8c5-88fd4c9b1a5b admin admin] PATH_INFO: `/v3/projects/d8ef90145ef945d98bee84c9a76d204d/users/c19568d5200641a5b9e15f79f37b8ada/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:43.456739 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da99685-af6d-4557-a8c5-88fd4c9b1a5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8ef90145ef945d98bee84c9a76d204d, user_id=c19568d5200641a5b9e15f79f37b8ada, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:43.459650 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da99685-af6d-4557-a8c5-88fd4c9b1a5b admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:43.530405 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 812/1610] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:04:43 2022] POST /identity/v3/projects => generated 373 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:04:43.531307 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf5f5d-8da1-4bbc-88d1-9a83848c2f64 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:43.559881 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 799/1611] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:04:43 2022] PUT /identity/v3/projects/d8ef90145ef945d98bee84c9a76d204d/users/c19568d5200641a5b9e15f79f37b8ada/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:04:43.561286 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da99685-af6d-4557-a8c5-88fd4c9b1a5b admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:43.655837 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf5f5d-8da1-4bbc-88d1-9a83848c2f64 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:43.662207 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da99685-af6d-4557-a8c5-88fd4c9b1a5b admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:43.668653 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af95d0-4656-41f6-83d5-f5d578979a84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:43.669726 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af95d0-4656-41f6-83d5-f5d578979a84 service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:43.670187 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af95d0-4656-41f6-83d5-f5d578979a84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:43.670769 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af95d0-4656-41f6-83d5-f5d578979a84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:43.748900 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f27453-1f15-42b0-8cf1-324e6f995114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:43.750369 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f27453-1f15-42b0-8cf1-324e6f995114 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:43.750941 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f27453-1f15-42b0-8cf1-324e6f995114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:43.751430 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f27453-1f15-42b0-8cf1-324e6f995114 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:43.753128 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f27453-1f15-42b0-8cf1-324e6f995114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:43.756373 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f27453-1f15-42b0-8cf1-324e6f995114 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:43.762270 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:04:43.781123 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3af95d0-4656-41f6-83d5-f5d578979a84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:43.783079 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 813/1612] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:04:43.783314 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3af95d0-4656-41f6-83d5-f5d578979a84 service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:43.785667 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabf9df-352c-4770-90d3-cbc39c1fae3b None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:43.786144 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabf9df-352c-4770-90d3-cbc39c1fae3b None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:43.786619 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabf9df-352c-4770-90d3-cbc39c1fae3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:43.796790 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 800/1613] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:04:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:04:43.797697 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af95d0-4656-41f6-83d5-f5d578979a84 service neutron] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:43.809707 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af95d0-4656-41f6-83d5-f5d578979a84 service neutron] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:43.815393 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f84d0-0db9-47db-9173-d05290d0044e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:43.816169 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f84d0-0db9-47db-9173-d05290d0044e admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:43.816735 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f84d0-0db9-47db-9173-d05290d0044e admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:43.817174 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f84d0-0db9-47db-9173-d05290d0044e admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:43.818526 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f84d0-0db9-47db-9173-d05290d0044e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:43.820700 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f84d0-0db9-47db-9173-d05290d0044e admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:43.823400 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-adabf9df-352c-4770-90d3-cbc39c1fae3b None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:04:43.825203 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-adabf9df-352c-4770-90d3-cbc39c1fae3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:04:43.830070 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:04:43.845056 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 814/1614] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:04:43.846114 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabf9df-352c-4770-90d3-cbc39c1fae3b None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:43.952263 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 801/1615] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:04:43 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:04:43.955302 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f84d0-0db9-47db-9173-d05290d0044e admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:43.980653 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabf9df-352c-4770-90d3-cbc39c1fae3b None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:43.982334 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f84d0-0db9-47db-9173-d05290d0044e admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:43.990336 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfc896-b9e1-475d-bc3d-b807ad825f91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:43.991172 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfc896-b9e1-475d-bc3d-b807ad825f91 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:43.991369 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfc896-b9e1-475d-bc3d-b807ad825f91 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:43.991752 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfc896-b9e1-475d-bc3d-b807ad825f91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:43.995619 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52e43a-2cc7-46c7-a5de-f3cb424a9e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:43.997315 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52e43a-2cc7-46c7-a5de-f3cb424a9e74 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:43.998316 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52e43a-2cc7-46c7-a5de-f3cb424a9e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:43.998924 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52e43a-2cc7-46c7-a5de-f3cb424a9e74 admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:44.001818 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f52e43a-2cc7-46c7-a5de-f3cb424a9e74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:44.007780 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f52e43a-2cc7-46c7-a5de-f3cb424a9e74 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:44.081811 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cfc896-b9e1-475d-bc3d-b807ad825f91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:44.083934 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cfc896-b9e1-475d-bc3d-b807ad825f91 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:44.098166 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 815/1616] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:04:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:04:44.100353 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464fe81-631c-4d0a-9bad-fc5efb9499e1 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:44.100934 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464fe81-631c-4d0a-9bad-fc5efb9499e1 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:44.101512 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464fe81-631c-4d0a-9bad-fc5efb9499e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:44.127563 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 802/1617] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:04:43 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:04:44.127563 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52e43a-2cc7-46c7-a5de-f3cb424a9e74 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:44.131265 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-9464fe81-631c-4d0a-9bad-fc5efb9499e1 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:04:44.133639 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9464fe81-631c-4d0a-9bad-fc5efb9499e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:04:44.144940 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52e43a-2cc7-46c7-a5de-f3cb424a9e74 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:44.147937 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 816/1618] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:04:44.149025 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9464fe81-631c-4d0a-9bad-fc5efb9499e1 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:44.158287 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9464fe81-631c-4d0a-9bad-fc5efb9499e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:04:44.158567 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634fc190-4fdd-46ee-a32e-6382ac190a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:44.160348 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fc190-4fdd-46ee-a32e-6382ac190a6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:44.169254 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fc190-4fdd-46ee-a32e-6382ac190a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:44.169254 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fc190-4fdd-46ee-a32e-6382ac190a6d admin admin] PATH_INFO: `/v3/projects/5bcfece7e0a24ee4a062fd578f53ae4b/users/7185d7002d22492394ce8730919dc0c0/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:44.192819 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9464fe81-631c-4d0a-9bad-fc5efb9499e1 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:44.196054 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634fc190-4fdd-46ee-a32e-6382ac190a6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bcfece7e0a24ee4a062fd578f53ae4b, user_id=7185d7002d22492394ce8730919dc0c0, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:44.201416 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0327498-3f0e-4848-b76d-6d92d26fa008 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:44.202431 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634fc190-4fdd-46ee-a32e-6382ac190a6d admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:44.203748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0327498-3f0e-4848-b76d-6d92d26fa008 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:44.204592 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0327498-3f0e-4848-b76d-6d92d26fa008 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:44.205407 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0327498-3f0e-4848-b76d-6d92d26fa008 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:44.226555 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0327498-3f0e-4848-b76d-6d92d26fa008 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:44.230203 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0327498-3f0e-4848-b76d-6d92d26fa008 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:44.269170 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 817/1619] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:04:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:04:44.269170 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0327498-3f0e-4848-b76d-6d92d26fa008 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:44.305378 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0327498-3f0e-4848-b76d-6d92d26fa008 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:44.326636 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd93c974-d09c-430d-b7e9-c5ccf12b703f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:44.327937 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93c974-d09c-430d-b7e9-c5ccf12b703f admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:44.329374 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93c974-d09c-430d-b7e9-c5ccf12b703f admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:44.329827 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93c974-d09c-430d-b7e9-c5ccf12b703f admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:44.332236 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd93c974-d09c-430d-b7e9-c5ccf12b703f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:44.335213 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd93c974-d09c-430d-b7e9-c5ccf12b703f admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:44.371748 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 803/1620] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:04:44 2022] PUT /identity/v3/projects/5bcfece7e0a24ee4a062fd578f53ae4b/users/7185d7002d22492394ce8730919dc0c0/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:04:44.373351 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634fc190-4fdd-46ee-a32e-6382ac190a6d admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:44.382785 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 818/1621] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:04:44.384990 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd93c974-d09c-430d-b7e9-c5ccf12b703f admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:44.423724 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd93c974-d09c-430d-b7e9-c5ccf12b703f admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:44.585465 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66b51d-f019-48dd-bb99-3dc3f931c219 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:44.586985 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66b51d-f019-48dd-bb99-3dc3f931c219 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:44.588703 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66b51d-f019-48dd-bb99-3dc3f931c219 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:44.588703 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66b51d-f019-48dd-bb99-3dc3f931c219 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:44.611188 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634fc190-4fdd-46ee-a32e-6382ac190a6d admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:44.618446 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403e3e2-582f-43f2-a1a1-e7a793588f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:44.620167 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403e3e2-582f-43f2-a1a1-e7a793588f39 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:44.620435 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403e3e2-582f-43f2-a1a1-e7a793588f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:44.620715 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403e3e2-582f-43f2-a1a1-e7a793588f39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:44.622289 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1403e3e2-582f-43f2-a1a1-e7a793588f39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:44.624000 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1403e3e2-582f-43f2-a1a1-e7a793588f39 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:44.624167 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da66b51d-f019-48dd-bb99-3dc3f931c219 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:44.627507 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da66b51d-f019-48dd-bb99-3dc3f931c219 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:44.641950 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:04:44.654364 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 819/1622] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:04:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:04:44.655951 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66b51d-f019-48dd-bb99-3dc3f931c219 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:44.670167 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 804/1623] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:04:44.674036 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa6824-6d77-42e6-9f77-393673373349 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:44.674036 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa6824-6d77-42e6-9f77-393673373349 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:44.674511 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa6824-6d77-42e6-9f77-393673373349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:44.683388 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66b51d-f019-48dd-bb99-3dc3f931c219 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:44.694967 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb3828-a668-4e90-ac2b-8fd5185b7bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:44.697704 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb3828-a668-4e90-ac2b-8fd5185b7bf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:44.699314 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb3828-a668-4e90-ac2b-8fd5185b7bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:44.699887 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb3828-a668-4e90-ac2b-8fd5185b7bf4 admin admin] PATH_INFO: `/v3/projects/8695829cc7d140a9b6a1bbe12f6cf6b4/users/f315bddd883a49d08477641485051d38/roles/681755518698445fabd9a8accec13c0f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:44.722425 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-45fa6824-6d77-42e6-9f77-393673373349 None None] MFA Rules not processed for user `7185d7002d22492394ce8730919dc0c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:04:44.724501 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-45fa6824-6d77-42e6-9f77-393673373349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:04:44.742095 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddb3828-a668-4e90-ac2b-8fd5185b7bf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8695829cc7d140a9b6a1bbe12f6cf6b4, user_id=f315bddd883a49d08477641485051d38, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:44.752213 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddb3828-a668-4e90-ac2b-8fd5185b7bf4 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:44.861048 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 805/1624] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:04:44 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:04:44.868507 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f2b80-c74e-4504-8b9a-ec74000671c1 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:44.868772 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f2b80-c74e-4504-8b9a-ec74000671c1 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:44.869261 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f2b80-c74e-4504-8b9a-ec74000671c1 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:44.877604 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 806/1625] 10.222.0.46 () {54 vars in 912 bytes} [Fri Jul 1 04:04:44 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 04:04:44.878845 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f2b80-c74e-4504-8b9a-ec74000671c1 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:44.880394 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 820/1626] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:04:44 2022] PUT /identity/v3/projects/8695829cc7d140a9b6a1bbe12f6cf6b4/users/f315bddd883a49d08477641485051d38/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:04:44.889009 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca16f42-b432-478e-8a1a-4b9d9a378563 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:44.889314 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca16f42-b432-478e-8a1a-4b9d9a378563 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:44.896685 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca16f42-b432-478e-8a1a-4b9d9a378563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:44.978397 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-7ca16f42-b432-478e-8a1a-4b9d9a378563 None None] MFA Rules not processed for user `2da466ad31d344898f5c838f77d45181`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:04:44.978397 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-7ca16f42-b432-478e-8a1a-4b9d9a378563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:04:44.986151 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:04:45.021721 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f2b80-c74e-4504-8b9a-ec74000671c1 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:45.029122 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94229024-81fb-4db9-9497-3785f6ab2e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:45.030230 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94229024-81fb-4db9-9497-3785f6ab2e58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:45.030571 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94229024-81fb-4db9-9497-3785f6ab2e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:45.030920 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94229024-81fb-4db9-9497-3785f6ab2e58 admin admin] PATH_INFO: `/v3/projects/e552c16c13a7488a8ac7f1e935db3da0/users/1918e10bc4b14ddab8e9572d645d7db7/roles/681755518698445fabd9a8accec13c0f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:45.056691 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94229024-81fb-4db9-9497-3785f6ab2e58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e552c16c13a7488a8ac7f1e935db3da0, user_id=1918e10bc4b14ddab8e9572d645d7db7, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:45.059799 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94229024-81fb-4db9-9497-3785f6ab2e58 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:45.065448 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 821/1627] 10.222.0.46 () {58 vars in 1009 bytes} [Fri Jul 1 04:04:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:04:45.066530 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca16f42-b432-478e-8a1a-4b9d9a378563 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:45.082362 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca16f42-b432-478e-8a1a-4b9d9a378563 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:45.089520 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef3e32-d6b8-4ed8-b55c-b3648c39a72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:45.090203 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef3e32-d6b8-4ed8-b55c-b3648c39a72a admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:45.090489 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef3e32-d6b8-4ed8-b55c-b3648c39a72a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:45.090770 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef3e32-d6b8-4ed8-b55c-b3648c39a72a admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:45.091749 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ef3e32-d6b8-4ed8-b55c-b3648c39a72a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:45.094244 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ef3e32-d6b8-4ed8-b55c-b3648c39a72a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:45.108438 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 822/1628] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:04:45.109626 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef3e32-d6b8-4ed8-b55c-b3648c39a72a admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:45.172394 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 807/1629] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:04:44 2022] PUT /identity/v3/projects/e552c16c13a7488a8ac7f1e935db3da0/users/1918e10bc4b14ddab8e9572d645d7db7/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:04:45.174106 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94229024-81fb-4db9-9497-3785f6ab2e58 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:45.254631 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef3e32-d6b8-4ed8-b55c-b3648c39a72a admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:45.299037 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94229024-81fb-4db9-9497-3785f6ab2e58 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:45.309836 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d3ed0-0dd4-4521-bc04-dc97a8ee4230 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:45.311731 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d3ed0-0dd4-4521-bc04-dc97a8ee4230 service cinder] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:45.313009 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d3ed0-0dd4-4521-bc04-dc97a8ee4230 service cinder] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:45.313881 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d3ed0-0dd4-4521-bc04-dc97a8ee4230 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:45.378131 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b3dc5-f143-4d23-9d30-97c252fcd7ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:45.378974 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b3dc5-f143-4d23-9d30-97c252fcd7ed service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:45.379267 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b3dc5-f143-4d23-9d30-97c252fcd7ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:45.379602 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b3dc5-f143-4d23-9d30-97c252fcd7ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:45.429589 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:04:45.477794 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41b3dc5-f143-4d23-9d30-97c252fcd7ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:45.483917 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41b3dc5-f143-4d23-9d30-97c252fcd7ed service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:45.498270 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32d3ed0-0dd4-4521-bc04-dc97a8ee4230 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:45.501086 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32d3ed0-0dd4-4521-bc04-dc97a8ee4230 service cinder] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:45.502140 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 823/1630] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:04:45 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:04:45.504984 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b3dc5-f143-4d23-9d30-97c252fcd7ed service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:45.517764 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 808/1631] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:04:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:04:45.518913 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d3ed0-0dd4-4521-bc04-dc97a8ee4230 service cinder] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:45.662248 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d3ed0-0dd4-4521-bc04-dc97a8ee4230 service cinder] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:45.670008 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b3dc5-f143-4d23-9d30-97c252fcd7ed service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:45.675904 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657961f-adaf-456c-98a3-78c75738830f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:45.676605 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657961f-adaf-456c-98a3-78c75738830f admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:45.676891 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657961f-adaf-456c-98a3-78c75738830f admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:45.678799 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657961f-adaf-456c-98a3-78c75738830f admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:45.683426 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e657961f-adaf-456c-98a3-78c75738830f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:45.687272 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e657961f-adaf-456c-98a3-78c75738830f admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:45.701993 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b1256-4fc2-4a1b-91c3-47d6599fac1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:45.705247 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b1256-4fc2-4a1b-91c3-47d6599fac1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:45.706765 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b1256-4fc2-4a1b-91c3-47d6599fac1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:45.708520 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b1256-4fc2-4a1b-91c3-47d6599fac1b admin admin] PATH_INFO: `/v3/projects/8695829cc7d140a9b6a1bbe12f6cf6b4/users/f315bddd883a49d08477641485051d38/roles/681755518698445fabd9a8accec13c0f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:45.713638 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 809/1632] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:04:45.722376 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657961f-adaf-456c-98a3-78c75738830f admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:45.726317 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b1256-4fc2-4a1b-91c3-47d6599fac1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8695829cc7d140a9b6a1bbe12f6cf6b4, user_id=f315bddd883a49d08477641485051d38, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:45.733260 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b1256-4fc2-4a1b-91c3-47d6599fac1b admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:45.745400 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657961f-adaf-456c-98a3-78c75738830f admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:45.764187 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac63f6-bfff-4406-8da6-38760e12cbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:45.765341 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac63f6-bfff-4406-8da6-38760e12cbe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:45.765629 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac63f6-bfff-4406-8da6-38760e12cbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:45.767101 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac63f6-bfff-4406-8da6-38760e12cbe8 admin admin] PATH_INFO: `/v3/projects/e552c16c13a7488a8ac7f1e935db3da0/users/1918e10bc4b14ddab8e9572d645d7db7/roles/681755518698445fabd9a8accec13c0f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:45.774430 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac63f6-bfff-4406-8da6-38760e12cbe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e552c16c13a7488a8ac7f1e935db3da0, user_id=1918e10bc4b14ddab8e9572d645d7db7, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:45.782630 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac63f6-bfff-4406-8da6-38760e12cbe8 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:45.803274 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 824/1633] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:04:45 2022] PUT /identity/v3/projects/8695829cc7d140a9b6a1bbe12f6cf6b4/users/f315bddd883a49d08477641485051d38/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:04:45.808256 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd7a1b-5794-4b45-bc1f-318ca525ac55 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:45.808765 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd7a1b-5794-4b45-bc1f-318ca525ac55 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:45.809199 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd7a1b-5794-4b45-bc1f-318ca525ac55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:45.827713 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 810/1634] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:04:45 2022] PUT /identity/v3/projects/e552c16c13a7488a8ac7f1e935db3da0/users/1918e10bc4b14ddab8e9572d645d7db7/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:04:45.847954 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228dfb76-d25c-4fef-a841-ddaad8cc58e6 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:45.851795 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228dfb76-d25c-4fef-a841-ddaad8cc58e6 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:45.852179 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228dfb76-d25c-4fef-a841-ddaad8cc58e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:45.934284 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-9cdd7a1b-5794-4b45-bc1f-318ca525ac55 None None] MFA Rules not processed for user `f315bddd883a49d08477641485051d38`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:04:45.936961 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9cdd7a1b-5794-4b45-bc1f-318ca525ac55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:04:45.957468 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:04:45.960064 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-228dfb76-d25c-4fef-a841-ddaad8cc58e6 None None] MFA Rules not processed for user `1918e10bc4b14ddab8e9572d645d7db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:04:45.965963 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-228dfb76-d25c-4fef-a841-ddaad8cc58e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:04:46.166080 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 825/1635] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:04:45 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:04:46.252080 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 811/1636] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:04:45 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:04:47.583710 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd7a1b-5794-4b45-bc1f-318ca525ac55 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:47.663711 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:04:47.684487 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd7a1b-5794-4b45-bc1f-318ca525ac55 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:47.696470 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228dfb76-d25c-4fef-a841-ddaad8cc58e6 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:47.697420 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23fca1-420d-42ee-922c-fd8f082fcaf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:47.698570 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23fca1-420d-42ee-922c-fd8f082fcaf5 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:47.699026 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23fca1-420d-42ee-922c-fd8f082fcaf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:47.699490 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23fca1-420d-42ee-922c-fd8f082fcaf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:47.734365 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228dfb76-d25c-4fef-a841-ddaad8cc58e6 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:47.738674 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe23fca1-420d-42ee-922c-fd8f082fcaf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:47.743903 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe23fca1-420d-42ee-922c-fd8f082fcaf5 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:47.748118 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5f37a-978c-4334-9903-396968ddce2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:47.749139 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5f37a-978c-4334-9903-396968ddce2f service cinder] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:47.749564 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5f37a-978c-4334-9903-396968ddce2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:47.749977 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5f37a-978c-4334-9903-396968ddce2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:47.783171 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 826/1637] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:04:47 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 04:04:47.794913 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d5f37a-978c-4334-9903-396968ddce2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:47.802401 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d5f37a-978c-4334-9903-396968ddce2f service cinder] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:47.835026 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 812/1638] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:04:47 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 04:04:48.056089 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d9784-71bd-4e52-8903-70e9ba6a96f0 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:48.056447 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d9784-71bd-4e52-8903-70e9ba6a96f0 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:48.056784 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d9784-71bd-4e52-8903-70e9ba6a96f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:48.107755 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-3e0d9784-71bd-4e52-8903-70e9ba6a96f0 None None] MFA Rules not processed for user `c19568d5200641a5b9e15f79f37b8ada`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:04:48.111381 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-3e0d9784-71bd-4e52-8903-70e9ba6a96f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:04:48.424197 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 827/1639] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:04:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:04:48.430442 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5f37a-978c-4334-9903-396968ddce2f service cinder] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:48.475001 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d9784-71bd-4e52-8903-70e9ba6a96f0 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:48.498411 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d9784-71bd-4e52-8903-70e9ba6a96f0 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:48.508204 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac41f7-5895-4349-bdd1-ceaba4a689da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:48.509271 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac41f7-5895-4349-bdd1-ceaba4a689da service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:48.509750 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac41f7-5895-4349-bdd1-ceaba4a689da service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:48.511508 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac41f7-5895-4349-bdd1-ceaba4a689da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:48.610990 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eac41f7-5895-4349-bdd1-ceaba4a689da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:48.612860 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eac41f7-5895-4349-bdd1-ceaba4a689da service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:48.620843 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5f37a-978c-4334-9903-396968ddce2f service cinder] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:48.626522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 828/1640] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:04:48 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 04:04:48.627695 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac41f7-5895-4349-bdd1-ceaba4a689da service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:48.633360 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c490f2e0-a017-4207-a96c-0f55bb9bf72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:48.634315 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490f2e0-a017-4207-a96c-0f55bb9bf72e admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:48.634739 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490f2e0-a017-4207-a96c-0f55bb9bf72e admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:48.642354 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490f2e0-a017-4207-a96c-0f55bb9bf72e admin admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:48.642354 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c490f2e0-a017-4207-a96c-0f55bb9bf72e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:48.642354 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c490f2e0-a017-4207-a96c-0f55bb9bf72e admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:48.643076 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac41f7-5895-4349-bdd1-ceaba4a689da service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:48.645175 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d45c1-25b5-435a-b168-ed958fe1e2ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:48.646056 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d45c1-25b5-435a-b168-ed958fe1e2ea service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:48.646432 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d45c1-25b5-435a-b168-ed958fe1e2ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:48.646861 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d45c1-25b5-435a-b168-ed958fe1e2ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:48.725247 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59d45c1-25b5-435a-b168-ed958fe1e2ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:48.727779 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59d45c1-25b5-435a-b168-ed958fe1e2ea service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:48.741662 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 829/1641] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:04:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:04:48.820925 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 813/1642] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:04:48 2022] POST /identity/v3/projects => generated 405 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:04:48.826890 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d45c1-25b5-435a-b168-ed958fe1e2ea service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:48.849963 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d45c1-25b5-435a-b168-ed958fe1e2ea service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:48.957556 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cebaf-4dfb-4d93-8ea2-d71d7da97edd None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:48.957780 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cebaf-4dfb-4d93-8ea2-d71d7da97edd None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:48.958011 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cebaf-4dfb-4d93-8ea2-d71d7da97edd None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:48.959736 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 814/1643] 10.222.0.46 () {54 vars in 961 bytes} [Fri Jul 1 04:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 04:04:48.973622 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47069167-79d1-49e7-9348-ec04ddcf1be4 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:48.973908 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47069167-79d1-49e7-9348-ec04ddcf1be4 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:48.974190 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47069167-79d1-49e7-9348-ec04ddcf1be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:49.012487 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-47069167-79d1-49e7-9348-ec04ddcf1be4 None None] MFA Rules not processed for user `2da466ad31d344898f5c838f77d45181`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:04:49.013762 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-47069167-79d1-49e7-9348-ec04ddcf1be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:04:49.068014 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:04:49.075304 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d779dc-e17b-4c5d-813e-b05ee5baa76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:49.076950 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d779dc-e17b-4c5d-813e-b05ee5baa76a admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:49.077640 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d779dc-e17b-4c5d-813e-b05ee5baa76a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:49.078321 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d779dc-e17b-4c5d-813e-b05ee5baa76a admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:49.099746 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d779dc-e17b-4c5d-813e-b05ee5baa76a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:49.099746 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d779dc-e17b-4c5d-813e-b05ee5baa76a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:49.157009 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 815/1644] 10.222.0.46 () {58 vars in 1058 bytes} [Fri Jul 1 04:04:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 04:04:49.161993 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30045e3e-784c-4658-aa50-67aebc2ab704 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:49.162955 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30045e3e-784c-4658-aa50-67aebc2ab704 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:49.163365 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30045e3e-784c-4658-aa50-67aebc2ab704 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:49.165712 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 816/1645] 10.222.0.46 () {54 vars in 912 bytes} [Fri Jul 1 04:04:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 04:04:49.178033 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71de2e4-4ebc-4bc0-a226-535c8cfc25a7 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:49.180853 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71de2e4-4ebc-4bc0-a226-535c8cfc25a7 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:49.181363 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71de2e4-4ebc-4bc0-a226-535c8cfc25a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:49.239902 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-d71de2e4-4ebc-4bc0-a226-535c8cfc25a7 None None] MFA Rules not processed for user `2da466ad31d344898f5c838f77d45181`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:04:49.241129 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-d71de2e4-4ebc-4bc0-a226-535c8cfc25a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:04:49.262632 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 817/1646] 10.222.0.46 () {58 vars in 1009 bytes} [Fri Jul 1 04:04:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:04:49.266110 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 830/1647] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:04:48 2022] POST /identity/v3/users => generated 309 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:04:49.270342 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71de2e4-4ebc-4bc0-a226-535c8cfc25a7 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:49.275224 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:04:49.298635 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71de2e4-4ebc-4bc0-a226-535c8cfc25a7 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:49.307376 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e827e-d975-459f-bacb-93a2a647c500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:49.308514 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e827e-d975-459f-bacb-93a2a647c500 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:49.308935 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e827e-d975-459f-bacb-93a2a647c500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:49.309488 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e827e-d975-459f-bacb-93a2a647c500 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:49.310693 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e827e-d975-459f-bacb-93a2a647c500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:49.312680 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e827e-d975-459f-bacb-93a2a647c500 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:49.327950 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 818/1648] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:04:49.332264 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d779dc-e17b-4c5d-813e-b05ee5baa76a admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:49.355039 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d779dc-e17b-4c5d-813e-b05ee5baa76a admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:49.361264 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8811c59-2991-45d5-aa0b-f46b4741e9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:49.362191 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8811c59-2991-45d5-aa0b-f46b4741e9d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:49.362493 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8811c59-2991-45d5-aa0b-f46b4741e9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:49.362759 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8811c59-2991-45d5-aa0b-f46b4741e9d4 admin admin] PATH_INFO: `/v3/projects/01bb02fda8124dd79093581c1f6eb14d/users/1d02b887793f4ebdb039d5821845f73b/roles/681755518698445fabd9a8accec13c0f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:49.397909 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8811c59-2991-45d5-aa0b-f46b4741e9d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01bb02fda8124dd79093581c1f6eb14d, user_id=1d02b887793f4ebdb039d5821845f73b, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:49.401082 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8811c59-2991-45d5-aa0b-f46b4741e9d4 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:49.464377 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e827e-d975-459f-bacb-93a2a647c500 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:49.617000 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e827e-d975-459f-bacb-93a2a647c500 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:49.627661 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644472fb-a8c2-4a93-ac9c-ce943baaf5f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:49.629469 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644472fb-a8c2-4a93-ac9c-ce943baaf5f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:49.629762 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644472fb-a8c2-4a93-ac9c-ce943baaf5f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:49.631237 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644472fb-a8c2-4a93-ac9c-ce943baaf5f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:49.638845 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 831/1649] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:04:49 2022] PUT /identity/v3/projects/01bb02fda8124dd79093581c1f6eb14d/users/1d02b887793f4ebdb039d5821845f73b/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:04:49.641352 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8811c59-2991-45d5-aa0b-f46b4741e9d4 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:49.668473 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644472fb-a8c2-4a93-ac9c-ce943baaf5f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:49.674102 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644472fb-a8c2-4a93-ac9c-ce943baaf5f3 service cinder] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:49.714786 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 819/1650] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:04:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 04:04:49.819764 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8811c59-2991-45d5-aa0b-f46b4741e9d4 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:49.829560 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5d8ff-34ac-457f-b6c2-e2867d155fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:49.830879 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5d8ff-34ac-457f-b6c2-e2867d155fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:49.831476 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5d8ff-34ac-457f-b6c2-e2867d155fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:49.832037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5d8ff-34ac-457f-b6c2-e2867d155fe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:49.834211 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f5d8ff-34ac-457f-b6c2-e2867d155fe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:49.842147 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f5d8ff-34ac-457f-b6c2-e2867d155fe0 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:49.884197 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 832/1651] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 04:04:49.893666 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644472fb-a8c2-4a93-ac9c-ce943baaf5f3 service cinder] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:49.920410 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644472fb-a8c2-4a93-ac9c-ce943baaf5f3 service cinder] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:49.937132 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e779fab-b039-4f8e-9ec3-1cab8cec8681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:49.940456 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e779fab-b039-4f8e-9ec3-1cab8cec8681 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:49.941991 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e779fab-b039-4f8e-9ec3-1cab8cec8681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:49.942770 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e779fab-b039-4f8e-9ec3-1cab8cec8681 admin admin] PATH_INFO: `/v3/projects/01bb02fda8124dd79093581c1f6eb14d/users/1d02b887793f4ebdb039d5821845f73b/roles/681755518698445fabd9a8accec13c0f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:49.947371 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e779fab-b039-4f8e-9ec3-1cab8cec8681 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01bb02fda8124dd79093581c1f6eb14d, user_id=1d02b887793f4ebdb039d5821845f73b, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:49.971268 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e779fab-b039-4f8e-9ec3-1cab8cec8681 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:50.000845 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 820/1652] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:04:49 2022] PUT /identity/v3/projects/01bb02fda8124dd79093581c1f6eb14d/users/1d02b887793f4ebdb039d5821845f73b/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:04:52.698238 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5d8ff-34ac-457f-b6c2-e2867d155fe0 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:52.730127 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5d8ff-34ac-457f-b6c2-e2867d155fe0 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:52.962822 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d41ed-bcd6-48bb-b9c2-c3e7a73f3a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:52.967530 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d41ed-bcd6-48bb-b9c2-c3e7a73f3a7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:52.967530 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d41ed-bcd6-48bb-b9c2-c3e7a73f3a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:52.967530 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d41ed-bcd6-48bb-b9c2-c3e7a73f3a7c admin admin] PATH_INFO: `/v3/users/fbaf17ac4e204f29b1330ba3c5776f59` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:52.973355 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868d41ed-bcd6-48bb-b9c2-c3e7a73f3a7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbaf17ac4e204f29b1330ba3c5776f59)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:52.982773 dv-cinder-846842-8-smb devstack@keystone.service[80377]: WARNING py.warnings [None req-868d41ed-bcd6-48bb-b9c2-c3e7a73f3a7c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 01 04:04:52.982773 dv-cinder-846842-8-smb devstack@keystone.service[80377]: warnings.warn(msg) Jul 01 04:04:52.982773 dv-cinder-846842-8-smb devstack@keystone.service[80377]: Jul 01 04:04:52.985503 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868d41ed-bcd6-48bb-b9c2-c3e7a73f3a7c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:53.123065 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:04:53.660831 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-868d41ed-bcd6-48bb-b9c2-c3e7a73f3a7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbaf17ac4e204f29b1330ba3c5776f59'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:04:53.664082 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-868d41ed-bcd6-48bb-b9c2-c3e7a73f3a7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbaf17ac4e204f29b1330ba3c5776f59'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:04:53.800265 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585546c8-db3d-426d-8f7f-a5530a26bf5d None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:53.800965 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585546c8-db3d-426d-8f7f-a5530a26bf5d None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:53.801693 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585546c8-db3d-426d-8f7f-a5530a26bf5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:53.804213 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-868d41ed-bcd6-48bb-b9c2-c3e7a73f3a7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbaf17ac4e204f29b1330ba3c5776f59'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:04:53.828308 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-868d41ed-bcd6-48bb-b9c2-c3e7a73f3a7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbaf17ac4e204f29b1330ba3c5776f59'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:04:53.830663 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-868d41ed-bcd6-48bb-b9c2-c3e7a73f3a7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbaf17ac4e204f29b1330ba3c5776f59'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:04:53.949961 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-585546c8-db3d-426d-8f7f-a5530a26bf5d None None] MFA Rules not processed for user `1d02b887793f4ebdb039d5821845f73b`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:04:53.952310 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-585546c8-db3d-426d-8f7f-a5530a26bf5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:04:53.988300 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 833/1653] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:04:52 2022] DELETE /identity/v3/users/fbaf17ac4e204f29b1330ba3c5776f59 => generated 0 bytes in 1291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:04:53.996188 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5a36e-ea80-490b-8f88-c7c3f36bfd55 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:53.996525 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5a36e-ea80-490b-8f88-c7c3f36bfd55 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:53.996798 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5a36e-ea80-490b-8f88-c7c3f36bfd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:54.118317 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-10c5a36e-ea80-490b-8f88-c7c3f36bfd55 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:04:54.120877 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-10c5a36e-ea80-490b-8f88-c7c3f36bfd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:04:54.444111 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 834/1654] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:04:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:04:54.453883 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5a36e-ea80-490b-8f88-c7c3f36bfd55 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:54.458847 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-10c5a36e-ea80-490b-8f88-c7c3f36bfd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:04:54.500308 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 821/1655] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:04:53 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 702 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:04:54.639985 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5a36e-ea80-490b-8f88-c7c3f36bfd55 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:54.649735 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483e4a0-413a-43a3-bcc3-812cc6c0235c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:54.650431 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483e4a0-413a-43a3-bcc3-812cc6c0235c service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:54.652183 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483e4a0-413a-43a3-bcc3-812cc6c0235c service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:54.652672 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483e4a0-413a-43a3-bcc3-812cc6c0235c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:54.674584 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b483e4a0-413a-43a3-bcc3-812cc6c0235c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:54.676124 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b483e4a0-413a-43a3-bcc3-812cc6c0235c service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:54.697930 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 835/1656] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:04:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:04:55.925632 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845b549-3f88-4b90-9516-be68fbfd684f None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:55.926503 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845b549-3f88-4b90-9516-be68fbfd684f None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:55.926503 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845b549-3f88-4b90-9516-be68fbfd684f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:56.020476 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-e845b549-3f88-4b90-9516-be68fbfd684f None None] MFA Rules not processed for user `28988559f6b1460f8f7dac1069c33456`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:04:56.027189 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-e845b549-3f88-4b90-9516-be68fbfd684f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:04:56.066140 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:04:56.244028 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7771c5-6d53-4412-9541-db927ec13669 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:56.245408 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 822/1657] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:04:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:04:56.246426 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7771c5-6d53-4412-9541-db927ec13669 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:56.246923 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7771c5-6d53-4412-9541-db927ec13669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:56.356723 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-6f7771c5-6d53-4412-9541-db927ec13669 None None] MFA Rules not processed for user `28988559f6b1460f8f7dac1069c33456`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:04:56.358828 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-6f7771c5-6d53-4412-9541-db927ec13669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:04:56.405066 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 836/1658] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:04:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:04:56.415230 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845b549-3f88-4b90-9516-be68fbfd684f None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:56.417557 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-e845b549-3f88-4b90-9516-be68fbfd684f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:04:56.533169 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d6a5d-c231-453a-8017-701d8f21fd49 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:56.533597 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d6a5d-c231-453a-8017-701d8f21fd49 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:56.534054 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d6a5d-c231-453a-8017-701d8f21fd49 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:56.537066 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 837/1659] 10.222.0.46 () {54 vars in 921 bytes} [Fri Jul 1 04:04:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 04:04:56.577538 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845b549-3f88-4b90-9516-be68fbfd684f None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:56.584762 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef12c0-fe74-4a51-bb91-2cddc2541ee3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:56.585698 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef12c0-fe74-4a51-bb91-2cddc2541ee3 service nova] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:56.586086 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef12c0-fe74-4a51-bb91-2cddc2541ee3 service nova] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:56.586477 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef12c0-fe74-4a51-bb91-2cddc2541ee3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:56.595992 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f1f2e-7748-453c-b83c-efd031afd10e None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:56.596835 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f1f2e-7748-453c-b83c-efd031afd10e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:56.597478 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f1f2e-7748-453c-b83c-efd031afd10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:56.618321 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ef12c0-fe74-4a51-bb91-2cddc2541ee3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:56.621783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ef12c0-fe74-4a51-bb91-2cddc2541ee3 service nova] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:56.667834 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 823/1660] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:04:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:04:56.683232 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-348f1f2e-7748-453c-b83c-efd031afd10e None None] MFA Rules not processed for user `4efe4a6dd11047688892641a936e2914`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:04:56.693601 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-348f1f2e-7748-453c-b83c-efd031afd10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:04:56.830188 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:04:56.874476 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef12c0-fe74-4a51-bb91-2cddc2541ee3 service nova] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:56.877021 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-41ef12c0-fe74-4a51-bb91-2cddc2541ee3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:04:56.909206 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef12c0-fe74-4a51-bb91-2cddc2541ee3 service nova] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:56.922259 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb40d4-811f-47af-98ea-2a4b51bcf17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:56.922783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb40d4-811f-47af-98ea-2a4b51bcf17b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:56.923061 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb40d4-811f-47af-98ea-2a4b51bcf17b admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:56.923956 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb40d4-811f-47af-98ea-2a4b51bcf17b admin admin] PATH_INFO: `/v3/projects/82e4b6ce3f584a9bb4f58e3b90a1b00f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:56.926158 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bb40d4-811f-47af-98ea-2a4b51bcf17b admin admin] RBAC: Authorizing `identity:delete_project(project_id=82e4b6ce3f584a9bb4f58e3b90a1b00f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:56.927367 dv-cinder-846842-8-smb devstack@keystone.service[80376]: WARNING py.warnings [None req-c3bb40d4-811f-47af-98ea-2a4b51bcf17b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 01 04:04:56.927367 dv-cinder-846842-8-smb devstack@keystone.service[80376]: warnings.warn(msg) Jul 01 04:04:56.927367 dv-cinder-846842-8-smb devstack@keystone.service[80376]: Jul 01 04:04:56.928779 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bb40d4-811f-47af-98ea-2a4b51bcf17b admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:56.945428 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 838/1661] 10.222.0.46 () {58 vars in 1018 bytes} [Fri Jul 1 04:04:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:04:57.040155 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71e892-c69a-4a20-8c37-fba4034f5a25 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:57.040618 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71e892-c69a-4a20-8c37-fba4034f5a25 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:57.041085 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71e892-c69a-4a20-8c37-fba4034f5a25 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:57.049075 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 839/1662] 10.222.0.46 () {54 vars in 960 bytes} [Fri Jul 1 04:04:57 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 04:04:57.057045 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fd799-0e83-4937-88a3-965fdee73ad3 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:57.057631 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fd799-0e83-4937-88a3-965fdee73ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:57.058361 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fd799-0e83-4937-88a3-965fdee73ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:57.134554 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-cf2fd799-0e83-4937-88a3-965fdee73ad3 None None] MFA Rules not processed for user `4efe4a6dd11047688892641a936e2914`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:04:57.141571 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-cf2fd799-0e83-4937-88a3-965fdee73ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:04:57.260866 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-c3bb40d4-811f-47af-98ea-2a4b51bcf17b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82e4b6ce3f584a9bb4f58e3b90a1b00f', 'request_id': 'req-c3bb40d4-811f-47af-98ea-2a4b51bcf17b'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:04:57.318987 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-c3bb40d4-811f-47af-98ea-2a4b51bcf17b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82e4b6ce3f584a9bb4f58e3b90a1b00f', 'request_id': 'req-c3bb40d4-811f-47af-98ea-2a4b51bcf17b'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:04:57.347240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-c3bb40d4-811f-47af-98ea-2a4b51bcf17b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82e4b6ce3f584a9bb4f58e3b90a1b00f', 'request_id': 'req-c3bb40d4-811f-47af-98ea-2a4b51bcf17b'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:04:57.363843 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 840/1663] 10.222.0.46 () {58 vars in 1057 bytes} [Fri Jul 1 04:04:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:04:57.375218 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2fd799-0e83-4937-88a3-965fdee73ad3 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:57.444425 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2fd799-0e83-4937-88a3-965fdee73ad3 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:57.479203 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125b062e-0ffa-4c54-9bee-ff85dfc3c0d3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efe4a6dd11047688892641a936e2914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:57.479665 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-c3bb40d4-811f-47af-98ea-2a4b51bcf17b admin admin] The token cache is being invalidate because project 82e4b6ce3f584a9bb4f58e3b90a1b00f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:04:57.480417 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b062e-0ffa-4c54-9bee-ff85dfc3c0d3 service placement] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:57.480880 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b062e-0ffa-4c54-9bee-ff85dfc3c0d3 service placement] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:57.481288 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-c3bb40d4-811f-47af-98ea-2a4b51bcf17b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:04:57.483308 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b062e-0ffa-4c54-9bee-ff85dfc3c0d3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:57.492563 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-c3bb40d4-811f-47af-98ea-2a4b51bcf17b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:04:57.506917 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 824/1664] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:04:56 2022] DELETE /identity/v3/projects/82e4b6ce3f584a9bb4f58e3b90a1b00f => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:04:57.510629 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9090238-c801-4d01-add5-773c85e18f0a None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:57.525190 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9090238-c801-4d01-add5-773c85e18f0a None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:57.526799 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9090238-c801-4d01-add5-773c85e18f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:57.566610 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125b062e-0ffa-4c54-9bee-ff85dfc3c0d3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:57.576773 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125b062e-0ffa-4c54-9bee-ff85dfc3c0d3 service placement] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:57.605977 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 841/1665] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:04:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:04:57.635638 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-e9090238-c801-4d01-add5-773c85e18f0a None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:04:57.642372 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-e9090238-c801-4d01-add5-773c85e18f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:04:57.777193 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:04:57.967782 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 825/1666] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:04:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 451 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:04:57.969488 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff187d5-17ba-43a7-af60-b1ecf58ac608 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:57.969791 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff187d5-17ba-43a7-af60-b1ecf58ac608 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:57.970076 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff187d5-17ba-43a7-af60-b1ecf58ac608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:57.972138 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177af283-846c-4751-8cfa-f5ff345c641f None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:57.973230 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177af283-846c-4751-8cfa-f5ff345c641f None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:57.973230 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177af283-846c-4751-8cfa-f5ff345c641f None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:57.975982 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 826/1667] 10.222.0.46 () {54 vars in 912 bytes} [Fri Jul 1 04:04:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 04:04:57.998004 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448aac61-06b1-4a88-a921-88b822e9bff9 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:57.998004 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448aac61-06b1-4a88-a921-88b822e9bff9 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:57.998576 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448aac61-06b1-4a88-a921-88b822e9bff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:58.037945 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-9ff187d5-17ba-43a7-af60-b1ecf58ac608 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:04:58.051833 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9ff187d5-17ba-43a7-af60-b1ecf58ac608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:04:58.073182 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 842/1668] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:04:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:04:58.080151 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff187d5-17ba-43a7-af60-b1ecf58ac608 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:58.106534 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff187d5-17ba-43a7-af60-b1ecf58ac608 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:58.117907 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe44c0-aaee-4b4c-bb10-08dab5868ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:58.120762 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe44c0-aaee-4b4c-bb10-08dab5868ccc admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:58.121755 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe44c0-aaee-4b4c-bb10-08dab5868ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:58.122046 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe44c0-aaee-4b4c-bb10-08dab5868ccc admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:58.122816 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffe44c0-aaee-4b4c-bb10-08dab5868ccc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:04:58.123126 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffe44c0-aaee-4b4c-bb10-08dab5868ccc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:58.124889 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffe44c0-aaee-4b4c-bb10-08dab5868ccc admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:58.204103 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-448aac61-06b1-4a88-a921-88b822e9bff9 None None] MFA Rules not processed for user `93929b81a23c482ca7ce47e7a94682e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:04:58.206375 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 843/1669] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:04:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:04:58.206589 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-448aac61-06b1-4a88-a921-88b822e9bff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:04:58.213073 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe44c0-aaee-4b4c-bb10-08dab5868ccc admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:58.254610 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe44c0-aaee-4b4c-bb10-08dab5868ccc admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:58.277648 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b1cefe-e5e7-40eb-b7a1-ce8305826f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:58.278353 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1cefe-e5e7-40eb-b7a1-ce8305826f16 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:58.278635 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1cefe-e5e7-40eb-b7a1-ce8305826f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:58.278913 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1cefe-e5e7-40eb-b7a1-ce8305826f16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:58.279664 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b1cefe-e5e7-40eb-b7a1-ce8305826f16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:58.295374 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b1cefe-e5e7-40eb-b7a1-ce8305826f16 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:58.457928 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 827/1670] 10.222.0.46 () {58 vars in 1009 bytes} [Fri Jul 1 04:04:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:04:58.528633 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 844/1671] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:04:58 2022] POST /identity/v3/projects => generated 369 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:04:58.530778 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448aac61-06b1-4a88-a921-88b822e9bff9 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:58.568757 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448aac61-06b1-4a88-a921-88b822e9bff9 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:58.596015 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b1cefe-e5e7-40eb-b7a1-ce8305826f16 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:58.599599 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-51b1cefe-e5e7-40eb-b7a1-ce8305826f16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:04:58.779765 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19fb84-083b-47a1-a75a-80ffb059b730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:58.780652 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19fb84-083b-47a1-a75a-80ffb059b730 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:58.782290 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19fb84-083b-47a1-a75a-80ffb059b730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:58.783754 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19fb84-083b-47a1-a75a-80ffb059b730 admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:58.785655 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19fb84-083b-47a1-a75a-80ffb059b730 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:58.809146 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19fb84-083b-47a1-a75a-80ffb059b730 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:58.873368 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b1cefe-e5e7-40eb-b7a1-ce8305826f16 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:58.886782 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a68fb4-663d-4978-ad53-f4d215361a56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:58.893648 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a68fb4-663d-4978-ad53-f4d215361a56 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:58.894892 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a68fb4-663d-4978-ad53-f4d215361a56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:58.895737 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a68fb4-663d-4978-ad53-f4d215361a56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:58.957780 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a68fb4-663d-4978-ad53-f4d215361a56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:58.961434 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a68fb4-663d-4978-ad53-f4d215361a56 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:59.007697 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 845/1672] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:04:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:04:59.034416 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 828/1673] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:04:58 2022] POST /identity/v3/users => generated 285 bytes in 505 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 04:04:59.040048 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a68fb4-663d-4978-ad53-f4d215361a56 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:59.113619 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a68fb4-663d-4978-ad53-f4d215361a56 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:59.171121 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae893f-a2ae-4124-ab40-be23f34a492d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:59.177000 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae893f-a2ae-4124-ab40-be23f34a492d admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:59.177437 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae893f-a2ae-4124-ab40-be23f34a492d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:59.177920 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae893f-a2ae-4124-ab40-be23f34a492d admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:59.179349 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae893f-a2ae-4124-ab40-be23f34a492d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:59.186783 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae893f-a2ae-4124-ab40-be23f34a492d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:59.208570 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 846/1674] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:04:59.212631 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19fb84-083b-47a1-a75a-80ffb059b730 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:59.240598 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19fb84-083b-47a1-a75a-80ffb059b730 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:59.246926 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02b8aa-da80-4f2a-b446-eed67c4b9e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:59.248118 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02b8aa-da80-4f2a-b446-eed67c4b9e44 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:59.248661 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02b8aa-da80-4f2a-b446-eed67c4b9e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:59.249161 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02b8aa-da80-4f2a-b446-eed67c4b9e44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:59.250162 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b02b8aa-da80-4f2a-b446-eed67c4b9e44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:59.252464 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b02b8aa-da80-4f2a-b446-eed67c4b9e44 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:59.283289 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 829/1675] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:04:59.288038 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae893f-a2ae-4124-ab40-be23f34a492d admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:59.317384 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae893f-a2ae-4124-ab40-be23f34a492d admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:59.336782 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775eaa5e-56a7-4124-9577-53ae8027a8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:59.342726 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775eaa5e-56a7-4124-9577-53ae8027a8eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:59.351166 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775eaa5e-56a7-4124-9577-53ae8027a8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:59.352562 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775eaa5e-56a7-4124-9577-53ae8027a8eb admin admin] PATH_INFO: `/v3/projects/e282379351154cabab81a4b86849d48c/users/fa2604705a534858bbc46c935e58829e/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:59.442370 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775eaa5e-56a7-4124-9577-53ae8027a8eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e282379351154cabab81a4b86849d48c, user_id=fa2604705a534858bbc46c935e58829e, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:59.452529 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775eaa5e-56a7-4124-9577-53ae8027a8eb admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:04:59.630025 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02b8aa-da80-4f2a-b446-eed67c4b9e44 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:04:59.631769 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-2b02b8aa-da80-4f2a-b446-eed67c4b9e44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:04:59.655492 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 847/1676] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:04:59 2022] PUT /identity/v3/projects/e282379351154cabab81a4b86849d48c/users/fa2604705a534858bbc46c935e58829e/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:04:59.657125 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a08f8-fbce-48dd-9597-adbc6770b30d None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:59.657449 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a08f8-fbce-48dd-9597-adbc6770b30d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:59.661958 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a08f8-fbce-48dd-9597-adbc6770b30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:59.667071 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02b8aa-da80-4f2a-b446-eed67c4b9e44 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:04:59.747259 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-6f2a08f8-fbce-48dd-9597-adbc6770b30d None None] MFA Rules not processed for user `fa2604705a534858bbc46c935e58829e`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:04:59.750201 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-6f2a08f8-fbce-48dd-9597-adbc6770b30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:04:59.906828 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9f2a6-13b6-4469-b0f0-a4b64262289d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:04:59.909691 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9f2a6-13b6-4469-b0f0-a4b64262289d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:04:59.910280 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9f2a6-13b6-4469-b0f0-a4b64262289d admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:04:59.910642 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9f2a6-13b6-4469-b0f0-a4b64262289d admin admin] PATH_INFO: `/v3/users/c19568d5200641a5b9e15f79f37b8ada` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:04:59.919033 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c9f2a6-13b6-4469-b0f0-a4b64262289d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c19568d5200641a5b9e15f79f37b8ada)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:04:59.926534 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c9f2a6-13b6-4469-b0f0-a4b64262289d admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:00.001983 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:00.022640 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 848/1677] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:04:59 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:00.029870 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a08f8-fbce-48dd-9597-adbc6770b30d None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:00.054969 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a08f8-fbce-48dd-9597-adbc6770b30d None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:00.070214 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df393a10-f484-4de9-a08e-e5d60716e8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:00.073350 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df393a10-f484-4de9-a08e-e5d60716e8d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:00.074178 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df393a10-f484-4de9-a08e-e5d60716e8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:00.074676 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df393a10-f484-4de9-a08e-e5d60716e8d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:00.076093 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df393a10-f484-4de9-a08e-e5d60716e8d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:00.079976 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df393a10-f484-4de9-a08e-e5d60716e8d0 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:00.340162 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 849/1678] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:05:00 2022] POST /identity/v3/projects => generated 373 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 04:05:00.351721 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df393a10-f484-4de9-a08e-e5d60716e8d0 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:00.374226 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-f2c9f2a6-13b6-4469-b0f0-a4b64262289d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c19568d5200641a5b9e15f79f37b8ada'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:00.376841 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-f2c9f2a6-13b6-4469-b0f0-a4b64262289d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c19568d5200641a5b9e15f79f37b8ada'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:00.491963 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-f2c9f2a6-13b6-4469-b0f0-a4b64262289d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c19568d5200641a5b9e15f79f37b8ada'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:00.493752 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-f2c9f2a6-13b6-4469-b0f0-a4b64262289d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c19568d5200641a5b9e15f79f37b8ada'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:00.543870 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-f2c9f2a6-13b6-4469-b0f0-a4b64262289d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c19568d5200641a5b9e15f79f37b8ada'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:00.632388 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 830/1679] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:04:59 2022] DELETE /identity/v3/users/c19568d5200641a5b9e15f79f37b8ada => generated 0 bytes in 998 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:00.654291 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9f2a6-13b6-4469-b0f0-a4b64262289d admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:00.657627 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-f2c9f2a6-13b6-4469-b0f0-a4b64262289d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:00.704906 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df393a10-f484-4de9-a08e-e5d60716e8d0 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:00.915197 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590b0ee-6146-438a-a405-552537c55624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:00.916978 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590b0ee-6146-438a-a405-552537c55624 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:00.922356 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590b0ee-6146-438a-a405-552537c55624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:00.922356 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590b0ee-6146-438a-a405-552537c55624 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:00.922356 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590b0ee-6146-438a-a405-552537c55624 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:00.922356 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590b0ee-6146-438a-a405-552537c55624 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:00.977751 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9f2a6-13b6-4469-b0f0-a4b64262289d admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:01.016781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d7116-1b18-4e4a-970e-d4a3566d27f0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efe4a6dd11047688892641a936e2914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:01.017462 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d7116-1b18-4e4a-970e-d4a3566d27f0 service placement] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:01.017752 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d7116-1b18-4e4a-970e-d4a3566d27f0 service placement] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:01.018034 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d7116-1b18-4e4a-970e-d4a3566d27f0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:01.020153 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-c25d7116-1b18-4e4a-970e-d4a3566d27f0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:01.062153 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25d7116-1b18-4e4a-970e-d4a3566d27f0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:01.072463 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25d7116-1b18-4e4a-970e-d4a3566d27f0 service placement] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:01.093191 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 850/1680] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:05:00 2022] POST /identity/v3/users => generated 293 bytes in 743 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:05:01.094543 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590b0ee-6146-438a-a405-552537c55624 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:01.098027 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1590b0ee-6146-438a-a405-552537c55624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:01.117596 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590b0ee-6146-438a-a405-552537c55624 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:01.123582 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 831/1681] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:05:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 04:05:01.138780 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e1ac5-04b1-4028-8351-fff4d8e843f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:01.144192 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e1ac5-04b1-4028-8351-fff4d8e843f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:01.146691 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e1ac5-04b1-4028-8351-fff4d8e843f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:01.148792 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e1ac5-04b1-4028-8351-fff4d8e843f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:01.153610 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e1ac5-04b1-4028-8351-fff4d8e843f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:01.160272 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e1ac5-04b1-4028-8351-fff4d8e843f5 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:01.212855 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d7116-1b18-4e4a-970e-d4a3566d27f0 service placement] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:01.218414 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 851/1682] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:05:01 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:05:01.236376 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d7116-1b18-4e4a-970e-d4a3566d27f0 service placement] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:01.260775 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b979da4-0263-4074-8d55-33b1e3e2e426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:01.268294 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b979da4-0263-4074-8d55-33b1e3e2e426 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:01.268757 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b979da4-0263-4074-8d55-33b1e3e2e426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:01.269047 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b979da4-0263-4074-8d55-33b1e3e2e426 admin admin] PATH_INFO: `/v3/projects/c1a1214614d54100a1f878f59baccd1c/users/9c0cff45198944e788ff9ede35332aff/roles/681755518698445fabd9a8accec13c0f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:01.314074 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b979da4-0263-4074-8d55-33b1e3e2e426 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1a1214614d54100a1f878f59baccd1c, user_id=9c0cff45198944e788ff9ede35332aff, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:01.319757 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b979da4-0263-4074-8d55-33b1e3e2e426 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:01.416768 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:01.555702 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 832/1683] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:05:01 2022] PUT /identity/v3/projects/c1a1214614d54100a1f878f59baccd1c/users/9c0cff45198944e788ff9ede35332aff/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:01.558960 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e1ac5-04b1-4028-8351-fff4d8e843f5 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:01.586846 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e1ac5-04b1-4028-8351-fff4d8e843f5 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:01.761449 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b979da4-0263-4074-8d55-33b1e3e2e426 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:01.764550 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-8b979da4-0263-4074-8d55-33b1e3e2e426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:01.791374 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94947e-2f6d-4d84-9e13-6acd68a11c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:01.793436 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94947e-2f6d-4d84-9e13-6acd68a11c57 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:01.793878 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94947e-2f6d-4d84-9e13-6acd68a11c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:01.794298 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94947e-2f6d-4d84-9e13-6acd68a11c57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:01.795211 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a94947e-2f6d-4d84-9e13-6acd68a11c57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:01.797803 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a94947e-2f6d-4d84-9e13-6acd68a11c57 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:01.826184 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 852/1684] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:05:01 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:05:01.830611 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94947e-2f6d-4d84-9e13-6acd68a11c57 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:01.899323 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94947e-2f6d-4d84-9e13-6acd68a11c57 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:01.934216 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa78003-6740-475f-b962-7f4f47580c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:01.935897 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa78003-6740-475f-b962-7f4f47580c8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:01.936430 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa78003-6740-475f-b962-7f4f47580c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:01.936935 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa78003-6740-475f-b962-7f4f47580c8d admin admin] PATH_INFO: `/v3/projects/c1a1214614d54100a1f878f59baccd1c/users/9c0cff45198944e788ff9ede35332aff/roles/681755518698445fabd9a8accec13c0f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:01.955844 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa78003-6740-475f-b962-7f4f47580c8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1a1214614d54100a1f878f59baccd1c, user_id=9c0cff45198944e788ff9ede35332aff, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:01.968592 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa78003-6740-475f-b962-7f4f47580c8d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:02.048905 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 853/1685] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:05:01 2022] PUT /identity/v3/projects/c1a1214614d54100a1f878f59baccd1c/users/9c0cff45198944e788ff9ede35332aff/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:02.063680 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e65149-f734-4c41-8b86-aa94510b1972 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:02.063680 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e65149-f734-4c41-8b86-aa94510b1972 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:02.064527 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e65149-f734-4c41-8b86-aa94510b1972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:02.142452 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b979da4-0263-4074-8d55-33b1e3e2e426 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:02.265709 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-b4e65149-f734-4c41-8b86-aa94510b1972 None None] MFA Rules not processed for user `9c0cff45198944e788ff9ede35332aff`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:02.271259 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b4e65149-f734-4c41-8b86-aa94510b1972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:02.342438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7e716-42dd-48ad-bc3d-9df2f025235f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:02.344530 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7e716-42dd-48ad-bc3d-9df2f025235f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:02.345053 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7e716-42dd-48ad-bc3d-9df2f025235f admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:02.346082 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7e716-42dd-48ad-bc3d-9df2f025235f admin admin] PATH_INFO: `/v3/projects/d8ef90145ef945d98bee84c9a76d204d` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:02.351143 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e7e716-42dd-48ad-bc3d-9df2f025235f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8ef90145ef945d98bee84c9a76d204d)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:02.360916 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e7e716-42dd-48ad-bc3d-9df2f025235f admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:02.408409 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:02.665648 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-24e7e716-42dd-48ad-bc3d-9df2f025235f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8ef90145ef945d98bee84c9a76d204d', 'request_id': 'req-24e7e716-42dd-48ad-bc3d-9df2f025235f'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:02.684812 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-24e7e716-42dd-48ad-bc3d-9df2f025235f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8ef90145ef945d98bee84c9a76d204d', 'request_id': 'req-24e7e716-42dd-48ad-bc3d-9df2f025235f'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:02.714845 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 854/1686] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:02 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 653 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:02.715468 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-24e7e716-42dd-48ad-bc3d-9df2f025235f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8ef90145ef945d98bee84c9a76d204d', 'request_id': 'req-24e7e716-42dd-48ad-bc3d-9df2f025235f'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:02.867419 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-24e7e716-42dd-48ad-bc3d-9df2f025235f admin admin] The token cache is being invalidate because project d8ef90145ef945d98bee84c9a76d204d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:05:02.869806 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-24e7e716-42dd-48ad-bc3d-9df2f025235f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:02.870783 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e65149-f734-4c41-8b86-aa94510b1972 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:02.872917 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b4e65149-f734-4c41-8b86-aa94510b1972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:02.884051 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-24e7e716-42dd-48ad-bc3d-9df2f025235f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:02.895582 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 833/1687] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:05:01 2022] DELETE /identity/v3/projects/d8ef90145ef945d98bee84c9a76d204d => generated 0 bytes in 1132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:02.896789 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7e716-42dd-48ad-bc3d-9df2f025235f admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:02.898524 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-24e7e716-42dd-48ad-bc3d-9df2f025235f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:03.107221 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e65149-f734-4c41-8b86-aa94510b1972 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:03.136405 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7e716-42dd-48ad-bc3d-9df2f025235f admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:03.156008 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a28a9-cf2e-4b8c-acd2-c0290f906923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:03.157213 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a28a9-cf2e-4b8c-acd2-c0290f906923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:03.157649 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a28a9-cf2e-4b8c-acd2-c0290f906923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:03.158072 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a28a9-cf2e-4b8c-acd2-c0290f906923 admin admin] PATH_INFO: `/v3/users/1d02b887793f4ebdb039d5821845f73b` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:03.160259 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a28a9-cf2e-4b8c-acd2-c0290f906923 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d02b887793f4ebdb039d5821845f73b)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:03.162493 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a28a9-cf2e-4b8c-acd2-c0290f906923 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:03.419688 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae216644-0f2d-4e51-b0c0-e7d583b22ca7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:03.420750 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae216644-0f2d-4e51-b0c0-e7d583b22ca7 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:03.421348 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae216644-0f2d-4e51-b0c0-e7d583b22ca7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:03.421948 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae216644-0f2d-4e51-b0c0-e7d583b22ca7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:03.427084 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ae216644-0f2d-4e51-b0c0-e7d583b22ca7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:03.573564 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-cf6a28a9-cf2e-4b8c-acd2-c0290f906923 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d02b887793f4ebdb039d5821845f73b'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:03.574533 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-cf6a28a9-cf2e-4b8c-acd2-c0290f906923 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d02b887793f4ebdb039d5821845f73b'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:03.686394 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae216644-0f2d-4e51-b0c0-e7d583b22ca7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:03.691588 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae216644-0f2d-4e51-b0c0-e7d583b22ca7 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:03.715253 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-cf6a28a9-cf2e-4b8c-acd2-c0290f906923 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d02b887793f4ebdb039d5821845f73b'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:03.720447 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-cf6a28a9-cf2e-4b8c-acd2-c0290f906923 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d02b887793f4ebdb039d5821845f73b'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:03.729070 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-cf6a28a9-cf2e-4b8c-acd2-c0290f906923 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d02b887793f4ebdb039d5821845f73b'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:03.756371 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 855/1688] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:05:02 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 886 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:05:03.787217 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 834/1689] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:05:02 2022] DELETE /identity/v3/users/1d02b887793f4ebdb039d5821845f73b => generated 0 bytes in 891 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:03.940063 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455b7de-f9ac-4303-8fcc-542643ef9583 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:03.940772 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455b7de-f9ac-4303-8fcc-542643ef9583 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:03.941259 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455b7de-f9ac-4303-8fcc-542643ef9583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:04.017000 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-9455b7de-f9ac-4303-8fcc-542643ef9583 None None] MFA Rules not processed for user `71b72d9b9e3a4eb2ba1aae5d8a924afd`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:04.020045 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9455b7de-f9ac-4303-8fcc-542643ef9583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:04.330538 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 856/1690] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:04.345057 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a28a9-cf2e-4b8c-acd2-c0290f906923 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:04.348359 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-cf6a28a9-cf2e-4b8c-acd2-c0290f906923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:04.464472 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455b7de-f9ac-4303-8fcc-542643ef9583 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:04.467407 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9455b7de-f9ac-4303-8fcc-542643ef9583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:04.606798 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a28a9-cf2e-4b8c-acd2-c0290f906923 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:04.639164 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83fa6a3-fd5e-46ed-83b5-538bba7ba9fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:04.639973 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fa6a3-fd5e-46ed-83b5-538bba7ba9fa service nova] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:04.640451 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fa6a3-fd5e-46ed-83b5-538bba7ba9fa service nova] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:04.640982 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fa6a3-fd5e-46ed-83b5-538bba7ba9fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:04.675062 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83fa6a3-fd5e-46ed-83b5-538bba7ba9fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:04.676727 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83fa6a3-fd5e-46ed-83b5-538bba7ba9fa service nova] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:04.690621 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 835/1691] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:05:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:05:04.692477 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83fa6a3-fd5e-46ed-83b5-538bba7ba9fa service nova] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:04.696628 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-e83fa6a3-fd5e-46ed-83b5-538bba7ba9fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:04.796624 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455b7de-f9ac-4303-8fcc-542643ef9583 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:04.815883 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13366914-7246-40d7-847a-23b55a750949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:04.818822 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13366914-7246-40d7-847a-23b55a750949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:04.821875 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13366914-7246-40d7-847a-23b55a750949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:04.827584 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13366914-7246-40d7-847a-23b55a750949 admin admin] PATH_INFO: `/v3/users/e55acb0cf1334916ae20af7cf19d914b` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:04.832236 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13366914-7246-40d7-847a-23b55a750949 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e55acb0cf1334916ae20af7cf19d914b)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:04.837568 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13366914-7246-40d7-847a-23b55a750949 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:04.897643 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83fa6a3-fd5e-46ed-83b5-538bba7ba9fa service nova] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:04.911108 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033c401-2b9a-4c5a-9463-f553c15621d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:04.917703 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:04.918319 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033c401-2b9a-4c5a-9463-f553c15621d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:04.920581 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033c401-2b9a-4c5a-9463-f553c15621d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:04.924852 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033c401-2b9a-4c5a-9463-f553c15621d4 admin admin] PATH_INFO: `/v3/users/7185d7002d22492394ce8730919dc0c0` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:04.940088 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6033c401-2b9a-4c5a-9463-f553c15621d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7185d7002d22492394ce8730919dc0c0)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:04.951158 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6033c401-2b9a-4c5a-9463-f553c15621d4 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:05.303303 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-13366914-7246-40d7-847a-23b55a750949 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e55acb0cf1334916ae20af7cf19d914b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:05.304644 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-13366914-7246-40d7-847a-23b55a750949 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e55acb0cf1334916ae20af7cf19d914b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:05.305556 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-6033c401-2b9a-4c5a-9463-f553c15621d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7185d7002d22492394ce8730919dc0c0'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:05.308039 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-6033c401-2b9a-4c5a-9463-f553c15621d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7185d7002d22492394ce8730919dc0c0'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:05.331678 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-13366914-7246-40d7-847a-23b55a750949 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e55acb0cf1334916ae20af7cf19d914b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:05.347103 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-13366914-7246-40d7-847a-23b55a750949 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e55acb0cf1334916ae20af7cf19d914b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:05.347934 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-13366914-7246-40d7-847a-23b55a750949 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e55acb0cf1334916ae20af7cf19d914b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:05.474996 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-6033c401-2b9a-4c5a-9463-f553c15621d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7185d7002d22492394ce8730919dc0c0'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:05.479066 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-6033c401-2b9a-4c5a-9463-f553c15621d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7185d7002d22492394ce8730919dc0c0'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:05.492243 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-6033c401-2b9a-4c5a-9463-f553c15621d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7185d7002d22492394ce8730919dc0c0'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:05.565993 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 836/1692] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:05:04 2022] DELETE /identity/v3/users/7185d7002d22492394ce8730919dc0c0 => generated 0 bytes in 865 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:05.565993 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033c401-2b9a-4c5a-9463-f553c15621d4 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:05.569537 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-6033c401-2b9a-4c5a-9463-f553c15621d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:05.660636 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 857/1693] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:05:04 2022] DELETE /identity/v3/users/e55acb0cf1334916ae20af7cf19d914b => generated 0 bytes in 1198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:05.662106 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b54b56-94bf-4a5a-8fb5-106c29925d3a None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:05.662390 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b54b56-94bf-4a5a-8fb5-106c29925d3a None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:05.662660 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b54b56-94bf-4a5a-8fb5-106c29925d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:05.710978 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-f7b54b56-94bf-4a5a-8fb5-106c29925d3a None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:05.717188 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f7b54b56-94bf-4a5a-8fb5-106c29925d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:05.851709 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033c401-2b9a-4c5a-9463-f553c15621d4 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:05.867901 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:05.929699 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 858/1694] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:05.933045 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9f7a3-7b70-4da9-b255-ed9b3838c652 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:05.933436 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9f7a3-7b70-4da9-b255-ed9b3838c652 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:05.938989 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9f7a3-7b70-4da9-b255-ed9b3838c652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:06.014172 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-9ec9f7a3-7b70-4da9-b255-ed9b3838c652 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:06.015989 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9ec9f7a3-7b70-4da9-b255-ed9b3838c652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:06.043648 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 859/1695] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:06.044857 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9f7a3-7b70-4da9-b255-ed9b3838c652 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:06.050849 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9ec9f7a3-7b70-4da9-b255-ed9b3838c652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:06.052290 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5063677-d7e3-40a1-8634-c354e7136fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:06.053343 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5063677-d7e3-40a1-8634-c354e7136fd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:06.053914 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5063677-d7e3-40a1-8634-c354e7136fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:06.061995 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5063677-d7e3-40a1-8634-c354e7136fd9 admin admin] PATH_INFO: `/v3/projects/01bb02fda8124dd79093581c1f6eb14d` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:06.066815 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5063677-d7e3-40a1-8634-c354e7136fd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01bb02fda8124dd79093581c1f6eb14d)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:06.074509 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5063677-d7e3-40a1-8634-c354e7136fd9 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:06.214803 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9f7a3-7b70-4da9-b255-ed9b3838c652 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:06.239511 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ca59e-98fd-4574-8a34-caa3dd96fc9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:06.239511 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ca59e-98fd-4574-8a34-caa3dd96fc9e service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:06.239511 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ca59e-98fd-4574-8a34-caa3dd96fc9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:06.239511 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ca59e-98fd-4574-8a34-caa3dd96fc9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:06.260345 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ca59e-98fd-4574-8a34-caa3dd96fc9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:06.262476 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ca59e-98fd-4574-8a34-caa3dd96fc9e service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:06.275088 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 860/1696] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:05:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:05:06.276333 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ca59e-98fd-4574-8a34-caa3dd96fc9e service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:06.277973 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-170ca59e-98fd-4574-8a34-caa3dd96fc9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:06.341661 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ca59e-98fd-4574-8a34-caa3dd96fc9e service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:06.344239 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94083737-bae6-4a76-a919-46d9cf51febf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:06.344239 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94083737-bae6-4a76-a919-46d9cf51febf service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:06.344503 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94083737-bae6-4a76-a919-46d9cf51febf service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:06.344907 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94083737-bae6-4a76-a919-46d9cf51febf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:06.371105 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94083737-bae6-4a76-a919-46d9cf51febf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:06.372650 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94083737-bae6-4a76-a919-46d9cf51febf service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:06.399262 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 861/1697] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:05:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:05:06.400532 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94083737-bae6-4a76-a919-46d9cf51febf service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:06.402732 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-94083737-bae6-4a76-a919-46d9cf51febf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:06.446027 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-f5063677-d7e3-40a1-8634-c354e7136fd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01bb02fda8124dd79093581c1f6eb14d', 'request_id': 'req-f5063677-d7e3-40a1-8634-c354e7136fd9'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:06.453477 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94083737-bae6-4a76-a919-46d9cf51febf service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:06.494882 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-f5063677-d7e3-40a1-8634-c354e7136fd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01bb02fda8124dd79093581c1f6eb14d', 'request_id': 'req-f5063677-d7e3-40a1-8634-c354e7136fd9'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:06.514318 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-f5063677-d7e3-40a1-8634-c354e7136fd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01bb02fda8124dd79093581c1f6eb14d', 'request_id': 'req-f5063677-d7e3-40a1-8634-c354e7136fd9'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:06.633060 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b48ce99-b59d-4a3a-90e5-4849910a1009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:06.634037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48ce99-b59d-4a3a-90e5-4849910a1009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:06.634325 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48ce99-b59d-4a3a-90e5-4849910a1009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:06.634605 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48ce99-b59d-4a3a-90e5-4849910a1009 admin admin] PATH_INFO: `/v3/users/fa2604705a534858bbc46c935e58829e` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:06.639712 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b48ce99-b59d-4a3a-90e5-4849910a1009 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa2604705a534858bbc46c935e58829e)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:06.641894 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b48ce99-b59d-4a3a-90e5-4849910a1009 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:06.780938 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-f5063677-d7e3-40a1-8634-c354e7136fd9 admin admin] The token cache is being invalidate because project 01bb02fda8124dd79093581c1f6eb14d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:05:06.781559 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-f5063677-d7e3-40a1-8634-c354e7136fd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:06.782807 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-f5063677-d7e3-40a1-8634-c354e7136fd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:06.785941 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 837/1698] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:05:05 2022] DELETE /identity/v3/projects/01bb02fda8124dd79093581c1f6eb14d => generated 0 bytes in 1228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:06.788745 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9fc49-94b4-48ef-9a79-8d1fd2c30f91 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:06.789252 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9fc49-94b4-48ef-9a79-8d1fd2c30f91 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:06.789699 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9fc49-94b4-48ef-9a79-8d1fd2c30f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:06.891616 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-cdc9fc49-94b4-48ef-9a79-8d1fd2c30f91 None None] MFA Rules not processed for user `a61e50919a13413c9f641f23f6b30217`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:06.893627 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-cdc9fc49-94b4-48ef-9a79-8d1fd2c30f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:06.965508 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-3b48ce99-b59d-4a3a-90e5-4849910a1009 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa2604705a534858bbc46c935e58829e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:06.966303 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-3b48ce99-b59d-4a3a-90e5-4849910a1009 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa2604705a534858bbc46c935e58829e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:06.984286 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-3b48ce99-b59d-4a3a-90e5-4849910a1009 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa2604705a534858bbc46c935e58829e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:07.011442 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-3b48ce99-b59d-4a3a-90e5-4849910a1009 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa2604705a534858bbc46c935e58829e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:07.011442 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-3b48ce99-b59d-4a3a-90e5-4849910a1009 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa2604705a534858bbc46c935e58829e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:07.119137 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 862/1699] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:05:06 2022] DELETE /identity/v3/users/fa2604705a534858bbc46c935e58829e => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:07.121457 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d2415-1a1c-4aa8-8160-43f046af2b7a None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:07.121784 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d2415-1a1c-4aa8-8160-43f046af2b7a None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:07.122063 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d2415-1a1c-4aa8-8160-43f046af2b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:07.180175 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 838/1700] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:07.184679 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0740d-b7b6-4595-bb8d-a9b564fccb15 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:07.184927 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0740d-b7b6-4595-bb8d-a9b564fccb15 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:07.185678 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0740d-b7b6-4595-bb8d-a9b564fccb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:07.208417 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-df4d2415-1a1c-4aa8-8160-43f046af2b7a None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:07.209966 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-df4d2415-1a1c-4aa8-8160-43f046af2b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:07.245550 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-75b0740d-b7b6-4595-bb8d-a9b564fccb15 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:07.255087 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-75b0740d-b7b6-4595-bb8d-a9b564fccb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:07.414292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 839/1701] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:07.418330 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5556066-0acd-4265-ab47-2af4a89aa9a1 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:07.420688 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5556066-0acd-4265-ab47-2af4a89aa9a1 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:07.420688 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5556066-0acd-4265-ab47-2af4a89aa9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:07.446292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-b5556066-0acd-4265-ab47-2af4a89aa9a1 None None] MFA Rules not processed for user `a61e50919a13413c9f641f23f6b30217`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:07.449202 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-b5556066-0acd-4265-ab47-2af4a89aa9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:07.485082 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 863/1702] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:07.505759 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d2415-1a1c-4aa8-8160-43f046af2b7a None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:07.515248 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-df4d2415-1a1c-4aa8-8160-43f046af2b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:07.616282 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 840/1703] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:07.632034 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837246c4-9040-456e-a141-3c054fc87bad None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:07.632843 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837246c4-9040-456e-a141-3c054fc87bad None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:07.633456 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837246c4-9040-456e-a141-3c054fc87bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:07.680978 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d2415-1a1c-4aa8-8160-43f046af2b7a None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:07.681545 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-837246c4-9040-456e-a141-3c054fc87bad None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:07.684662 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-837246c4-9040-456e-a141-3c054fc87bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:07.686478 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf992d-bd27-4407-8bc0-32356487411d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:07.687441 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf992d-bd27-4407-8bc0-32356487411d service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:07.687910 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf992d-bd27-4407-8bc0-32356487411d service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:07.688341 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf992d-bd27-4407-8bc0-32356487411d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:07.708383 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 841/1704] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:07.709112 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837246c4-9040-456e-a141-3c054fc87bad None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:07.714451 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-837246c4-9040-456e-a141-3c054fc87bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:07.731709 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf992d-bd27-4407-8bc0-32356487411d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:07.736225 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf992d-bd27-4407-8bc0-32356487411d service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:07.746490 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837246c4-9040-456e-a141-3c054fc87bad None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:07.753313 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 864/1705] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:05:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:05:07.754717 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf992d-bd27-4407-8bc0-32356487411d service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:07.756564 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-6adf992d-bd27-4407-8bc0-32356487411d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:07.761450 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41398f0b-6d3b-46ef-9579-2f3362102af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:07.762503 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41398f0b-6d3b-46ef-9579-2f3362102af4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:07.764334 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41398f0b-6d3b-46ef-9579-2f3362102af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:07.766965 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41398f0b-6d3b-46ef-9579-2f3362102af4 admin admin] PATH_INFO: `/v3/projects/e3f110a8ac144bf285d17c2934f6b796` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:07.770217 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41398f0b-6d3b-46ef-9579-2f3362102af4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3f110a8ac144bf285d17c2934f6b796)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:07.772954 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41398f0b-6d3b-46ef-9579-2f3362102af4 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:07.922720 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf992d-bd27-4407-8bc0-32356487411d service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:07.929250 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52639c23-a0ae-43f0-813f-556f40b6ca25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:07.930397 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52639c23-a0ae-43f0-813f-556f40b6ca25 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:07.930848 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52639c23-a0ae-43f0-813f-556f40b6ca25 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:07.931383 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52639c23-a0ae-43f0-813f-556f40b6ca25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:07.944601 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52639c23-a0ae-43f0-813f-556f40b6ca25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:07.949633 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52639c23-a0ae-43f0-813f-556f40b6ca25 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:07.960544 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 865/1706] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:05:07 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:05:07.961724 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52639c23-a0ae-43f0-813f-556f40b6ca25 service nova] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:07.984536 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52639c23-a0ae-43f0-813f-556f40b6ca25 service nova] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:08.008759 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780bc17-45e9-4d9c-8905-c4bcb3340670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:08.008759 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780bc17-45e9-4d9c-8905-c4bcb3340670 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:08.008759 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780bc17-45e9-4d9c-8905-c4bcb3340670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:08.008759 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780bc17-45e9-4d9c-8905-c4bcb3340670 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:08.009841 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6780bc17-45e9-4d9c-8905-c4bcb3340670 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:05:08.009841 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6780bc17-45e9-4d9c-8905-c4bcb3340670 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:08.009841 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6780bc17-45e9-4d9c-8905-c4bcb3340670 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:08.044147 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 866/1707] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:05:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:05:08.045194 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780bc17-45e9-4d9c-8905-c4bcb3340670 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:08.056826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780bc17-45e9-4d9c-8905-c4bcb3340670 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:08.063045 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90330e55-d8d0-4e61-b149-8e8d39142565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:08.063775 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90330e55-d8d0-4e61-b149-8e8d39142565 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:08.064268 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90330e55-d8d0-4e61-b149-8e8d39142565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:08.064636 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90330e55-d8d0-4e61-b149-8e8d39142565 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:08.065581 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90330e55-d8d0-4e61-b149-8e8d39142565 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:08.067610 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90330e55-d8d0-4e61-b149-8e8d39142565 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:08.156834 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-41398f0b-6d3b-46ef-9579-2f3362102af4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3f110a8ac144bf285d17c2934f6b796', 'request_id': 'req-41398f0b-6d3b-46ef-9579-2f3362102af4'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:08.166152 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-41398f0b-6d3b-46ef-9579-2f3362102af4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3f110a8ac144bf285d17c2934f6b796', 'request_id': 'req-41398f0b-6d3b-46ef-9579-2f3362102af4'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:08.175655 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-41398f0b-6d3b-46ef-9579-2f3362102af4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3f110a8ac144bf285d17c2934f6b796', 'request_id': 'req-41398f0b-6d3b-46ef-9579-2f3362102af4'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:08.184548 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 867/1708] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:05:08 2022] POST /identity/v3/projects => generated 387 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:05:08.186641 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90330e55-d8d0-4e61-b149-8e8d39142565 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:08.328196 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-41398f0b-6d3b-46ef-9579-2f3362102af4 admin admin] The token cache is being invalidate because project e3f110a8ac144bf285d17c2934f6b796 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:05:08.328196 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-41398f0b-6d3b-46ef-9579-2f3362102af4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:08.328196 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-41398f0b-6d3b-46ef-9579-2f3362102af4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:08.328913 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 842/1709] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:05:07 2022] DELETE /identity/v3/projects/e3f110a8ac144bf285d17c2934f6b796 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:08.334514 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41398f0b-6d3b-46ef-9579-2f3362102af4 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:08.336625 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-41398f0b-6d3b-46ef-9579-2f3362102af4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:08.420937 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90330e55-d8d0-4e61-b149-8e8d39142565 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:08.440840 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6578744d-b571-44a0-88d9-69abb7665d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:08.441703 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6578744d-b571-44a0-88d9-69abb7665d81 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:08.444193 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6578744d-b571-44a0-88d9-69abb7665d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:08.445466 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6578744d-b571-44a0-88d9-69abb7665d81 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:08.446836 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:08.448136 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6578744d-b571-44a0-88d9-69abb7665d81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:08.453947 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6578744d-b571-44a0-88d9-69abb7665d81 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:08.471796 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41398f0b-6d3b-46ef-9579-2f3362102af4 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:08.480594 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a8a118-891c-4d1b-823c-da57adef4bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:08.481971 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8a118-891c-4d1b-823c-da57adef4bec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:08.481971 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8a118-891c-4d1b-823c-da57adef4bec admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:08.482687 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8a118-891c-4d1b-823c-da57adef4bec admin admin] PATH_INFO: `/v3/projects/5bcfece7e0a24ee4a062fd578f53ae4b` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:08.484284 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a8a118-891c-4d1b-823c-da57adef4bec admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bcfece7e0a24ee4a062fd578f53ae4b)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:08.486939 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a8a118-891c-4d1b-823c-da57adef4bec admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:08.617728 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 868/1710] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:05:08 2022] POST /identity/v3/users => generated 294 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:05:08.621977 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6578744d-b571-44a0-88d9-69abb7665d81 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:08.631945 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-6578744d-b571-44a0-88d9-69abb7665d81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:08.704621 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6578744d-b571-44a0-88d9-69abb7665d81 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:08.727007 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0802bf-5055-4671-9620-9c165d71b327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:08.727007 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0802bf-5055-4671-9620-9c165d71b327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:08.727007 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0802bf-5055-4671-9620-9c165d71b327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:08.727007 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0802bf-5055-4671-9620-9c165d71b327 admin admin] PATH_INFO: `/v3/users/f315bddd883a49d08477641485051d38` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:08.730972 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0802bf-5055-4671-9620-9c165d71b327 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f315bddd883a49d08477641485051d38)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:08.733038 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0802bf-5055-4671-9620-9c165d71b327 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:08.765757 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-83a8a118-891c-4d1b-823c-da57adef4bec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bcfece7e0a24ee4a062fd578f53ae4b', 'request_id': 'req-83a8a118-891c-4d1b-823c-da57adef4bec'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:08.790758 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-83a8a118-891c-4d1b-823c-da57adef4bec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bcfece7e0a24ee4a062fd578f53ae4b', 'request_id': 'req-83a8a118-891c-4d1b-823c-da57adef4bec'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:08.812733 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-83a8a118-891c-4d1b-823c-da57adef4bec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bcfece7e0a24ee4a062fd578f53ae4b', 'request_id': 'req-83a8a118-891c-4d1b-823c-da57adef4bec'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:08.880488 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:09.030297 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-83a8a118-891c-4d1b-823c-da57adef4bec admin admin] The token cache is being invalidate because project 5bcfece7e0a24ee4a062fd578f53ae4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:05:09.031632 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-83a8a118-891c-4d1b-823c-da57adef4bec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:09.038913 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-83a8a118-891c-4d1b-823c-da57adef4bec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:09.038913 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 843/1711] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:05:08 2022] DELETE /identity/v3/projects/5bcfece7e0a24ee4a062fd578f53ae4b => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:09.044111 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a8a118-891c-4d1b-823c-da57adef4bec admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:09.048073 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-83a8a118-891c-4d1b-823c-da57adef4bec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:09.257513 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-bc0802bf-5055-4671-9620-9c165d71b327 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f315bddd883a49d08477641485051d38'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:09.263284 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-bc0802bf-5055-4671-9620-9c165d71b327 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f315bddd883a49d08477641485051d38'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:09.315525 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-bc0802bf-5055-4671-9620-9c165d71b327 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f315bddd883a49d08477641485051d38'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:09.329698 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-bc0802bf-5055-4671-9620-9c165d71b327 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f315bddd883a49d08477641485051d38'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:09.332300 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-bc0802bf-5055-4671-9620-9c165d71b327 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f315bddd883a49d08477641485051d38'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:09.390108 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a8a118-891c-4d1b-823c-da57adef4bec admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:09.400718 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb72baa-78a4-4351-a62a-a0544e2bfc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:09.403678 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb72baa-78a4-4351-a62a-a0544e2bfc5e admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:09.404273 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb72baa-78a4-4351-a62a-a0544e2bfc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:09.404851 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb72baa-78a4-4351-a62a-a0544e2bfc5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:09.406421 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb72baa-78a4-4351-a62a-a0544e2bfc5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:09.410727 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb72baa-78a4-4351-a62a-a0544e2bfc5e admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:09.443885 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 844/1712] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:05:09.445444 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb72baa-78a4-4351-a62a-a0544e2bfc5e admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:09.449155 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-fdb72baa-78a4-4351-a62a-a0544e2bfc5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:09.465842 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 869/1713] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:05:08 2022] DELETE /identity/v3/users/f315bddd883a49d08477641485051d38 => generated 0 bytes in 843 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:09.470087 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d2756-58b9-4170-9df5-43be8bb2dcf6 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:09.470087 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d2756-58b9-4170-9df5-43be8bb2dcf6 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:09.470087 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d2756-58b9-4170-9df5-43be8bb2dcf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:09.490482 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:09.519102 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb72baa-78a4-4351-a62a-a0544e2bfc5e admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:09.539239 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-b16d2756-58b9-4170-9df5-43be8bb2dcf6 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:09.545264 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b16d2756-58b9-4170-9df5-43be8bb2dcf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:09.779428 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 870/1714] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:09.782848 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2a895-dfca-45a7-a324-e7f627b0bfcd None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:09.792871 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2a895-dfca-45a7-a324-e7f627b0bfcd None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:09.793351 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2a895-dfca-45a7-a324-e7f627b0bfcd None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:09.796813 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 871/1715] 10.222.0.46 () {54 vars in 912 bytes} [Fri Jul 1 04:05:09 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 04:05:09.799866 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c27f22-9d87-4ddc-9c5a-b29e24728e11 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:09.800837 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c27f22-9d87-4ddc-9c5a-b29e24728e11 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:09.801689 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c27f22-9d87-4ddc-9c5a-b29e24728e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:09.811388 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b4ac2-9f16-4f58-84a4-407546cfa553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:09.811388 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b4ac2-9f16-4f58-84a4-407546cfa553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:09.811388 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b4ac2-9f16-4f58-84a4-407546cfa553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:09.812410 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b4ac2-9f16-4f58-84a4-407546cfa553 admin admin] PATH_INFO: `/v3/projects/e282379351154cabab81a4b86849d48c` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:09.815391 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189b4ac2-9f16-4f58-84a4-407546cfa553 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e282379351154cabab81a4b86849d48c)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:09.821222 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189b4ac2-9f16-4f58-84a4-407546cfa553 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:09.878334 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-49c27f22-9d87-4ddc-9c5a-b29e24728e11 None None] MFA Rules not processed for user `dd41221abea04808bed5ef4ac4528c62`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:09.902870 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-49c27f22-9d87-4ddc-9c5a-b29e24728e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:10.075080 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-189b4ac2-9f16-4f58-84a4-407546cfa553 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e282379351154cabab81a4b86849d48c', 'request_id': 'req-189b4ac2-9f16-4f58-84a4-407546cfa553'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:10.084150 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-189b4ac2-9f16-4f58-84a4-407546cfa553 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e282379351154cabab81a4b86849d48c', 'request_id': 'req-189b4ac2-9f16-4f58-84a4-407546cfa553'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:10.109363 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-189b4ac2-9f16-4f58-84a4-407546cfa553 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e282379351154cabab81a4b86849d48c', 'request_id': 'req-189b4ac2-9f16-4f58-84a4-407546cfa553'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:10.169522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 872/1716] 10.222.0.46 () {58 vars in 1009 bytes} [Fri Jul 1 04:05:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:10.169522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c27f22-9d87-4ddc-9c5a-b29e24728e11 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:10.170634 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-49c27f22-9d87-4ddc-9c5a-b29e24728e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:10.231034 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c27f22-9d87-4ddc-9c5a-b29e24728e11 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:10.325238 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-189b4ac2-9f16-4f58-84a4-407546cfa553 admin admin] The token cache is being invalidate because project e282379351154cabab81a4b86849d48c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:05:10.325548 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-189b4ac2-9f16-4f58-84a4-407546cfa553 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:10.326447 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-189b4ac2-9f16-4f58-84a4-407546cfa553 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:10.329894 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5c0b7-12cc-4b6f-9cf5-0a11d4cf3d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:10.330237 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 845/1717] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:05:09 2022] DELETE /identity/v3/projects/e282379351154cabab81a4b86849d48c => generated 0 bytes in 886 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:10.333513 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166004d-4972-4000-abf0-25cd10c66ac8 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:10.334047 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166004d-4972-4000-abf0-25cd10c66ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:10.334602 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166004d-4972-4000-abf0-25cd10c66ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:10.336515 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5c0b7-12cc-4b6f-9cf5-0a11d4cf3d6d admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:10.336769 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5c0b7-12cc-4b6f-9cf5-0a11d4cf3d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:10.337396 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5c0b7-12cc-4b6f-9cf5-0a11d4cf3d6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:10.339741 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca5c0b7-12cc-4b6f-9cf5-0a11d4cf3d6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:10.346110 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca5c0b7-12cc-4b6f-9cf5-0a11d4cf3d6d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:10.370066 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-9166004d-4972-4000-abf0-25cd10c66ac8 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:10.374522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 873/1718] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:05:10.376522 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-9166004d-4972-4000-abf0-25cd10c66ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:10.379613 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703de762-4321-4d3b-8ced-3706a5f41d39 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:10.381135 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703de762-4321-4d3b-8ced-3706a5f41d39 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:10.381883 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703de762-4321-4d3b-8ced-3706a5f41d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:10.399643 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 846/1719] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:10.401043 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166004d-4972-4000-abf0-25cd10c66ac8 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:10.405963 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-9166004d-4972-4000-abf0-25cd10c66ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:10.449811 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-703de762-4321-4d3b-8ced-3706a5f41d39 None None] MFA Rules not processed for user `93929b81a23c482ca7ce47e7a94682e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:10.451925 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-703de762-4321-4d3b-8ced-3706a5f41d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:10.454518 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166004d-4972-4000-abf0-25cd10c66ac8 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:10.472112 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae941fbd-aa69-489a-9a47-f02196cb5d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:10.474404 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae941fbd-aa69-489a-9a47-f02196cb5d7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:10.475413 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae941fbd-aa69-489a-9a47-f02196cb5d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:10.476304 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae941fbd-aa69-489a-9a47-f02196cb5d7e admin admin] PATH_INFO: `/v3/users/9c0cff45198944e788ff9ede35332aff` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:10.493243 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae941fbd-aa69-489a-9a47-f02196cb5d7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c0cff45198944e788ff9ede35332aff)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:10.501130 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae941fbd-aa69-489a-9a47-f02196cb5d7e admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:10.592006 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 874/1720] 10.222.0.46 () {58 vars in 1009 bytes} [Fri Jul 1 04:05:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:10.593124 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703de762-4321-4d3b-8ced-3706a5f41d39 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:10.594965 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-703de762-4321-4d3b-8ced-3706a5f41d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:10.612062 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703de762-4321-4d3b-8ced-3706a5f41d39 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:10.618180 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629956f5-8afb-4707-86d5-cbfee9dfe305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:10.619327 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629956f5-8afb-4707-86d5-cbfee9dfe305 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:10.620356 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629956f5-8afb-4707-86d5-cbfee9dfe305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:10.620734 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629956f5-8afb-4707-86d5-cbfee9dfe305 admin admin] PATH_INFO: `/v3/projects/35809a703a094f388be53b29d52a91fa/users/7a4ba7744acd4507bb901102cb13ed8b/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:10.648443 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629956f5-8afb-4707-86d5-cbfee9dfe305 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35809a703a094f388be53b29d52a91fa, user_id=7a4ba7744acd4507bb901102cb13ed8b, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:10.655228 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629956f5-8afb-4707-86d5-cbfee9dfe305 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:10.836260 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 875/1721] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:05:10 2022] PUT /identity/v3/projects/35809a703a094f388be53b29d52a91fa/users/7a4ba7744acd4507bb901102cb13ed8b/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:10.846749 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629956f5-8afb-4707-86d5-cbfee9dfe305 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:10.860601 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-ae941fbd-aa69-489a-9a47-f02196cb5d7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c0cff45198944e788ff9ede35332aff'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:10.861434 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-ae941fbd-aa69-489a-9a47-f02196cb5d7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c0cff45198944e788ff9ede35332aff'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:10.954429 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-ae941fbd-aa69-489a-9a47-f02196cb5d7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c0cff45198944e788ff9ede35332aff'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:10.955096 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-ae941fbd-aa69-489a-9a47-f02196cb5d7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c0cff45198944e788ff9ede35332aff'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:10.974423 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-ae941fbd-aa69-489a-9a47-f02196cb5d7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c0cff45198944e788ff9ede35332aff'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:11.035716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 847/1722] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:05:10 2022] DELETE /identity/v3/users/9c0cff45198944e788ff9ede35332aff => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:11.036863 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae941fbd-aa69-489a-9a47-f02196cb5d7e admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:11.039105 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-ae941fbd-aa69-489a-9a47-f02196cb5d7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:11.041135 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629956f5-8afb-4707-86d5-cbfee9dfe305 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:11.263516 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26cd14d-476c-4d7e-abc8-2566939f5584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:11.265702 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26cd14d-476c-4d7e-abc8-2566939f5584 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:11.266768 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26cd14d-476c-4d7e-abc8-2566939f5584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:11.267942 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26cd14d-476c-4d7e-abc8-2566939f5584 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:11.271053 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26cd14d-476c-4d7e-abc8-2566939f5584 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:05:11.271546 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26cd14d-476c-4d7e-abc8-2566939f5584 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:11.292820 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26cd14d-476c-4d7e-abc8-2566939f5584 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:11.293254 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae941fbd-aa69-489a-9a47-f02196cb5d7e admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:11.293254 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b747a57-9978-4bec-b5f7-9711f6c7dbb8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83787880173b459c8975b834bd47a51a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:11.293254 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b747a57-9978-4bec-b5f7-9711f6c7dbb8 service swift] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:11.293254 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b747a57-9978-4bec-b5f7-9711f6c7dbb8 service swift] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:11.294181 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b747a57-9978-4bec-b5f7-9711f6c7dbb8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:11.301586 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-3b747a57-9978-4bec-b5f7-9711f6c7dbb8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:11.309387 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 876/1723] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:05:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 470 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:05:11.310913 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f8fcc-3ac9-401e-93f3-1eb8ee29b8c3 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:11.311290 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f8fcc-3ac9-401e-93f3-1eb8ee29b8c3 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:11.314032 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f8fcc-3ac9-401e-93f3-1eb8ee29b8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:11.376625 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-986f8fcc-3ac9-401e-93f3-1eb8ee29b8c3 None None] MFA Rules not processed for user `7a4ba7744acd4507bb901102cb13ed8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:11.378240 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-986f8fcc-3ac9-401e-93f3-1eb8ee29b8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:11.397935 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b747a57-9978-4bec-b5f7-9711f6c7dbb8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:11.400226 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b747a57-9978-4bec-b5f7-9711f6c7dbb8 service swift] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:11.412229 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 848/1724] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Jul 1 04:05:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 04:05:11.413396 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b747a57-9978-4bec-b5f7-9711f6c7dbb8 service swift] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:11.415557 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-3b747a57-9978-4bec-b5f7-9711f6c7dbb8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:11.578947 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b747a57-9978-4bec-b5f7-9711f6c7dbb8 service swift] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:11.588573 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8226f70-6552-4812-b8f0-090381339c96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:11.589566 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8226f70-6552-4812-b8f0-090381339c96 service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:11.590009 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8226f70-6552-4812-b8f0-090381339c96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:11.590441 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8226f70-6552-4812-b8f0-090381339c96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:11.592923 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-f8226f70-6552-4812-b8f0-090381339c96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:11.609744 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8226f70-6552-4812-b8f0-090381339c96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:11.611573 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8226f70-6552-4812-b8f0-090381339c96 service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:11.631700 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 849/1725] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:05:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:05:11.632887 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8226f70-6552-4812-b8f0-090381339c96 service neutron] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:11.635034 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-f8226f70-6552-4812-b8f0-090381339c96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:11.656054 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 877/1726] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:11.657842 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f8fcc-3ac9-401e-93f3-1eb8ee29b8c3 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:11.660910 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-986f8fcc-3ac9-401e-93f3-1eb8ee29b8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:11.723010 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f8fcc-3ac9-401e-93f3-1eb8ee29b8c3 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:11.724022 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8226f70-6552-4812-b8f0-090381339c96 service neutron] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:11.749188 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff756d4e-e3ab-44a4-b5ff-6869d89a917b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:11.750713 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff756d4e-e3ab-44a4-b5ff-6869d89a917b admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:11.751278 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff756d4e-e3ab-44a4-b5ff-6869d89a917b admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:11.751785 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff756d4e-e3ab-44a4-b5ff-6869d89a917b admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:11.757428 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff756d4e-e3ab-44a4-b5ff-6869d89a917b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:11.762557 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d9d6b-b453-41a7-b3db-7b3653f492ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:11.763337 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d9d6b-b453-41a7-b3db-7b3653f492ed admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:11.763694 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d9d6b-b453-41a7-b3db-7b3653f492ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:11.764010 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d9d6b-b453-41a7-b3db-7b3653f492ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:11.764777 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435d9d6b-b453-41a7-b3db-7b3653f492ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:11.767110 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435d9d6b-b453-41a7-b3db-7b3653f492ed admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:11.770725 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff756d4e-e3ab-44a4-b5ff-6869d89a917b admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:12.042489 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 850/1727] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:05:11 2022] POST /identity/v3/projects => generated 357 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:05:12.044219 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d9d6b-b453-41a7-b3db-7b3653f492ed admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:12.099025 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 878/1728] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:05:11 2022] POST /identity/v3/projects => generated 387 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:05:12.107370 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff756d4e-e3ab-44a4-b5ff-6869d89a917b admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:12.185594 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:12.251257 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d9d6b-b453-41a7-b3db-7b3653f492ed admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:12.478347 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff756d4e-e3ab-44a4-b5ff-6869d89a917b admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:12.493876 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a9997-e616-4e00-8060-345076d39c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:12.496402 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a9997-e616-4e00-8060-345076d39c16 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:12.496694 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a9997-e616-4e00-8060-345076d39c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:12.496975 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a9997-e616-4e00-8060-345076d39c16 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:12.500247 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a9997-e616-4e00-8060-345076d39c16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:12.506820 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a9997-e616-4e00-8060-345076d39c16 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:12.508422 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350b40b-7c99-499d-bb49-ad6b52ba6261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:12.509895 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350b40b-7c99-499d-bb49-ad6b52ba6261 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:12.510475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350b40b-7c99-499d-bb49-ad6b52ba6261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:12.511140 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350b40b-7c99-499d-bb49-ad6b52ba6261 admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:12.512222 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7350b40b-7c99-499d-bb49-ad6b52ba6261 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:12.514632 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7350b40b-7c99-499d-bb49-ad6b52ba6261 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:12.663100 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 879/1729] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:05:12 2022] POST /identity/v3/users => generated 300 bytes in 564 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:05:12.664350 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a9997-e616-4e00-8060-345076d39c16 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:12.680414 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2f0a9997-e616-4e00-8060-345076d39c16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:12.698552 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 851/1730] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:05:12 2022] POST /identity/v3/users => generated 279 bytes in 654 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:05:12.699810 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350b40b-7c99-499d-bb49-ad6b52ba6261 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:12.704420 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:12.771078 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350b40b-7c99-499d-bb49-ad6b52ba6261 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:12.773820 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a9997-e616-4e00-8060-345076d39c16 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:12.792910 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db83db-21e1-400a-bf8f-6c60de466970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:12.793922 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db83db-21e1-400a-bf8f-6c60de466970 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:12.794205 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db83db-21e1-400a-bf8f-6c60de466970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:12.794531 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db83db-21e1-400a-bf8f-6c60de466970 admin admin] PATH_INFO: `/v3/projects/c1a1214614d54100a1f878f59baccd1c` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:12.797332 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db83db-21e1-400a-bf8f-6c60de466970 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1a1214614d54100a1f878f59baccd1c)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:12.799384 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db83db-21e1-400a-bf8f-6c60de466970 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:12.801395 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9ea9da-2aba-414e-8401-0d48e06bc1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:12.802668 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ea9da-2aba-414e-8401-0d48e06bc1b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:12.815382 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ea9da-2aba-414e-8401-0d48e06bc1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:12.815382 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ea9da-2aba-414e-8401-0d48e06bc1b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:12.815382 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9ea9da-2aba-414e-8401-0d48e06bc1b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:12.815382 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9ea9da-2aba-414e-8401-0d48e06bc1b6 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:12.837497 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 852/1731] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:05:12.843428 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9ea9da-2aba-414e-8401-0d48e06bc1b6 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:12.880072 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9ea9da-2aba-414e-8401-0d48e06bc1b6 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:12.905642 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2534b86-0da9-4591-bda3-899e8cae9bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:12.912014 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2534b86-0da9-4591-bda3-899e8cae9bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:12.913831 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2534b86-0da9-4591-bda3-899e8cae9bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:12.914117 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2534b86-0da9-4591-bda3-899e8cae9bf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:12.918833 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2534b86-0da9-4591-bda3-899e8cae9bf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:12.923823 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2534b86-0da9-4591-bda3-899e8cae9bf9 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:12.974180 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 853/1732] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:05:12.975355 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2534b86-0da9-4591-bda3-899e8cae9bf9 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:13.009623 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2534b86-0da9-4591-bda3-899e8cae9bf9 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:13.043986 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf43dfe0-2e62-4e3d-bd03-dd1b8a8d17e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:13.046107 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43dfe0-2e62-4e3d-bd03-dd1b8a8d17e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:13.050924 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43dfe0-2e62-4e3d-bd03-dd1b8a8d17e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:13.051680 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43dfe0-2e62-4e3d-bd03-dd1b8a8d17e9 admin admin] PATH_INFO: `/v3/projects/2008955135514724bb786040186d9918/users/4003968f16a54726aac6e8896821395e/roles/681755518698445fabd9a8accec13c0f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:13.100046 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf43dfe0-2e62-4e3d-bd03-dd1b8a8d17e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2008955135514724bb786040186d9918, user_id=4003968f16a54726aac6e8896821395e, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:13.103413 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf43dfe0-2e62-4e3d-bd03-dd1b8a8d17e9 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:13.218583 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 854/1733] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:05:12 2022] PUT /identity/v3/projects/2008955135514724bb786040186d9918/users/4003968f16a54726aac6e8896821395e/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:13.218583 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf43dfe0-2e62-4e3d-bd03-dd1b8a8d17e9 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:13.222555 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-cf43dfe0-2e62-4e3d-bd03-dd1b8a8d17e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:13.294561 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-40db83db-21e1-400a-bf8f-6c60de466970 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1a1214614d54100a1f878f59baccd1c', 'request_id': 'req-40db83db-21e1-400a-bf8f-6c60de466970'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:13.454571 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf43dfe0-2e62-4e3d-bd03-dd1b8a8d17e9 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:13.538045 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-40db83db-21e1-400a-bf8f-6c60de466970 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1a1214614d54100a1f878f59baccd1c', 'request_id': 'req-40db83db-21e1-400a-bf8f-6c60de466970'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:13.547135 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-40db83db-21e1-400a-bf8f-6c60de466970 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1a1214614d54100a1f878f59baccd1c', 'request_id': 'req-40db83db-21e1-400a-bf8f-6c60de466970'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:13.577023 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-40db83db-21e1-400a-bf8f-6c60de466970 admin admin] The token cache is being invalidate because project c1a1214614d54100a1f878f59baccd1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:05:13.578045 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-40db83db-21e1-400a-bf8f-6c60de466970 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:13.579067 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-40db83db-21e1-400a-bf8f-6c60de466970 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:13.582677 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 880/1734] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:05:12 2022] DELETE /identity/v3/projects/c1a1214614d54100a1f878f59baccd1c => generated 0 bytes in 919 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:13.584987 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db83db-21e1-400a-bf8f-6c60de466970 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:13.589205 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-40db83db-21e1-400a-bf8f-6c60de466970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:13.621509 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de1bf8-4f0f-4f92-9fcb-fe6ba7ccc7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:13.622598 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de1bf8-4f0f-4f92-9fcb-fe6ba7ccc7a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:13.622912 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de1bf8-4f0f-4f92-9fcb-fe6ba7ccc7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:13.628028 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de1bf8-4f0f-4f92-9fcb-fe6ba7ccc7a7 admin admin] PATH_INFO: `/v3/projects/8695829cc7d140a9b6a1bbe12f6cf6b4` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:13.630330 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de1bf8-4f0f-4f92-9fcb-fe6ba7ccc7a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8695829cc7d140a9b6a1bbe12f6cf6b4)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:13.632925 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de1bf8-4f0f-4f92-9fcb-fe6ba7ccc7a7 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:13.749601 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db83db-21e1-400a-bf8f-6c60de466970 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:13.779767 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2841b2-7125-414e-8d49-f1e8d4b5095b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:13.780675 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2841b2-7125-414e-8d49-f1e8d4b5095b admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:13.782575 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2841b2-7125-414e-8d49-f1e8d4b5095b admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:13.783011 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2841b2-7125-414e-8d49-f1e8d4b5095b admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:13.785655 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2841b2-7125-414e-8d49-f1e8d4b5095b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:13.792414 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2841b2-7125-414e-8d49-f1e8d4b5095b admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:13.833596 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 881/1735] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:05:13.842251 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2841b2-7125-414e-8d49-f1e8d4b5095b admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:13.848508 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-fe2841b2-7125-414e-8d49-f1e8d4b5095b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:13.911008 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-42de1bf8-4f0f-4f92-9fcb-fe6ba7ccc7a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8695829cc7d140a9b6a1bbe12f6cf6b4', 'request_id': 'req-42de1bf8-4f0f-4f92-9fcb-fe6ba7ccc7a7'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:13.912730 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2841b2-7125-414e-8d49-f1e8d4b5095b admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:13.912812 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-42de1bf8-4f0f-4f92-9fcb-fe6ba7ccc7a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8695829cc7d140a9b6a1bbe12f6cf6b4', 'request_id': 'req-42de1bf8-4f0f-4f92-9fcb-fe6ba7ccc7a7'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:13.912812 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-42de1bf8-4f0f-4f92-9fcb-fe6ba7ccc7a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8695829cc7d140a9b6a1bbe12f6cf6b4', 'request_id': 'req-42de1bf8-4f0f-4f92-9fcb-fe6ba7ccc7a7'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:14.015629 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decec261-1026-4588-b0aa-4ee4b3666969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:14.016916 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decec261-1026-4588-b0aa-4ee4b3666969 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:14.017596 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decec261-1026-4588-b0aa-4ee4b3666969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:14.018103 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decec261-1026-4588-b0aa-4ee4b3666969 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:14.019265 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decec261-1026-4588-b0aa-4ee4b3666969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:14.021155 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decec261-1026-4588-b0aa-4ee4b3666969 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:14.043720 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 882/1736] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:05:14.045962 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60faed4-4cc2-4781-b0d7-1c43be51902c None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:14.046476 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60faed4-4cc2-4781-b0d7-1c43be51902c None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:14.046934 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60faed4-4cc2-4781-b0d7-1c43be51902c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:14.080433 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-f60faed4-4cc2-4781-b0d7-1c43be51902c None None] MFA Rules not processed for user `93929b81a23c482ca7ce47e7a94682e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:14.081740 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f60faed4-4cc2-4781-b0d7-1c43be51902c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:14.161879 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-42de1bf8-4f0f-4f92-9fcb-fe6ba7ccc7a7 admin admin] The token cache is being invalidate because project 8695829cc7d140a9b6a1bbe12f6cf6b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:05:14.162146 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-42de1bf8-4f0f-4f92-9fcb-fe6ba7ccc7a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:14.163491 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-42de1bf8-4f0f-4f92-9fcb-fe6ba7ccc7a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:14.168967 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 855/1737] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:05:13 2022] DELETE /identity/v3/projects/8695829cc7d140a9b6a1bbe12f6cf6b4 => generated 0 bytes in 952 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:14.172604 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94032c-af89-4681-9ff2-5fa360aa55b5 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:14.172932 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94032c-af89-4681-9ff2-5fa360aa55b5 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:14.173738 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94032c-af89-4681-9ff2-5fa360aa55b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:14.181432 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 883/1738] 10.222.0.13 () {58 vars in 1015 bytes} [Fri Jul 1 04:05:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:14.183123 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60faed4-4cc2-4781-b0d7-1c43be51902c None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:14.184938 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f60faed4-4cc2-4781-b0d7-1c43be51902c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:14.219140 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-ca94032c-af89-4681-9ff2-5fa360aa55b5 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:14.219610 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60faed4-4cc2-4781-b0d7-1c43be51902c None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:14.221562 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-ca94032c-af89-4681-9ff2-5fa360aa55b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:14.225196 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5bbec8-d8ef-4e94-b74e-62eabb5a7e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:14.226130 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bbec8-d8ef-4e94-b74e-62eabb5a7e31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:14.226447 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bbec8-d8ef-4e94-b74e-62eabb5a7e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:14.226889 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bbec8-d8ef-4e94-b74e-62eabb5a7e31 admin admin] PATH_INFO: `/v3/projects/3fa4f8472d7444b6ae9c4409da6d8d9e/users/212d00a72e8948c681158e3f92e028a4/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:14.258818 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 856/1739] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:14.262089 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a8524-3e9c-4071-aab0-8dceccd3cd19 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:14.262532 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a8524-3e9c-4071-aab0-8dceccd3cd19 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:14.262830 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a8524-3e9c-4071-aab0-8dceccd3cd19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:14.281679 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5bbec8-d8ef-4e94-b74e-62eabb5a7e31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fa4f8472d7444b6ae9c4409da6d8d9e, user_id=212d00a72e8948c681158e3f92e028a4, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:14.318594 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5bbec8-d8ef-4e94-b74e-62eabb5a7e31 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:14.320230 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-d83a8524-3e9c-4071-aab0-8dceccd3cd19 None None] MFA Rules not processed for user `a61e50919a13413c9f641f23f6b30217`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:14.322772 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-d83a8524-3e9c-4071-aab0-8dceccd3cd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:14.464232 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 884/1740] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:05:14 2022] PUT /identity/v3/projects/3fa4f8472d7444b6ae9c4409da6d8d9e/users/212d00a72e8948c681158e3f92e028a4/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:14.476803 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5bbec8-d8ef-4e94-b74e-62eabb5a7e31 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:14.499924 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ee5bbec8-d8ef-4e94-b74e-62eabb5a7e31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:14.541475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 857/1741] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:14.543669 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed17d6c-09c1-4a61-a3c7-8d16c04f7673 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:14.544152 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed17d6c-09c1-4a61-a3c7-8d16c04f7673 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:14.548167 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed17d6c-09c1-4a61-a3c7-8d16c04f7673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:14.606246 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-1ed17d6c-09c1-4a61-a3c7-8d16c04f7673 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:14.618662 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-1ed17d6c-09c1-4a61-a3c7-8d16c04f7673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:14.774362 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5bbec8-d8ef-4e94-b74e-62eabb5a7e31 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:14.812769 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04238c-cf74-4a71-a016-c966ffa5490e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:14.813633 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04238c-cf74-4a71-a016-c966ffa5490e admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:14.814742 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04238c-cf74-4a71-a016-c966ffa5490e admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:14.815137 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04238c-cf74-4a71-a016-c966ffa5490e admin admin] PATH_INFO: `/v3/projects/2008955135514724bb786040186d9918/users/4003968f16a54726aac6e8896821395e/roles/681755518698445fabd9a8accec13c0f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:14.821663 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a04238c-cf74-4a71-a016-c966ffa5490e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2008955135514724bb786040186d9918, user_id=4003968f16a54726aac6e8896821395e, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:14.826716 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a04238c-cf74-4a71-a016-c966ffa5490e admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:14.848648 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 858/1742] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:14.850424 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed17d6c-09c1-4a61-a3c7-8d16c04f7673 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:14.858193 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-1ed17d6c-09c1-4a61-a3c7-8d16c04f7673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:14.880665 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 885/1743] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:05:14 2022] PUT /identity/v3/projects/2008955135514724bb786040186d9918/users/4003968f16a54726aac6e8896821395e/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:14.880665 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7a692-f0c6-4a8f-85f3-4e09519e371b None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:14.880665 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7a692-f0c6-4a8f-85f3-4e09519e371b None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:14.880665 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7a692-f0c6-4a8f-85f3-4e09519e371b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:15.038121 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed17d6c-09c1-4a61-a3c7-8d16c04f7673 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:15.181804 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-f6f7a692-f0c6-4a8f-85f3-4e09519e371b None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:15.184355 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f6f7a692-f0c6-4a8f-85f3-4e09519e371b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:15.210265 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cbc603-027e-4c34-9f0d-55e82b3677cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:15.211428 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbc603-027e-4c34-9f0d-55e82b3677cc service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:15.213155 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbc603-027e-4c34-9f0d-55e82b3677cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:15.213696 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbc603-027e-4c34-9f0d-55e82b3677cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:15.235930 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cbc603-027e-4c34-9f0d-55e82b3677cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:15.242527 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cbc603-027e-4c34-9f0d-55e82b3677cc service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:15.267816 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 859/1744] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:05:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:05:15.273568 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94e7c7-0e25-4617-b374-1885d9a28444 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:15.274150 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94e7c7-0e25-4617-b374-1885d9a28444 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:15.274563 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94e7c7-0e25-4617-b374-1885d9a28444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:15.361472 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-1d94e7c7-0e25-4617-b374-1885d9a28444 None None] MFA Rules not processed for user `212d00a72e8948c681158e3f92e028a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:15.363247 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-1d94e7c7-0e25-4617-b374-1885d9a28444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:15.365774 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 886/1745] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 488 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:15.371742 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7631882-985c-44a8-9dd2-7fbe3decd5c4 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:15.372508 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7631882-985c-44a8-9dd2-7fbe3decd5c4 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:15.373303 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7631882-985c-44a8-9dd2-7fbe3decd5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:15.448709 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-d7631882-985c-44a8-9dd2-7fbe3decd5c4 None None] MFA Rules not processed for user `71b72d9b9e3a4eb2ba1aae5d8a924afd`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:15.448709 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d7631882-985c-44a8-9dd2-7fbe3decd5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:15.562001 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 860/1746] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:15 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:15.566576 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7269e1-53e9-4dff-a8f0-c79af66c00fe None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:15.567232 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7269e1-53e9-4dff-a8f0-c79af66c00fe None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:15.567852 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7269e1-53e9-4dff-a8f0-c79af66c00fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:15.589800 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 887/1747] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:15.594739 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f0dc6-350f-4efc-bd05-0de7a6b91693 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:15.595404 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f0dc6-350f-4efc-bd05-0de7a6b91693 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:15.604594 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f0dc6-350f-4efc-bd05-0de7a6b91693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:15.633214 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-1c7269e1-53e9-4dff-a8f0-c79af66c00fe None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:15.634521 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-1c7269e1-53e9-4dff-a8f0-c79af66c00fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:15.678473 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-ed9f0dc6-350f-4efc-bd05-0de7a6b91693 None None] MFA Rules not processed for user `4003968f16a54726aac6e8896821395e`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:15.687795 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 861/1748] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:15.688987 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7269e1-53e9-4dff-a8f0-c79af66c00fe None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:15.692053 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ed9f0dc6-350f-4efc-bd05-0de7a6b91693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:15.728707 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7269e1-53e9-4dff-a8f0-c79af66c00fe None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:15.736570 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67704b88-94e4-4379-af0b-36c51baa2dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:15.737521 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67704b88-94e4-4379-af0b-36c51baa2dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:15.743199 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67704b88-94e4-4379-af0b-36c51baa2dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:15.743199 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67704b88-94e4-4379-af0b-36c51baa2dd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:15.743199 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67704b88-94e4-4379-af0b-36c51baa2dd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:05:15.743199 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67704b88-94e4-4379-af0b-36c51baa2dd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:15.743199 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67704b88-94e4-4379-af0b-36c51baa2dd6 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:15.781008 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 862/1749] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:05:15.790768 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67704b88-94e4-4379-af0b-36c51baa2dd6 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:15.813990 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67704b88-94e4-4379-af0b-36c51baa2dd6 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:15.835912 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba2664-f53e-4987-83be-1d0f129b5be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:15.869585 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba2664-f53e-4987-83be-1d0f129b5be9 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:15.869585 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba2664-f53e-4987-83be-1d0f129b5be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:15.869585 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba2664-f53e-4987-83be-1d0f129b5be9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:15.869585 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba2664-f53e-4987-83be-1d0f129b5be9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:15.869585 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba2664-f53e-4987-83be-1d0f129b5be9 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:15.966606 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 888/1750] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:15.968100 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f0dc6-350f-4efc-bd05-0de7a6b91693 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:16.026756 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f0dc6-350f-4efc-bd05-0de7a6b91693 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:16.037322 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22b152-94e2-41b3-a685-251a22110c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:16.038269 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22b152-94e2-41b3-a685-251a22110c67 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:16.038618 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22b152-94e2-41b3-a685-251a22110c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:16.039060 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22b152-94e2-41b3-a685-251a22110c67 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:16.040487 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22b152-94e2-41b3-a685-251a22110c67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:05:16.041439 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22b152-94e2-41b3-a685-251a22110c67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:16.044447 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22b152-94e2-41b3-a685-251a22110c67 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:16.074687 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 889/1751] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:05:16.088349 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22b152-94e2-41b3-a685-251a22110c67 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:16.130755 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22b152-94e2-41b3-a685-251a22110c67 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:16.158293 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7289866-5269-4323-a732-640fea66ad2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:16.159360 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7289866-5269-4323-a732-640fea66ad2b admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:16.159927 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7289866-5269-4323-a732-640fea66ad2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:16.160420 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7289866-5269-4323-a732-640fea66ad2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:16.173341 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7289866-5269-4323-a732-640fea66ad2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:16.176811 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 863/1752] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:05:15 2022] POST /identity/v3/projects => generated 353 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:05:16.177901 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba2664-f53e-4987-83be-1d0f129b5be9 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:16.181852 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7289866-5269-4323-a732-640fea66ad2b admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:16.183290 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-55ba2664-f53e-4987-83be-1d0f129b5be9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:16.323380 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba2664-f53e-4987-83be-1d0f129b5be9 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:16.333672 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2811c02-809e-49c0-99ea-133530ba3b59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:16.334549 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2811c02-809e-49c0-99ea-133530ba3b59 service cinder] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:16.335020 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2811c02-809e-49c0-99ea-133530ba3b59 service cinder] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:16.335409 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2811c02-809e-49c0-99ea-133530ba3b59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:16.533458 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:16.535704 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2811c02-809e-49c0-99ea-133530ba3b59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:16.538003 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2811c02-809e-49c0-99ea-133530ba3b59 service cinder] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:16.553024 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 890/1753] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:05:16 2022] POST /identity/v3/projects => generated 363 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:05:16.553024 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7289866-5269-4323-a732-640fea66ad2b admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:16.559953 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 864/1754] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:05:16 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:05:16.565139 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2811c02-809e-49c0-99ea-133530ba3b59 service cinder] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:16.787517 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2811c02-809e-49c0-99ea-133530ba3b59 service cinder] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:16.951097 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af0ce68-fcf3-40f6-9037-0fd24ca28041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:16.951887 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0ce68-fcf3-40f6-9037-0fd24ca28041 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:16.952124 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0ce68-fcf3-40f6-9037-0fd24ca28041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:16.952720 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0ce68-fcf3-40f6-9037-0fd24ca28041 admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:16.953849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af0ce68-fcf3-40f6-9037-0fd24ca28041 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:16.956726 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af0ce68-fcf3-40f6-9037-0fd24ca28041 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:17.085221 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7289866-5269-4323-a732-640fea66ad2b admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:17.105545 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8349f23-c96f-4c08-90c8-dff5e9c4775d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:17.111007 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8349f23-c96f-4c08-90c8-dff5e9c4775d admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:17.111007 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8349f23-c96f-4c08-90c8-dff5e9c4775d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:17.111007 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8349f23-c96f-4c08-90c8-dff5e9c4775d admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:17.111007 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8349f23-c96f-4c08-90c8-dff5e9c4775d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:17.151071 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8349f23-c96f-4c08-90c8-dff5e9c4775d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:17.211422 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 865/1755] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:05:16 2022] POST /identity/v3/users => generated 283 bytes in 651 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:05:17.212359 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af0ce68-fcf3-40f6-9037-0fd24ca28041 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:17.252530 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af0ce68-fcf3-40f6-9037-0fd24ca28041 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:17.274997 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a297018-7b8f-4a92-b1e7-dcf72138596f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:17.276511 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a297018-7b8f-4a92-b1e7-dcf72138596f admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:17.276813 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a297018-7b8f-4a92-b1e7-dcf72138596f admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:17.277089 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a297018-7b8f-4a92-b1e7-dcf72138596f admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:17.277827 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a297018-7b8f-4a92-b1e7-dcf72138596f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:17.279975 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a297018-7b8f-4a92-b1e7-dcf72138596f admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:17.384997 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 891/1756] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:05:16 2022] POST /identity/v3/projects => generated 377 bytes in 831 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:05:17.384997 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8349f23-c96f-4c08-90c8-dff5e9c4775d admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:17.444531 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 866/1757] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:05:17 2022] POST /identity/v3/users => generated 282 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:05:17.447090 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a297018-7b8f-4a92-b1e7-dcf72138596f admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:17.481551 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a297018-7b8f-4a92-b1e7-dcf72138596f admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:17.634237 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64b5ca-7293-4408-9f4c-95ea830d15df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:17.635109 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64b5ca-7293-4408-9f4c-95ea830d15df admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:17.635587 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64b5ca-7293-4408-9f4c-95ea830d15df admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:17.635976 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64b5ca-7293-4408-9f4c-95ea830d15df admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:17.636844 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c64b5ca-7293-4408-9f4c-95ea830d15df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:17.638633 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c64b5ca-7293-4408-9f4c-95ea830d15df admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:17.649298 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8349f23-c96f-4c08-90c8-dff5e9c4775d admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:17.656055 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 867/1758] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:05:17.656055 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64b5ca-7293-4408-9f4c-95ea830d15df admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:17.669640 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8128fd-4da7-4455-9eea-a47bf9b39a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:17.673863 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8128fd-4da7-4455-9eea-a47bf9b39a5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:17.673863 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8128fd-4da7-4455-9eea-a47bf9b39a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:17.674574 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8128fd-4da7-4455-9eea-a47bf9b39a5d admin admin] PATH_INFO: `/v3/users/7a4ba7744acd4507bb901102cb13ed8b` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:17.674893 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64b5ca-7293-4408-9f4c-95ea830d15df admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:17.679738 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8128fd-4da7-4455-9eea-a47bf9b39a5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a4ba7744acd4507bb901102cb13ed8b)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:17.680440 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4529425-6ec6-4b7d-92fb-8f52a735aad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:17.681235 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4529425-6ec6-4b7d-92fb-8f52a735aad6 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:17.681603 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4529425-6ec6-4b7d-92fb-8f52a735aad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:17.681950 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4529425-6ec6-4b7d-92fb-8f52a735aad6 admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:17.683643 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4529425-6ec6-4b7d-92fb-8f52a735aad6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:17.685738 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4529425-6ec6-4b7d-92fb-8f52a735aad6 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:17.690163 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8128fd-4da7-4455-9eea-a47bf9b39a5d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:17.734701 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:17.801420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 868/1759] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:05:17 2022] POST /identity/v3/users => generated 289 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:05:17.805649 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4529425-6ec6-4b7d-92fb-8f52a735aad6 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:17.826590 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4529425-6ec6-4b7d-92fb-8f52a735aad6 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:17.834593 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9127afa-5fce-41c8-ab31-2de9ae172f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:17.835658 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9127afa-5fce-41c8-ab31-2de9ae172f3a admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:17.837715 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9127afa-5fce-41c8-ab31-2de9ae172f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:17.839383 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9127afa-5fce-41c8-ab31-2de9ae172f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:17.840585 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9127afa-5fce-41c8-ab31-2de9ae172f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:17.851203 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9127afa-5fce-41c8-ab31-2de9ae172f3a admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:17.880411 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 869/1760] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:05:17.881727 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9127afa-5fce-41c8-ab31-2de9ae172f3a admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:17.895338 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9127afa-5fce-41c8-ab31-2de9ae172f3a admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:17.903802 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d903bdf-6247-47ae-bc8f-78f2f521b2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:17.905123 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d903bdf-6247-47ae-bc8f-78f2f521b2d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:17.905703 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d903bdf-6247-47ae-bc8f-78f2f521b2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:17.906915 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d903bdf-6247-47ae-bc8f-78f2f521b2d3 admin admin] PATH_INFO: `/v3/projects/10a7e1cfcd9a45979be5dbe9c6201818/users/aa7c5db53b004482829f263a623f33d7/roles/681755518698445fabd9a8accec13c0f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:17.934420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d903bdf-6247-47ae-bc8f-78f2f521b2d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10a7e1cfcd9a45979be5dbe9c6201818, user_id=aa7c5db53b004482829f263a623f33d7, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:17.937358 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d903bdf-6247-47ae-bc8f-78f2f521b2d3 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:18.199625 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 870/1761] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:05:17 2022] PUT /identity/v3/projects/10a7e1cfcd9a45979be5dbe9c6201818/users/aa7c5db53b004482829f263a623f33d7/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:18.203257 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d903bdf-6247-47ae-bc8f-78f2f521b2d3 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:18.334216 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d903bdf-6247-47ae-bc8f-78f2f521b2d3 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:18.346184 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd4408-f5b0-4bdd-819d-6c98e91f25e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:18.347566 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd4408-f5b0-4bdd-819d-6c98e91f25e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:18.348311 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd4408-f5b0-4bdd-819d-6c98e91f25e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:18.348904 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd4408-f5b0-4bdd-819d-6c98e91f25e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:18.350327 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cd4408-f5b0-4bdd-819d-6c98e91f25e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:18.354284 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cd4408-f5b0-4bdd-819d-6c98e91f25e4 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:18.377667 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 871/1762] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:05:18.379641 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd4408-f5b0-4bdd-819d-6c98e91f25e4 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:18.408313 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd4408-f5b0-4bdd-819d-6c98e91f25e4 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:18.417017 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0b287-e0d4-49c7-8e34-cd4febc6f1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:18.418162 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0b287-e0d4-49c7-8e34-cd4febc6f1c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:18.418631 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0b287-e0d4-49c7-8e34-cd4febc6f1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:18.419197 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0b287-e0d4-49c7-8e34-cd4febc6f1c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:18.420663 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c0b287-e0d4-49c7-8e34-cd4febc6f1c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:18.424790 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c0b287-e0d4-49c7-8e34-cd4febc6f1c5 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:18.442661 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 872/1763] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:05:18.444419 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0b287-e0d4-49c7-8e34-cd4febc6f1c5 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:18.480061 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0b287-e0d4-49c7-8e34-cd4febc6f1c5 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:18.489484 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2e177-81b7-437a-a1b5-df3f995be0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:18.490724 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2e177-81b7-437a-a1b5-df3f995be0da admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:18.491401 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2e177-81b7-437a-a1b5-df3f995be0da admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:18.491936 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2e177-81b7-437a-a1b5-df3f995be0da admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:18.493682 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d2e177-81b7-437a-a1b5-df3f995be0da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:18.505280 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-be8128fd-4da7-4455-9eea-a47bf9b39a5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a4ba7744acd4507bb901102cb13ed8b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:18.506414 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-be8128fd-4da7-4455-9eea-a47bf9b39a5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a4ba7744acd4507bb901102cb13ed8b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:18.511840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d2e177-81b7-437a-a1b5-df3f995be0da admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:18.560178 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 873/1764] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:05:18.562588 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2e177-81b7-437a-a1b5-df3f995be0da admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:18.571247 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-55d2e177-81b7-437a-a1b5-df3f995be0da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:18.576710 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-be8128fd-4da7-4455-9eea-a47bf9b39a5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a4ba7744acd4507bb901102cb13ed8b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:18.590550 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-be8128fd-4da7-4455-9eea-a47bf9b39a5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a4ba7744acd4507bb901102cb13ed8b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:18.591782 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-be8128fd-4da7-4455-9eea-a47bf9b39a5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a4ba7744acd4507bb901102cb13ed8b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:18.641084 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2e177-81b7-437a-a1b5-df3f995be0da admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:18.680689 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013efea3-2070-4097-b4e6-e37ab473d988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:18.687342 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013efea3-2070-4097-b4e6-e37ab473d988 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:18.688555 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013efea3-2070-4097-b4e6-e37ab473d988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:18.689116 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013efea3-2070-4097-b4e6-e37ab473d988 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:18.690583 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013efea3-2070-4097-b4e6-e37ab473d988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:18.702299 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013efea3-2070-4097-b4e6-e37ab473d988 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:18.704200 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 892/1765] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:05:17 2022] DELETE /identity/v3/users/7a4ba7744acd4507bb901102cb13ed8b => generated 0 bytes in 1322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:18.709245 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8128fd-4da7-4455-9eea-a47bf9b39a5d admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:18.717069 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-be8128fd-4da7-4455-9eea-a47bf9b39a5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:18.788794 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 874/1766] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:05:18.788794 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013efea3-2070-4097-b4e6-e37ab473d988 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:18.799696 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-013efea3-2070-4097-b4e6-e37ab473d988 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:19.039682 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013efea3-2070-4097-b4e6-e37ab473d988 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:19.040001 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8128fd-4da7-4455-9eea-a47bf9b39a5d admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:19.062319 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc345e2c-9570-4b55-b5e3-cde36652bbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:19.064381 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc345e2c-9570-4b55-b5e3-cde36652bbb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:19.066730 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc345e2c-9570-4b55-b5e3-cde36652bbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:19.067828 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc345e2c-9570-4b55-b5e3-cde36652bbb3 admin admin] PATH_INFO: `/v3/projects/df3b6413d24b43498e9dd4720e69b30c/users/193b37c1cf5647869c024b804a38e314/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:19.103009 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4299760-10ce-4857-a81e-912dc5f46052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:19.106521 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4299760-10ce-4857-a81e-912dc5f46052 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:19.107079 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4299760-10ce-4857-a81e-912dc5f46052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:19.107560 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4299760-10ce-4857-a81e-912dc5f46052 admin admin] PATH_INFO: `/v3/projects/10a7e1cfcd9a45979be5dbe9c6201818/users/aa7c5db53b004482829f263a623f33d7/roles/681755518698445fabd9a8accec13c0f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:19.118877 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4299760-10ce-4857-a81e-912dc5f46052 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10a7e1cfcd9a45979be5dbe9c6201818, user_id=aa7c5db53b004482829f263a623f33d7, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:19.123245 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4299760-10ce-4857-a81e-912dc5f46052 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:19.152505 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 875/1767] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:05:18 2022] PUT /identity/v3/projects/10a7e1cfcd9a45979be5dbe9c6201818/users/aa7c5db53b004482829f263a623f33d7/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:19.154298 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e281f4-6766-4af7-a9be-e8b897150db5 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:19.154594 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e281f4-6766-4af7-a9be-e8b897150db5 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:19.154869 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e281f4-6766-4af7-a9be-e8b897150db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:19.194653 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc345e2c-9570-4b55-b5e3-cde36652bbb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df3b6413d24b43498e9dd4720e69b30c, user_id=193b37c1cf5647869c024b804a38e314, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:19.201775 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-e2e281f4-6766-4af7-a9be-e8b897150db5 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:19.208013 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-e2e281f4-6766-4af7-a9be-e8b897150db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:19.217074 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc345e2c-9570-4b55-b5e3-cde36652bbb3 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:19.310353 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 876/1768] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:19.311411 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e281f4-6766-4af7-a9be-e8b897150db5 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:19.333004 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 893/1769] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:05:18 2022] PUT /identity/v3/projects/df3b6413d24b43498e9dd4720e69b30c/users/193b37c1cf5647869c024b804a38e314/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:19.335924 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5db12-3dd5-497f-82ec-b261270ce873 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:19.336530 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5db12-3dd5-497f-82ec-b261270ce873 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:19.337017 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5db12-3dd5-497f-82ec-b261270ce873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:19.339613 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e281f4-6766-4af7-a9be-e8b897150db5 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:19.461449 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-dbd5db12-3dd5-497f-82ec-b261270ce873 None None] MFA Rules not processed for user `aa7c5db53b004482829f263a623f33d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:19.465134 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-dbd5db12-3dd5-497f-82ec-b261270ce873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:19.559971 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da72c7b-fd62-458c-b6e4-4c107c42be84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:19.561105 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da72c7b-fd62-458c-b6e4-4c107c42be84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:19.561484 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da72c7b-fd62-458c-b6e4-4c107c42be84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:19.561830 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da72c7b-fd62-458c-b6e4-4c107c42be84 admin admin] PATH_INFO: `/v3/projects/30252c2c80d741758dbeafe74f570494/users/8cf04e8a59744ef49d9bf5f492bd2e3d/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:19.583390 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da72c7b-fd62-458c-b6e4-4c107c42be84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30252c2c80d741758dbeafe74f570494, user_id=8cf04e8a59744ef49d9bf5f492bd2e3d, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:19.593115 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da72c7b-fd62-458c-b6e4-4c107c42be84 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:19.665486 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 894/1770] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:19 2022] POST /identity/v3/auth/tokens => generated 3287 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:19.670070 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5db12-3dd5-497f-82ec-b261270ce873 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:19.678129 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-dbd5db12-3dd5-497f-82ec-b261270ce873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:19.871912 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5db12-3dd5-497f-82ec-b261270ce873 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:19.891227 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f292ea-fe4b-4fcd-9e7d-c15d962767e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:19.896319 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f292ea-fe4b-4fcd-9e7d-c15d962767e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:19.896319 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f292ea-fe4b-4fcd-9e7d-c15d962767e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:19.896319 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f292ea-fe4b-4fcd-9e7d-c15d962767e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:19.908043 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 877/1771] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:05:19 2022] PUT /identity/v3/projects/30252c2c80d741758dbeafe74f570494/users/8cf04e8a59744ef49d9bf5f492bd2e3d/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:19.909728 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e3b09-aeec-4d4c-b4cf-ac5ebc84e5bb None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:19.909728 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e3b09-aeec-4d4c-b4cf-ac5ebc84e5bb None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:19.909728 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e3b09-aeec-4d4c-b4cf-ac5ebc84e5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:19.923019 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f292ea-fe4b-4fcd-9e7d-c15d962767e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:19.924793 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f292ea-fe4b-4fcd-9e7d-c15d962767e7 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:19.947309 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 895/1772] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:05:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:05:19.949475 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8da0ac-1eec-47a8-9c86-dc7c6465f06d None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:19.949714 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8da0ac-1eec-47a8-9c86-dc7c6465f06d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:19.949997 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8da0ac-1eec-47a8-9c86-dc7c6465f06d None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:19.952244 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 896/1773] 10.222.0.46 () {54 vars in 921 bytes} [Fri Jul 1 04:05:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 04:05:19.975280 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8da0ac-1eec-47a8-9c86-dc7c6465f06d None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:19.981682 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ae8da0ac-1eec-47a8-9c86-dc7c6465f06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:20.000221 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-157e3b09-aeec-4d4c-b4cf-ac5ebc84e5bb None None] MFA Rules not processed for user `193b37c1cf5647869c024b804a38e314`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:20.001010 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-157e3b09-aeec-4d4c-b4cf-ac5ebc84e5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:20.147944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8da0ac-1eec-47a8-9c86-dc7c6465f06d None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:20.148638 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b2ba9-8639-4320-85d9-d6fd558c495b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:20.149617 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b2ba9-8639-4320-85d9-d6fd558c495b service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:20.149901 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b2ba9-8639-4320-85d9-d6fd558c495b service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:20.150183 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b2ba9-8639-4320-85d9-d6fd558c495b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:20.181206 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 878/1774] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:19 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:20.187016 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d332c-283b-4580-a659-bf759a6afe85 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:20.187299 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d332c-283b-4580-a659-bf759a6afe85 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:20.187619 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d332c-283b-4580-a659-bf759a6afe85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:20.336532 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-b02d332c-283b-4580-a659-bf759a6afe85 None None] MFA Rules not processed for user `8cf04e8a59744ef49d9bf5f492bd2e3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:20.338550 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-b02d332c-283b-4580-a659-bf759a6afe85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:20.357453 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b2ba9-8639-4320-85d9-d6fd558c495b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:20.360063 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b2ba9-8639-4320-85d9-d6fd558c495b service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:20.381189 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 897/1775] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:05:19 2022] GET /identity/v3/auth/tokens => generated 3287 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:05:20.383582 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2df3c0-54f6-4c81-a276-a9bbfc4f65ef None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:20.384892 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2df3c0-54f6-4c81-a276-a9bbfc4f65ef None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:20.385030 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2df3c0-54f6-4c81-a276-a9bbfc4f65ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:20.410690 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-ea2df3c0-54f6-4c81-a276-a9bbfc4f65ef None None] MFA Rules not processed for user `2da466ad31d344898f5c838f77d45181`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:20.415069 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ea2df3c0-54f6-4c81-a276-a9bbfc4f65ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:20.578479 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 898/1776] 10.222.0.46 () {58 vars in 1018 bytes} [Fri Jul 1 04:05:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:20.579980 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2df3c0-54f6-4c81-a276-a9bbfc4f65ef None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:20.655760 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 879/1777] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 472 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:20.659162 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d332c-283b-4580-a659-bf759a6afe85 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:20.778666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2df3c0-54f6-4c81-a276-a9bbfc4f65ef None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:20.806089 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01d9a1-f8fd-4373-ae03-ba5e7b52edde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:20.808448 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01d9a1-f8fd-4373-ae03-ba5e7b52edde admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:20.812164 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01d9a1-f8fd-4373-ae03-ba5e7b52edde admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:20.818754 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01d9a1-f8fd-4373-ae03-ba5e7b52edde admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:20.822491 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce01d9a1-f8fd-4373-ae03-ba5e7b52edde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:20.835057 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce01d9a1-f8fd-4373-ae03-ba5e7b52edde admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:20.886578 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d332c-283b-4580-a659-bf759a6afe85 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:20.909804 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eba12a-63e8-47a8-8e32-8fbb37d6b94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:20.910666 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eba12a-63e8-47a8-8e32-8fbb37d6b94d admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:20.911058 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eba12a-63e8-47a8-8e32-8fbb37d6b94d admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:20.911433 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eba12a-63e8-47a8-8e32-8fbb37d6b94d admin admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:20.912406 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eba12a-63e8-47a8-8e32-8fbb37d6b94d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:20.914631 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eba12a-63e8-47a8-8e32-8fbb37d6b94d admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:21.167963 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 899/1778] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:05:20 2022] POST /identity/v3/projects => generated 363 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:05:21.167963 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01d9a1-f8fd-4373-ae03-ba5e7b52edde admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:21.167963 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01d9a1-f8fd-4373-ae03-ba5e7b52edde admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:21.167963 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731e76e-8db2-4688-9a5b-6aaf5864919c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:21.170789 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731e76e-8db2-4688-9a5b-6aaf5864919c service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:21.170789 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731e76e-8db2-4688-9a5b-6aaf5864919c service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:21.170789 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731e76e-8db2-4688-9a5b-6aaf5864919c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:21.170789 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1731e76e-8db2-4688-9a5b-6aaf5864919c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:21.170789 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731e76e-8db2-4688-9a5b-6aaf5864919c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:21.170789 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731e76e-8db2-4688-9a5b-6aaf5864919c service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:21.187989 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 900/1779] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:05:21 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:05:21.190487 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731e76e-8db2-4688-9a5b-6aaf5864919c service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:21.192894 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1731e76e-8db2-4688-9a5b-6aaf5864919c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:21.347672 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 880/1780] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:05:20 2022] POST /identity/v3/projects => generated 375 bytes in 689 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:05:21.349543 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eba12a-63e8-47a8-8e32-8fbb37d6b94d admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:21.420250 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731e76e-8db2-4688-9a5b-6aaf5864919c service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:21.677710 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720339d-0992-4ed8-b598-f4785693457f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:21.679614 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720339d-0992-4ed8-b598-f4785693457f service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:21.679955 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720339d-0992-4ed8-b598-f4785693457f service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:21.680232 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720339d-0992-4ed8-b598-f4785693457f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:21.690354 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eba12a-63e8-47a8-8e32-8fbb37d6b94d admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:21.697795 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b6ad3-03f0-409f-ac02-44ae2d5fdf7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:21.699359 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b6ad3-03f0-409f-ac02-44ae2d5fdf7b admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:21.699836 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b6ad3-03f0-409f-ac02-44ae2d5fdf7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:21.700320 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b6ad3-03f0-409f-ac02-44ae2d5fdf7b admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:21.701907 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b6ad3-03f0-409f-ac02-44ae2d5fdf7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:21.705461 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b6ad3-03f0-409f-ac02-44ae2d5fdf7b admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:21.713936 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720339d-0992-4ed8-b598-f4785693457f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:21.713936 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720339d-0992-4ed8-b598-f4785693457f service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:21.731229 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 901/1781] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:05:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:05:21.732725 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720339d-0992-4ed8-b598-f4785693457f service nova] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:21.748598 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720339d-0992-4ed8-b598-f4785693457f service nova] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:21.757800 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a9e18-bbb4-4581-912b-f69250a98655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:21.777075 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a9e18-bbb4-4581-912b-f69250a98655 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:21.777075 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a9e18-bbb4-4581-912b-f69250a98655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:21.777075 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a9e18-bbb4-4581-912b-f69250a98655 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:21.777075 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a9e18-bbb4-4581-912b-f69250a98655 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:21.777075 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a9e18-bbb4-4581-912b-f69250a98655 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:21.968232 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 881/1782] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:05:21 2022] POST /identity/v3/users => generated 288 bytes in 620 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:05:21.974764 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b6ad3-03f0-409f-ac02-44ae2d5fdf7b admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:21.989868 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b6ad3-03f0-409f-ac02-44ae2d5fdf7b admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:21.996457 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9847b96-0a87-4f87-8801-87313e13934b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:21.998005 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9847b96-0a87-4f87-8801-87313e13934b admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:21.999155 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9847b96-0a87-4f87-8801-87313e13934b admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:21.999971 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9847b96-0a87-4f87-8801-87313e13934b admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:22.001824 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9847b96-0a87-4f87-8801-87313e13934b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:22.005244 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9847b96-0a87-4f87-8801-87313e13934b admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:22.023249 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 882/1783] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:05:22.029939 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9847b96-0a87-4f87-8801-87313e13934b admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:22.047285 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9847b96-0a87-4f87-8801-87313e13934b admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:22.054645 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e549030-a694-4f7b-b8e0-127a66952150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:22.056059 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e549030-a694-4f7b-b8e0-127a66952150 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:22.056594 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e549030-a694-4f7b-b8e0-127a66952150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:22.057105 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e549030-a694-4f7b-b8e0-127a66952150 admin admin] PATH_INFO: `/v3/projects/57f28af32c8042c1b0e43df047a89a3e/users/42aae24063b24e20830c825c4e85a56b/roles/681755518698445fabd9a8accec13c0f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:22.085928 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e549030-a694-4f7b-b8e0-127a66952150 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57f28af32c8042c1b0e43df047a89a3e, user_id=42aae24063b24e20830c825c4e85a56b, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:22.090923 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e549030-a694-4f7b-b8e0-127a66952150 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:22.158128 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 902/1784] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:05:21 2022] POST /identity/v3/users => generated 294 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:05:22.162059 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a9e18-bbb4-4581-912b-f69250a98655 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:22.191367 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a9e18-bbb4-4581-912b-f69250a98655 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:22.222481 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 883/1785] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:05:22 2022] PUT /identity/v3/projects/57f28af32c8042c1b0e43df047a89a3e/users/42aae24063b24e20830c825c4e85a56b/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:05:22.226994 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e549030-a694-4f7b-b8e0-127a66952150 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:22.229911 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4fe6f-0932-44da-9129-0d5064435fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:22.230624 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4fe6f-0932-44da-9129-0d5064435fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:22.230909 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4fe6f-0932-44da-9129-0d5064435fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:22.231190 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4fe6f-0932-44da-9129-0d5064435fd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:22.231988 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b4fe6f-0932-44da-9129-0d5064435fd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:22.233690 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b4fe6f-0932-44da-9129-0d5064435fd9 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:22.275470 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 903/1786] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:05:22 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 04:05:22.278004 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4fe6f-0932-44da-9129-0d5064435fd9 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:22.308952 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4fe6f-0932-44da-9129-0d5064435fd9 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:22.512500 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee736fc1-e54a-4a69-a3db-2663f7402092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:22.513543 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee736fc1-e54a-4a69-a3db-2663f7402092 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:22.513834 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee736fc1-e54a-4a69-a3db-2663f7402092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:22.514113 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee736fc1-e54a-4a69-a3db-2663f7402092 admin admin] PATH_INFO: `/v3/projects/017081ebfba446fbb736468138f469d7/users/bef18e4087ca446587e1c329881280a0/roles/681755518698445fabd9a8accec13c0f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:22.549333 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e549030-a694-4f7b-b8e0-127a66952150 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:22.558230 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81db859-ddd9-489a-832a-e170a5a41252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:22.558995 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81db859-ddd9-489a-832a-e170a5a41252 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:22.559323 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81db859-ddd9-489a-832a-e170a5a41252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:22.559642 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81db859-ddd9-489a-832a-e170a5a41252 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:22.561205 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81db859-ddd9-489a-832a-e170a5a41252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:22.562554 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee736fc1-e54a-4a69-a3db-2663f7402092 admin admin] RBAC: Authorizing `identity:create_grant(project_id=017081ebfba446fbb736468138f469d7, user_id=bef18e4087ca446587e1c329881280a0, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:22.567223 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81db859-ddd9-489a-832a-e170a5a41252 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:22.570133 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee736fc1-e54a-4a69-a3db-2663f7402092 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:22.607945 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 884/1787] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:05:22 2022] GET /identity/v3/roles => generated 1420 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:05:22.609243 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81db859-ddd9-489a-832a-e170a5a41252 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:22.611679 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-e81db859-ddd9-489a-832a-e170a5a41252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:22.639625 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81db859-ddd9-489a-832a-e170a5a41252 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:22.649509 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381167e4-b48a-4fca-94dd-cee2942c83de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:22.650446 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381167e4-b48a-4fca-94dd-cee2942c83de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:22.650965 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381167e4-b48a-4fca-94dd-cee2942c83de admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:22.651816 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381167e4-b48a-4fca-94dd-cee2942c83de admin admin] PATH_INFO: `/v3/projects/35809a703a094f388be53b29d52a91fa` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:22.653216 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381167e4-b48a-4fca-94dd-cee2942c83de admin admin] RBAC: Authorizing `identity:delete_project(project_id=35809a703a094f388be53b29d52a91fa)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:22.655245 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381167e4-b48a-4fca-94dd-cee2942c83de admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:22.758707 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 904/1788] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:05:22 2022] PUT /identity/v3/projects/017081ebfba446fbb736468138f469d7/users/bef18e4087ca446587e1c329881280a0/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:22.770121 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee736fc1-e54a-4a69-a3db-2663f7402092 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:23.043129 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee736fc1-e54a-4a69-a3db-2663f7402092 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:23.043129 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca005dfb-b0eb-4e30-b000-8b082ad8038b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:23.043129 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca005dfb-b0eb-4e30-b000-8b082ad8038b admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:23.043129 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca005dfb-b0eb-4e30-b000-8b082ad8038b admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:23.044214 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca005dfb-b0eb-4e30-b000-8b082ad8038b admin admin] PATH_INFO: `/v3/projects/57f28af32c8042c1b0e43df047a89a3e/users/42aae24063b24e20830c825c4e85a56b/roles/681755518698445fabd9a8accec13c0f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:23.060131 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca005dfb-b0eb-4e30-b000-8b082ad8038b admin admin] RBAC: Authorizing `identity:create_grant(project_id=57f28af32c8042c1b0e43df047a89a3e, user_id=42aae24063b24e20830c825c4e85a56b, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:23.075895 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca005dfb-b0eb-4e30-b000-8b082ad8038b admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:23.098728 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 905/1789] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:05:22 2022] PUT /identity/v3/projects/57f28af32c8042c1b0e43df047a89a3e/users/42aae24063b24e20830c825c4e85a56b/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:23.100499 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca005dfb-b0eb-4e30-b000-8b082ad8038b admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:23.133984 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-381167e4-b48a-4fca-94dd-cee2942c83de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35809a703a094f388be53b29d52a91fa', 'request_id': 'req-381167e4-b48a-4fca-94dd-cee2942c83de'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:23.156236 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-381167e4-b48a-4fca-94dd-cee2942c83de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35809a703a094f388be53b29d52a91fa', 'request_id': 'req-381167e4-b48a-4fca-94dd-cee2942c83de'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:23.169932 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-381167e4-b48a-4fca-94dd-cee2942c83de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35809a703a094f388be53b29d52a91fa', 'request_id': 'req-381167e4-b48a-4fca-94dd-cee2942c83de'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:23.220510 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:23.280864 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-381167e4-b48a-4fca-94dd-cee2942c83de admin admin] The token cache is being invalidate because project 35809a703a094f388be53b29d52a91fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:05:23.281354 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-381167e4-b48a-4fca-94dd-cee2942c83de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:23.288222 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-381167e4-b48a-4fca-94dd-cee2942c83de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:23.293126 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 885/1790] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:05:22 2022] DELETE /identity/v3/projects/35809a703a094f388be53b29d52a91fa => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:23.297692 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6de194-ac6b-4936-aaf0-d78bd108882c None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:23.302525 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6de194-ac6b-4936-aaf0-d78bd108882c None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:23.306338 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6de194-ac6b-4936-aaf0-d78bd108882c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:23.307109 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:23.355124 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca005dfb-b0eb-4e30-b000-8b082ad8038b admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:23.373371 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacff81f-34cf-4b08-8a09-0de424222abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:23.374350 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacff81f-34cf-4b08-8a09-0de424222abb admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:23.374727 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacff81f-34cf-4b08-8a09-0de424222abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:23.375129 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacff81f-34cf-4b08-8a09-0de424222abb admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:23.377784 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacff81f-34cf-4b08-8a09-0de424222abb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:23.379775 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacff81f-34cf-4b08-8a09-0de424222abb admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:23.405193 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 906/1791] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:05:23.406392 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacff81f-34cf-4b08-8a09-0de424222abb admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:23.412103 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-eacff81f-34cf-4b08-8a09-0de424222abb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:23.418044 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-2a6de194-ac6b-4936-aaf0-d78bd108882c None None] MFA Rules not processed for user `42aae24063b24e20830c825c4e85a56b`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:23.422870 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-2a6de194-ac6b-4936-aaf0-d78bd108882c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:23.440044 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacff81f-34cf-4b08-8a09-0de424222abb admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:23.454771 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1d16a-7e8f-4d76-92ac-b28c33e34e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:23.458263 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1d16a-7e8f-4d76-92ac-b28c33e34e17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:23.458724 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1d16a-7e8f-4d76-92ac-b28c33e34e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:23.462367 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1d16a-7e8f-4d76-92ac-b28c33e34e17 admin admin] PATH_INFO: `/v3/users/4003968f16a54726aac6e8896821395e` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:23.462665 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad1d16a-7e8f-4d76-92ac-b28c33e34e17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4003968f16a54726aac6e8896821395e)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:23.464797 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad1d16a-7e8f-4d76-92ac-b28c33e34e17 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:23.716696 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-cad1d16a-7e8f-4d76-92ac-b28c33e34e17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4003968f16a54726aac6e8896821395e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:23.724011 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-cad1d16a-7e8f-4d76-92ac-b28c33e34e17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4003968f16a54726aac6e8896821395e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:23.744412 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 886/1792] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:23 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 451 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:23.746047 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6de194-ac6b-4936-aaf0-d78bd108882c None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:23.750962 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-2a6de194-ac6b-4936-aaf0-d78bd108882c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:23.769427 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-cad1d16a-7e8f-4d76-92ac-b28c33e34e17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4003968f16a54726aac6e8896821395e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:23.785471 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-cad1d16a-7e8f-4d76-92ac-b28c33e34e17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4003968f16a54726aac6e8896821395e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:23.786924 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-cad1d16a-7e8f-4d76-92ac-b28c33e34e17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4003968f16a54726aac6e8896821395e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:23.925734 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6de194-ac6b-4936-aaf0-d78bd108882c None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:23.925734 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b4b74-4c2c-4810-a8cd-440002b2576e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:23.925734 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b4b74-4c2c-4810-a8cd-440002b2576e admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:23.925734 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b4b74-4c2c-4810-a8cd-440002b2576e admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:23.927365 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b4b74-4c2c-4810-a8cd-440002b2576e admin admin] PATH_INFO: `/v3/projects/017081ebfba446fbb736468138f469d7/users/bef18e4087ca446587e1c329881280a0/roles/681755518698445fabd9a8accec13c0f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:23.927365 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b4b74-4c2c-4810-a8cd-440002b2576e admin admin] RBAC: Authorizing `identity:create_grant(project_id=017081ebfba446fbb736468138f469d7, user_id=bef18e4087ca446587e1c329881280a0, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:23.927365 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b4b74-4c2c-4810-a8cd-440002b2576e admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:23.927365 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 887/1793] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:05:23 2022] PUT /identity/v3/projects/017081ebfba446fbb736468138f469d7/users/bef18e4087ca446587e1c329881280a0/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:23.940233 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905310c-153d-4109-8741-489e9379981b None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:23.940663 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905310c-153d-4109-8741-489e9379981b None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:23.941041 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905310c-153d-4109-8741-489e9379981b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:23.989620 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-3905310c-153d-4109-8741-489e9379981b None None] MFA Rules not processed for user `bef18e4087ca446587e1c329881280a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:23.991314 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-3905310c-153d-4109-8741-489e9379981b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:24.067158 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 907/1794] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:05:23 2022] DELETE /identity/v3/users/4003968f16a54726aac6e8896821395e => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:24.246995 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1d16a-7e8f-4d76-92ac-b28c33e34e17 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:24.249854 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-cad1d16a-7e8f-4d76-92ac-b28c33e34e17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:24.424824 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1d16a-7e8f-4d76-92ac-b28c33e34e17 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:24.434655 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0a519-76b4-4978-a151-e3722f2980e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:24.435797 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0a519-76b4-4978-a151-e3722f2980e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:24.436248 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0a519-76b4-4978-a151-e3722f2980e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:24.436674 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0a519-76b4-4978-a151-e3722f2980e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:24.439254 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-72e0a519-76b4-4978-a151-e3722f2980e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:24.599693 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 888/1795] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:23 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 660 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:24.605387 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e0a519-76b4-4978-a151-e3722f2980e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:24.606966 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e0a519-76b4-4978-a151-e3722f2980e8 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:24.621246 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 908/1796] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:05:24 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:05:24.627800 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905310c-153d-4109-8741-489e9379981b None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:24.627800 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-3905310c-153d-4109-8741-489e9379981b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:24.785953 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905310c-153d-4109-8741-489e9379981b None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:24.791156 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32360c78-ef8a-400e-89f0-a8039b98b832 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:24.799901 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32360c78-ef8a-400e-89f0-a8039b98b832 service cinder] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:24.799901 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32360c78-ef8a-400e-89f0-a8039b98b832 service cinder] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:24.799901 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32360c78-ef8a-400e-89f0-a8039b98b832 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:24.799901 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-32360c78-ef8a-400e-89f0-a8039b98b832 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:24.917559 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32360c78-ef8a-400e-89f0-a8039b98b832 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:24.919969 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32360c78-ef8a-400e-89f0-a8039b98b832 service cinder] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:24.959911 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 889/1797] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:05:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:05:25.232806 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0a519-76b4-4978-a151-e3722f2980e8 service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:25.249976 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0a519-76b4-4978-a151-e3722f2980e8 service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:25.254798 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49f19f-fc9f-4d40-969f-f224e314c719 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:25.258050 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49f19f-fc9f-4d40-969f-f224e314c719 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:25.258583 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49f19f-fc9f-4d40-969f-f224e314c719 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:25.259007 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49f19f-fc9f-4d40-969f-f224e314c719 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:25.268809 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2a49f19f-fc9f-4d40-969f-f224e314c719 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:25.480149 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a49f19f-fc9f-4d40-969f-f224e314c719 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:25.484984 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a49f19f-fc9f-4d40-969f-f224e314c719 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:25.514287 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 909/1798] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:05:25 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:05:25.732388 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32360c78-ef8a-400e-89f0-a8039b98b832 service cinder] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:25.734510 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-32360c78-ef8a-400e-89f0-a8039b98b832 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:25.929273 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32360c78-ef8a-400e-89f0-a8039b98b832 service cinder] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:25.934982 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9daa94b-36c3-4192-b0ce-a3bc87b8376f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:25.936490 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9daa94b-36c3-4192-b0ce-a3bc87b8376f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:25.936490 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9daa94b-36c3-4192-b0ce-a3bc87b8376f admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:25.936765 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9daa94b-36c3-4192-b0ce-a3bc87b8376f admin admin] PATH_INFO: `/v3/projects/2008955135514724bb786040186d9918` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:25.937840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9daa94b-36c3-4192-b0ce-a3bc87b8376f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2008955135514724bb786040186d9918)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:25.939873 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9daa94b-36c3-4192-b0ce-a3bc87b8376f admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:26.095888 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-e9daa94b-36c3-4192-b0ce-a3bc87b8376f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2008955135514724bb786040186d9918', 'request_id': 'req-e9daa94b-36c3-4192-b0ce-a3bc87b8376f'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:26.107125 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-e9daa94b-36c3-4192-b0ce-a3bc87b8376f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2008955135514724bb786040186d9918', 'request_id': 'req-e9daa94b-36c3-4192-b0ce-a3bc87b8376f'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:26.114939 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-e9daa94b-36c3-4192-b0ce-a3bc87b8376f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2008955135514724bb786040186d9918', 'request_id': 'req-e9daa94b-36c3-4192-b0ce-a3bc87b8376f'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:26.267963 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-e9daa94b-36c3-4192-b0ce-a3bc87b8376f admin admin] The token cache is being invalidate because project 2008955135514724bb786040186d9918 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:05:26.269921 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-e9daa94b-36c3-4192-b0ce-a3bc87b8376f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:26.278199 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-e9daa94b-36c3-4192-b0ce-a3bc87b8376f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:26.285254 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 890/1799] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:05:25 2022] DELETE /identity/v3/projects/2008955135514724bb786040186d9918 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:26.288370 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a16a1d-e1cd-4ecd-8201-0642145c4a8a None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:26.289851 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a16a1d-e1cd-4ecd-8201-0642145c4a8a None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:26.293898 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a16a1d-e1cd-4ecd-8201-0642145c4a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:26.342189 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-d9a16a1d-e1cd-4ecd-8201-0642145c4a8a None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:26.345469 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d9a16a1d-e1cd-4ecd-8201-0642145c4a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:26.510755 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 910/1800] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:26.518798 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11e5cd-d7db-48b2-852f-1a2f8f9283b9 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:26.519084 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11e5cd-d7db-48b2-852f-1a2f8f9283b9 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:26.519434 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11e5cd-d7db-48b2-852f-1a2f8f9283b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:26.549164 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-3b11e5cd-d7db-48b2-852f-1a2f8f9283b9 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:26.552238 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-3b11e5cd-d7db-48b2-852f-1a2f8f9283b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:26.564827 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 891/1801] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:26.565808 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a16a1d-e1cd-4ecd-8201-0642145c4a8a None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:26.582790 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a16a1d-e1cd-4ecd-8201-0642145c4a8a None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:26.593167 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a05efa-d868-42d3-aabd-b18335545f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:26.599256 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a05efa-d868-42d3-aabd-b18335545f91 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:26.599256 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a05efa-d868-42d3-aabd-b18335545f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:26.599256 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a05efa-d868-42d3-aabd-b18335545f91 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:26.599256 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a05efa-d868-42d3-aabd-b18335545f91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:05:26.599256 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a05efa-d868-42d3-aabd-b18335545f91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:26.603168 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a05efa-d868-42d3-aabd-b18335545f91 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:26.661482 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 911/1802] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:05:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:05:26.665520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11e5cd-d7db-48b2-852f-1a2f8f9283b9 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:26.684680 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11e5cd-d7db-48b2-852f-1a2f8f9283b9 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:26.698725 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e209e-7c31-485e-a74e-cba8802c4c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:26.699982 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e209e-7c31-485e-a74e-cba8802c4c33 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:26.700130 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e209e-7c31-485e-a74e-cba8802c4c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:26.701024 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e209e-7c31-485e-a74e-cba8802c4c33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:26.702100 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e209e-7c31-485e-a74e-cba8802c4c33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:26.711049 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e209e-7c31-485e-a74e-cba8802c4c33 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:26.881500 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 892/1803] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:05:26 2022] POST /identity/v3/projects => generated 387 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:05:26.882160 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a05efa-d868-42d3-aabd-b18335545f91 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:26.895607 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a05efa-d868-42d3-aabd-b18335545f91 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:27.108420 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a6e58-bc48-4d7e-af23-afcfed689c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:27.109668 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a6e58-bc48-4d7e-af23-afcfed689c93 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:27.110244 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a6e58-bc48-4d7e-af23-afcfed689c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:27.111020 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a6e58-bc48-4d7e-af23-afcfed689c93 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:27.112413 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a6e58-bc48-4d7e-af23-afcfed689c93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:27.116673 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a6e58-bc48-4d7e-af23-afcfed689c93 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:27.242466 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 912/1804] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:05:26 2022] POST /identity/v3/users => generated 294 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 04:05:27.243412 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e209e-7c31-485e-a74e-cba8802c4c33 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:27.259765 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e209e-7c31-485e-a74e-cba8802c4c33 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:27.269517 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038261c1-f241-4dcc-a7bd-57a6e6c0ac19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:27.270708 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038261c1-f241-4dcc-a7bd-57a6e6c0ac19 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:27.271219 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038261c1-f241-4dcc-a7bd-57a6e6c0ac19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:27.271897 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038261c1-f241-4dcc-a7bd-57a6e6c0ac19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:27.273441 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038261c1-f241-4dcc-a7bd-57a6e6c0ac19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:27.277369 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038261c1-f241-4dcc-a7bd-57a6e6c0ac19 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:27.302277 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 893/1805] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:05:27.303080 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a6e58-bc48-4d7e-af23-afcfed689c93 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:27.318150 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a6e58-bc48-4d7e-af23-afcfed689c93 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:27.323742 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e3d7e-73d2-4943-9125-16d5a8f08471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:27.324471 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e3d7e-73d2-4943-9125-16d5a8f08471 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:27.324777 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e3d7e-73d2-4943-9125-16d5a8f08471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:27.325026 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e3d7e-73d2-4943-9125-16d5a8f08471 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:27.325777 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e3d7e-73d2-4943-9125-16d5a8f08471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:27.327576 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e3d7e-73d2-4943-9125-16d5a8f08471 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:27.340382 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 913/1806] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 04:05:27.346324 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038261c1-f241-4dcc-a7bd-57a6e6c0ac19 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:27.356682 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038261c1-f241-4dcc-a7bd-57a6e6c0ac19 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:27.361910 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337682c-8195-453a-8b9e-95a5cda33ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:27.362701 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337682c-8195-453a-8b9e-95a5cda33ead admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:27.362982 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337682c-8195-453a-8b9e-95a5cda33ead admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:27.363270 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337682c-8195-453a-8b9e-95a5cda33ead admin admin] PATH_INFO: `/v3/projects/778793bb191d4a36aa0d40c9c00c51de/users/bcbe1ec43e6e409f9636cedcbb7a782d/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:27.381131 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b337682c-8195-453a-8b9e-95a5cda33ead admin admin] RBAC: Authorizing `identity:create_grant(project_id=778793bb191d4a36aa0d40c9c00c51de, user_id=bcbe1ec43e6e409f9636cedcbb7a782d, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:27.384768 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b337682c-8195-453a-8b9e-95a5cda33ead admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:27.522653 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 894/1807] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:05:27 2022] PUT /identity/v3/projects/778793bb191d4a36aa0d40c9c00c51de/users/bcbe1ec43e6e409f9636cedcbb7a782d/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:27.536442 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd19459-70a9-414e-8f5f-18b3864087c4 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:27.536736 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd19459-70a9-414e-8f5f-18b3864087c4 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:27.537170 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd19459-70a9-414e-8f5f-18b3864087c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:27.572566 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa5718-7390-49f2-8100-c9570dfd9b0b None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:27.575857 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa5718-7390-49f2-8100-c9570dfd9b0b None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:27.579580 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa5718-7390-49f2-8100-c9570dfd9b0b None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:27.586635 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 895/1808] 10.222.0.46 () {54 vars in 921 bytes} [Fri Jul 1 04:05:27 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 04:05:27.605872 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf46438-933c-4a7f-b9bb-e4ef243ce919 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:27.605872 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf46438-933c-4a7f-b9bb-e4ef243ce919 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:27.606155 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf46438-933c-4a7f-b9bb-e4ef243ce919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:27.618647 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-6cd19459-70a9-414e-8f5f-18b3864087c4 None None] MFA Rules not processed for user `bcbe1ec43e6e409f9636cedcbb7a782d`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:27.620984 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-6cd19459-70a9-414e-8f5f-18b3864087c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:27.671842 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-5cf46438-933c-4a7f-b9bb-e4ef243ce919 None None] MFA Rules not processed for user `2da466ad31d344898f5c838f77d45181`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:27.674411 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-5cf46438-933c-4a7f-b9bb-e4ef243ce919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:27.756800 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 914/1809] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:27.768886 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd19459-70a9-414e-8f5f-18b3864087c4 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:27.890206 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 896/1810] 10.222.0.46 () {58 vars in 1018 bytes} [Fri Jul 1 04:05:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:27.945412 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf46438-933c-4a7f-b9bb-e4ef243ce919 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:27.952808 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-5cf46438-933c-4a7f-b9bb-e4ef243ce919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:27.999883 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd19459-70a9-414e-8f5f-18b3864087c4 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:28.001921 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf46438-933c-4a7f-b9bb-e4ef243ce919 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:28.016190 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dde5a0-84d1-481e-ad86-9a2aa96369e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:28.017619 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dde5a0-84d1-481e-ad86-9a2aa96369e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:28.017908 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dde5a0-84d1-481e-ad86-9a2aa96369e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:28.019398 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5ed2e-b561-4a57-9af3-bccec86bb172 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:28.019940 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dde5a0-84d1-481e-ad86-9a2aa96369e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:28.020154 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5ed2e-b561-4a57-9af3-bccec86bb172 service nova] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:28.020461 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5ed2e-b561-4a57-9af3-bccec86bb172 service nova] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:28.020988 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5ed2e-b561-4a57-9af3-bccec86bb172 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:28.021381 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dde5a0-84d1-481e-ad86-9a2aa96369e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:28.024307 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dde5a0-84d1-481e-ad86-9a2aa96369e6 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:28.056616 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d5ed2e-b561-4a57-9af3-bccec86bb172 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:28.056616 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d5ed2e-b561-4a57-9af3-bccec86bb172 service nova] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:28.069309 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 897/1811] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:05:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:05:28.220870 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 915/1812] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:05:27 2022] POST /identity/v3/projects => generated 389 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:05:28.222379 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5ed2e-b561-4a57-9af3-bccec86bb172 service nova] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:28.239159 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5ed2e-b561-4a57-9af3-bccec86bb172 service nova] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:28.427570 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f245172-d669-4c05-b06f-68f9caf29550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:28.430525 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f245172-d669-4c05-b06f-68f9caf29550 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:28.434139 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f245172-d669-4c05-b06f-68f9caf29550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:28.434772 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f245172-d669-4c05-b06f-68f9caf29550 admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:28.439130 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f245172-d669-4c05-b06f-68f9caf29550 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:28.447825 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f245172-d669-4c05-b06f-68f9caf29550 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:28.661389 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:28.671499 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 898/1813] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:05:28 2022] POST /identity/v3/users => generated 301 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 04:05:28.675682 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dde5a0-84d1-481e-ad86-9a2aa96369e6 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:28.692401 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dde5a0-84d1-481e-ad86-9a2aa96369e6 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:28.711016 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a4401-5c85-44f1-8406-31f537683761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:28.711946 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a4401-5c85-44f1-8406-31f537683761 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:28.712867 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a4401-5c85-44f1-8406-31f537683761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:28.714683 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a4401-5c85-44f1-8406-31f537683761 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:28.715132 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85a4401-5c85-44f1-8406-31f537683761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:28.717482 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85a4401-5c85-44f1-8406-31f537683761 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:28.740578 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 916/1814] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:05:28.744594 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f245172-d669-4c05-b06f-68f9caf29550 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:28.760646 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f245172-d669-4c05-b06f-68f9caf29550 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:28.766405 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61478dd8-75d4-4020-948f-3537fb0ec822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:28.773020 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61478dd8-75d4-4020-948f-3537fb0ec822 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:28.773599 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61478dd8-75d4-4020-948f-3537fb0ec822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:28.774087 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61478dd8-75d4-4020-948f-3537fb0ec822 admin admin] PATH_INFO: `/v3/projects/985d7171e2cd478d8fd23871de853276/users/33d4f3dd93b34d609f3ac7e7bd81acd2/roles/681755518698445fabd9a8accec13c0f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:28.793359 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61478dd8-75d4-4020-948f-3537fb0ec822 admin admin] RBAC: Authorizing `identity:create_grant(project_id=985d7171e2cd478d8fd23871de853276, user_id=33d4f3dd93b34d609f3ac7e7bd81acd2, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:28.796218 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61478dd8-75d4-4020-948f-3537fb0ec822 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:28.804996 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:28.989478 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 899/1815] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:05:28 2022] PUT /identity/v3/projects/985d7171e2cd478d8fd23871de853276/users/33d4f3dd93b34d609f3ac7e7bd81acd2/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:28.990432 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a4401-5c85-44f1-8406-31f537683761 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:29.014353 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a4401-5c85-44f1-8406-31f537683761 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:29.095071 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27dfe6-70d4-4c89-8dfa-f2d7215b3b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:29.096368 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27dfe6-70d4-4c89-8dfa-f2d7215b3b67 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:29.096368 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27dfe6-70d4-4c89-8dfa-f2d7215b3b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:29.096546 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27dfe6-70d4-4c89-8dfa-f2d7215b3b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:29.097334 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f27dfe6-70d4-4c89-8dfa-f2d7215b3b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:29.099314 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f27dfe6-70d4-4c89-8dfa-f2d7215b3b67 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:29.134119 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 917/1816] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:05:29.138214 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61478dd8-75d4-4020-948f-3537fb0ec822 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:29.153508 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61478dd8-75d4-4020-948f-3537fb0ec822 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:29.159288 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a003b-8476-43fa-8aa1-e9c311502995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:29.160433 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a003b-8476-43fa-8aa1-e9c311502995 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:29.160786 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a003b-8476-43fa-8aa1-e9c311502995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:29.161123 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a003b-8476-43fa-8aa1-e9c311502995 admin admin] PATH_INFO: `/v3/projects/985d7171e2cd478d8fd23871de853276/users/33d4f3dd93b34d609f3ac7e7bd81acd2/roles/681755518698445fabd9a8accec13c0f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:29.163541 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a003b-8476-43fa-8aa1-e9c311502995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=985d7171e2cd478d8fd23871de853276, user_id=33d4f3dd93b34d609f3ac7e7bd81acd2, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:29.166696 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a003b-8476-43fa-8aa1-e9c311502995 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:29.180995 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 900/1817] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:05:29 2022] PUT /identity/v3/projects/985d7171e2cd478d8fd23871de853276/users/33d4f3dd93b34d609f3ac7e7bd81acd2/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:29.192186 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5effce1e-b330-4345-a81c-e6eb368ba4de None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:29.192636 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5effce1e-b330-4345-a81c-e6eb368ba4de None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:29.192927 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5effce1e-b330-4345-a81c-e6eb368ba4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:29.240565 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-5effce1e-b330-4345-a81c-e6eb368ba4de None None] MFA Rules not processed for user `33d4f3dd93b34d609f3ac7e7bd81acd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:29.243729 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-5effce1e-b330-4345-a81c-e6eb368ba4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:29.362415 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 918/1818] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:29 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:29.374034 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a003b-8476-43fa-8aa1-e9c311502995 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:29.375844 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-3c6a003b-8476-43fa-8aa1-e9c311502995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:29.466531 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a003b-8476-43fa-8aa1-e9c311502995 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:29.474377 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35a174-993e-4be8-a221-9cdd52c598ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:29.474620 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35a174-993e-4be8-a221-9cdd52c598ab service cinder] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:29.474928 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35a174-993e-4be8-a221-9cdd52c598ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:29.475204 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35a174-993e-4be8-a221-9cdd52c598ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:29.488742 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b35a174-993e-4be8-a221-9cdd52c598ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:29.490290 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b35a174-993e-4be8-a221-9cdd52c598ab service cinder] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:29.507648 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 901/1819] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:05:29 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:05:29.697530 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5effce1e-b330-4345-a81c-e6eb368ba4de None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:29.773953 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5effce1e-b330-4345-a81c-e6eb368ba4de None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:29.779178 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85071e0-24f3-49d8-8b10-478f15966df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:29.780319 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85071e0-24f3-49d8-8b10-478f15966df4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:29.780616 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85071e0-24f3-49d8-8b10-478f15966df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:29.780896 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85071e0-24f3-49d8-8b10-478f15966df4 admin admin] PATH_INFO: `/v3/users/bcbe1ec43e6e409f9636cedcbb7a782d` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:29.782157 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85071e0-24f3-49d8-8b10-478f15966df4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcbe1ec43e6e409f9636cedcbb7a782d)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:29.784188 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85071e0-24f3-49d8-8b10-478f15966df4 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:30.202620 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d85071e0-24f3-49d8-8b10-478f15966df4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcbe1ec43e6e409f9636cedcbb7a782d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:30.204532 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d85071e0-24f3-49d8-8b10-478f15966df4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcbe1ec43e6e409f9636cedcbb7a782d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:30.241715 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d85071e0-24f3-49d8-8b10-478f15966df4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcbe1ec43e6e409f9636cedcbb7a782d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:30.264062 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d85071e0-24f3-49d8-8b10-478f15966df4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcbe1ec43e6e409f9636cedcbb7a782d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:30.264062 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d85071e0-24f3-49d8-8b10-478f15966df4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcbe1ec43e6e409f9636cedcbb7a782d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:30.402536 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 919/1820] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:05:29 2022] DELETE /identity/v3/users/bcbe1ec43e6e409f9636cedcbb7a782d => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:30.418926 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c667b1-a065-472b-a045-20348d006f30 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:30.419980 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c667b1-a065-472b-a045-20348d006f30 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:30.420750 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c667b1-a065-472b-a045-20348d006f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:30.483174 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-20c667b1-a065-472b-a045-20348d006f30 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:30.491970 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-20c667b1-a065-472b-a045-20348d006f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:30.662299 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 902/1821] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:30.674183 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85071e0-24f3-49d8-8b10-478f15966df4 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:30.676485 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d85071e0-24f3-49d8-8b10-478f15966df4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:30.872767 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85071e0-24f3-49d8-8b10-478f15966df4 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:30.884003 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8186ff9c-91af-45d7-bea7-69776d70f1f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:30.886917 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186ff9c-91af-45d7-bea7-69776d70f1f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:30.887569 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186ff9c-91af-45d7-bea7-69776d70f1f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:30.888189 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186ff9c-91af-45d7-bea7-69776d70f1f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:30.920852 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8186ff9c-91af-45d7-bea7-69776d70f1f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:30.928498 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8186ff9c-91af-45d7-bea7-69776d70f1f2 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:30.958819 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 920/1822] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:05:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:05:31.268043 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c667b1-a065-472b-a045-20348d006f30 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:31.269389 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-20c667b1-a065-472b-a045-20348d006f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:31.381831 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c667b1-a065-472b-a045-20348d006f30 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:31.392301 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b12283-3bc6-4e27-a4ee-bafef1525fe2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:31.392301 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b12283-3bc6-4e27-a4ee-bafef1525fe2 service cinder] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:31.392301 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b12283-3bc6-4e27-a4ee-bafef1525fe2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:31.392301 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b12283-3bc6-4e27-a4ee-bafef1525fe2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:31.392714 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-a8b12283-3bc6-4e27-a4ee-bafef1525fe2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:31.488528 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8186ff9c-91af-45d7-bea7-69776d70f1f2 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:31.491366 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8186ff9c-91af-45d7-bea7-69776d70f1f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:31.511554 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8186ff9c-91af-45d7-bea7-69776d70f1f2 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:31.535054 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e963c83-c62f-40c2-8a0f-79ab2f21feb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:31.536033 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e963c83-c62f-40c2-8a0f-79ab2f21feb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:31.536362 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e963c83-c62f-40c2-8a0f-79ab2f21feb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:31.536638 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e963c83-c62f-40c2-8a0f-79ab2f21feb1 admin admin] PATH_INFO: `/v3/users/193b37c1cf5647869c024b804a38e314` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:31.538543 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b12283-3bc6-4e27-a4ee-bafef1525fe2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:31.539066 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e963c83-c62f-40c2-8a0f-79ab2f21feb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=193b37c1cf5647869c024b804a38e314)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:31.541586 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b12283-3bc6-4e27-a4ee-bafef1525fe2 service cinder] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:31.543721 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e963c83-c62f-40c2-8a0f-79ab2f21feb1 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:31.567882 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 903/1823] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:05:31 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 04:05:31.871728 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-4e963c83-c62f-40c2-8a0f-79ab2f21feb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '193b37c1cf5647869c024b804a38e314'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:31.876140 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-4e963c83-c62f-40c2-8a0f-79ab2f21feb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '193b37c1cf5647869c024b804a38e314'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:31.907215 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-4e963c83-c62f-40c2-8a0f-79ab2f21feb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '193b37c1cf5647869c024b804a38e314'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:31.926665 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-4e963c83-c62f-40c2-8a0f-79ab2f21feb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '193b37c1cf5647869c024b804a38e314'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:31.928075 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-4e963c83-c62f-40c2-8a0f-79ab2f21feb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '193b37c1cf5647869c024b804a38e314'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:31.936040 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:32.076992 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 921/1824] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:05:31 2022] DELETE /identity/v3/users/193b37c1cf5647869c024b804a38e314 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:32.083309 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82472c7d-6c1d-4d6c-9d68-c358f62e839d None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:32.083309 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82472c7d-6c1d-4d6c-9d68-c358f62e839d None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:32.083309 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82472c7d-6c1d-4d6c-9d68-c358f62e839d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:32.145020 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e963c83-c62f-40c2-8a0f-79ab2f21feb1 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:32.147092 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-4e963c83-c62f-40c2-8a0f-79ab2f21feb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:32.149732 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-82472c7d-6c1d-4d6c-9d68-c358f62e839d None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:32.153666 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-82472c7d-6c1d-4d6c-9d68-c358f62e839d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:32.370607 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e963c83-c62f-40c2-8a0f-79ab2f21feb1 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:32.389903 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc48a2-1b02-4001-8dc3-436226017675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:32.390887 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc48a2-1b02-4001-8dc3-436226017675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:32.391177 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc48a2-1b02-4001-8dc3-436226017675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:32.391471 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc48a2-1b02-4001-8dc3-436226017675 admin admin] PATH_INFO: `/v3/projects/778793bb191d4a36aa0d40c9c00c51de` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:32.396625 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dc48a2-1b02-4001-8dc3-436226017675 admin admin] RBAC: Authorizing `identity:delete_project(project_id=778793bb191d4a36aa0d40c9c00c51de)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:32.398938 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dc48a2-1b02-4001-8dc3-436226017675 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:32.437341 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 904/1825] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 04:05:32.497859 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82472c7d-6c1d-4d6c-9d68-c358f62e839d None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:32.500330 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-82472c7d-6c1d-4d6c-9d68-c358f62e839d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:32.629567 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-64dc48a2-1b02-4001-8dc3-436226017675 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '778793bb191d4a36aa0d40c9c00c51de', 'request_id': 'req-64dc48a2-1b02-4001-8dc3-436226017675'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:32.697554 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82472c7d-6c1d-4d6c-9d68-c358f62e839d None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:32.778176 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-64dc48a2-1b02-4001-8dc3-436226017675 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '778793bb191d4a36aa0d40c9c00c51de', 'request_id': 'req-64dc48a2-1b02-4001-8dc3-436226017675'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:32.786799 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-64dc48a2-1b02-4001-8dc3-436226017675 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '778793bb191d4a36aa0d40c9c00c51de', 'request_id': 'req-64dc48a2-1b02-4001-8dc3-436226017675'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:32.816955 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-64dc48a2-1b02-4001-8dc3-436226017675 admin admin] The token cache is being invalidate because project 778793bb191d4a36aa0d40c9c00c51de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:05:32.817247 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-64dc48a2-1b02-4001-8dc3-436226017675 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:32.819002 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-64dc48a2-1b02-4001-8dc3-436226017675 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:32.824406 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 922/1826] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:05:32 2022] DELETE /identity/v3/projects/778793bb191d4a36aa0d40c9c00c51de => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:32.828409 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc48a2-1b02-4001-8dc3-436226017675 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:32.830418 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-64dc48a2-1b02-4001-8dc3-436226017675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:32.893271 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137878e2-d3c0-4b62-8770-3c4feb0024d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:32.896021 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137878e2-d3c0-4b62-8770-3c4feb0024d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:32.897701 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137878e2-d3c0-4b62-8770-3c4feb0024d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:32.901110 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137878e2-d3c0-4b62-8770-3c4feb0024d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:32.908948 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-137878e2-d3c0-4b62-8770-3c4feb0024d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:32.987576 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc48a2-1b02-4001-8dc3-436226017675 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:32.997488 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92861dc-9731-4619-965f-d865ebd6c447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:32.998446 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92861dc-9731-4619-965f-d865ebd6c447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:32.998752 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92861dc-9731-4619-965f-d865ebd6c447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:32.999047 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92861dc-9731-4619-965f-d865ebd6c447 admin admin] PATH_INFO: `/v3/users/33d4f3dd93b34d609f3ac7e7bd81acd2` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:33.005808 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92861dc-9731-4619-965f-d865ebd6c447 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33d4f3dd93b34d609f3ac7e7bd81acd2)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:33.008190 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92861dc-9731-4619-965f-d865ebd6c447 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:33.088942 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137878e2-d3c0-4b62-8770-3c4feb0024d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:33.088942 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137878e2-d3c0-4b62-8770-3c4feb0024d8 service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:33.122998 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 905/1827] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:05:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 04:05:33.128203 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d1a40-f924-4cae-8669-efa2207cc01b None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:33.128911 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d1a40-f924-4cae-8669-efa2207cc01b None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:33.129554 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d1a40-f924-4cae-8669-efa2207cc01b None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:33.133222 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 906/1828] 10.222.0.46 () {54 vars in 921 bytes} [Fri Jul 1 04:05:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 04:05:33.163309 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7413a-8a70-47c1-a7b9-119015453b83 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:33.163962 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7413a-8a70-47c1-a7b9-119015453b83 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:33.166926 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7413a-8a70-47c1-a7b9-119015453b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:33.266332 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-3ed7413a-8a70-47c1-a7b9-119015453b83 None None] MFA Rules not processed for user `2da466ad31d344898f5c838f77d45181`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:33.268644 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-3ed7413a-8a70-47c1-a7b9-119015453b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:33.343524 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d92861dc-9731-4619-965f-d865ebd6c447 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33d4f3dd93b34d609f3ac7e7bd81acd2'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:33.344610 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d92861dc-9731-4619-965f-d865ebd6c447 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33d4f3dd93b34d609f3ac7e7bd81acd2'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:33.377924 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d92861dc-9731-4619-965f-d865ebd6c447 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33d4f3dd93b34d609f3ac7e7bd81acd2'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:33.394302 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d92861dc-9731-4619-965f-d865ebd6c447 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33d4f3dd93b34d609f3ac7e7bd81acd2'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:33.395928 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d92861dc-9731-4619-965f-d865ebd6c447 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33d4f3dd93b34d609f3ac7e7bd81acd2'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:33.499359 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 907/1829] 10.222.0.46 () {58 vars in 1018 bytes} [Fri Jul 1 04:05:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:33.525579 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 923/1830] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:05:32 2022] DELETE /identity/v3/users/33d4f3dd93b34d609f3ac7e7bd81acd2 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:05:33.710780 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed7413a-8a70-47c1-a7b9-119015453b83 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:33.718581 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-3ed7413a-8a70-47c1-a7b9-119015453b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:33.751904 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed7413a-8a70-47c1-a7b9-119015453b83 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:33.970916 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64a04a-64a1-4c86-9205-3330ab6b2e31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:33.972391 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64a04a-64a1-4c86-9205-3330ab6b2e31 service nova] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:33.974335 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64a04a-64a1-4c86-9205-3330ab6b2e31 service nova] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:33.975340 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64a04a-64a1-4c86-9205-3330ab6b2e31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:34.012119 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e64a04a-64a1-4c86-9205-3330ab6b2e31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:34.016853 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e64a04a-64a1-4c86-9205-3330ab6b2e31 service nova] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:34.035940 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:34.047699 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 908/1831] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:05:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:05:34.426408 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92861dc-9731-4619-965f-d865ebd6c447 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:34.430261 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d92861dc-9731-4619-965f-d865ebd6c447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:34.492749 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64a04a-64a1-4c86-9205-3330ab6b2e31 service nova] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:34.495858 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-8e64a04a-64a1-4c86-9205-3330ab6b2e31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:34.725754 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92861dc-9731-4619-965f-d865ebd6c447 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:34.748172 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d6366-926e-4c17-b94b-68df89916bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:34.751423 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d6366-926e-4c17-b94b-68df89916bf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:34.752963 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d6366-926e-4c17-b94b-68df89916bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:34.754531 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d6366-926e-4c17-b94b-68df89916bf5 admin admin] PATH_INFO: `/v3/projects/985d7171e2cd478d8fd23871de853276` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:34.757212 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d6366-926e-4c17-b94b-68df89916bf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=985d7171e2cd478d8fd23871de853276)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:34.766128 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d6366-926e-4c17-b94b-68df89916bf5 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:34.805366 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64a04a-64a1-4c86-9205-3330ab6b2e31 service nova] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:34.825968 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae98097-7567-44cd-a04c-c4c72eb5de66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:34.827608 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae98097-7567-44cd-a04c-c4c72eb5de66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:34.827946 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae98097-7567-44cd-a04c-c4c72eb5de66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:34.828414 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae98097-7567-44cd-a04c-c4c72eb5de66 admin admin] PATH_INFO: `/v3/projects/df3b6413d24b43498e9dd4720e69b30c` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:34.830811 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae98097-7567-44cd-a04c-c4c72eb5de66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df3b6413d24b43498e9dd4720e69b30c)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:34.834376 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae98097-7567-44cd-a04c-c4c72eb5de66 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:35.022812 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-695d6366-926e-4c17-b94b-68df89916bf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '985d7171e2cd478d8fd23871de853276', 'request_id': 'req-695d6366-926e-4c17-b94b-68df89916bf5'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:35.108195 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-cae98097-7567-44cd-a04c-c4c72eb5de66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df3b6413d24b43498e9dd4720e69b30c', 'request_id': 'req-cae98097-7567-44cd-a04c-c4c72eb5de66'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:35.118703 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-cae98097-7567-44cd-a04c-c4c72eb5de66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df3b6413d24b43498e9dd4720e69b30c', 'request_id': 'req-cae98097-7567-44cd-a04c-c4c72eb5de66'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:35.130668 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-cae98097-7567-44cd-a04c-c4c72eb5de66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df3b6413d24b43498e9dd4720e69b30c', 'request_id': 'req-cae98097-7567-44cd-a04c-c4c72eb5de66'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:35.219859 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-695d6366-926e-4c17-b94b-68df89916bf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '985d7171e2cd478d8fd23871de853276', 'request_id': 'req-695d6366-926e-4c17-b94b-68df89916bf5'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:35.227958 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-695d6366-926e-4c17-b94b-68df89916bf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '985d7171e2cd478d8fd23871de853276', 'request_id': 'req-695d6366-926e-4c17-b94b-68df89916bf5'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:35.254373 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-695d6366-926e-4c17-b94b-68df89916bf5 admin admin] The token cache is being invalidate because project 985d7171e2cd478d8fd23871de853276 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:05:35.254686 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-695d6366-926e-4c17-b94b-68df89916bf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:35.255569 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-695d6366-926e-4c17-b94b-68df89916bf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:35.261652 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 924/1832] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:05:34 2022] DELETE /identity/v3/projects/985d7171e2cd478d8fd23871de853276 => generated 0 bytes in 832 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:05:35.265483 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0d630-f861-49ba-b354-614f879f021c None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:35.265483 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0d630-f861-49ba-b354-614f879f021c None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:35.265483 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0d630-f861-49ba-b354-614f879f021c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:35.292679 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-dae0d630-f861-49ba-b354-614f879f021c None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:35.294201 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-dae0d630-f861-49ba-b354-614f879f021c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:35.394751 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-cae98097-7567-44cd-a04c-c4c72eb5de66 admin admin] The token cache is being invalidate because project df3b6413d24b43498e9dd4720e69b30c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:05:35.395716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-cae98097-7567-44cd-a04c-c4c72eb5de66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:35.396919 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-cae98097-7567-44cd-a04c-c4c72eb5de66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:35.400242 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 909/1833] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:05:34 2022] DELETE /identity/v3/projects/df3b6413d24b43498e9dd4720e69b30c => generated 0 bytes in 908 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:35.405578 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae98097-7567-44cd-a04c-c4c72eb5de66 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:35.412476 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-cae98097-7567-44cd-a04c-c4c72eb5de66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:35.416634 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 925/1834] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:35.429855 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93df40-08df-49e2-8737-2dc181e00142 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:35.430465 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93df40-08df-49e2-8737-2dc181e00142 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:35.430796 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93df40-08df-49e2-8737-2dc181e00142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:35.437997 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae98097-7567-44cd-a04c-c4c72eb5de66 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:35.442998 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793b458-cb40-467e-87a6-bd699fe63155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:35.444484 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793b458-cb40-467e-87a6-bd699fe63155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:35.444786 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793b458-cb40-467e-87a6-bd699fe63155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:35.445195 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793b458-cb40-467e-87a6-bd699fe63155 admin admin] PATH_INFO: `/v3/users/42aae24063b24e20830c825c4e85a56b` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:35.446614 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d793b458-cb40-467e-87a6-bd699fe63155 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42aae24063b24e20830c825c4e85a56b)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:35.449447 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d793b458-cb40-467e-87a6-bd699fe63155 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:35.463428 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-dc93df40-08df-49e2-8737-2dc181e00142 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:35.466042 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-dc93df40-08df-49e2-8737-2dc181e00142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:35.481834 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 926/1835] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:35.488910 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93df40-08df-49e2-8737-2dc181e00142 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:35.503852 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93df40-08df-49e2-8737-2dc181e00142 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:35.512059 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fe6a0-847f-4fd0-930c-17471685245f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:35.512869 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fe6a0-847f-4fd0-930c-17471685245f admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:35.513374 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fe6a0-847f-4fd0-930c-17471685245f admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:35.513746 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fe6a0-847f-4fd0-930c-17471685245f admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:35.514561 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740fe6a0-847f-4fd0-930c-17471685245f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:05:35.514931 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740fe6a0-847f-4fd0-930c-17471685245f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:35.516956 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740fe6a0-847f-4fd0-930c-17471685245f admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:35.537904 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 927/1836] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:05:35.543408 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fe6a0-847f-4fd0-930c-17471685245f admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:35.564060 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fe6a0-847f-4fd0-930c-17471685245f admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:35.567832 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5af20a-5862-4555-bd3c-924f61f88b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:35.568522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5af20a-5862-4555-bd3c-924f61f88b8d admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:35.568801 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5af20a-5862-4555-bd3c-924f61f88b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:35.569126 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5af20a-5862-4555-bd3c-924f61f88b8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:35.569813 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5af20a-5862-4555-bd3c-924f61f88b8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:35.572118 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5af20a-5862-4555-bd3c-924f61f88b8d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:35.822591 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 928/1837] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:05:35 2022] POST /identity/v3/projects => generated 381 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 04:05:35.828392 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5af20a-5862-4555-bd3c-924f61f88b8d admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:35.889466 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-d793b458-cb40-467e-87a6-bd699fe63155 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42aae24063b24e20830c825c4e85a56b'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:35.891514 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-d793b458-cb40-467e-87a6-bd699fe63155 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42aae24063b24e20830c825c4e85a56b'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:35.949615 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5af20a-5862-4555-bd3c-924f61f88b8d admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:35.955610 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a469d9-ba18-4e84-807f-63c824f26abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:35.956626 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a469d9-ba18-4e84-807f-63c824f26abb admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:35.956626 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a469d9-ba18-4e84-807f-63c824f26abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:35.956884 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a469d9-ba18-4e84-807f-63c824f26abb admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:35.957597 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a469d9-ba18-4e84-807f-63c824f26abb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:35.959675 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a469d9-ba18-4e84-807f-63c824f26abb admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:35.995356 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:36.052556 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-d793b458-cb40-467e-87a6-bd699fe63155 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42aae24063b24e20830c825c4e85a56b'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:36.053438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-d793b458-cb40-467e-87a6-bd699fe63155 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42aae24063b24e20830c825c4e85a56b'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:36.061700 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-d793b458-cb40-467e-87a6-bd699fe63155 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42aae24063b24e20830c825c4e85a56b'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:36.083583 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 910/1838] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:05:35 2022] DELETE /identity/v3/users/42aae24063b24e20830c825c4e85a56b => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:36.128053 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 929/1839] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:05:35 2022] POST /identity/v3/users => generated 291 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 04:05:36.132089 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793b458-cb40-467e-87a6-bd699fe63155 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:36.134075 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-d793b458-cb40-467e-87a6-bd699fe63155 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:36.230464 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793b458-cb40-467e-87a6-bd699fe63155 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:36.235239 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbcce8b-639a-421e-b0c5-d38af53693ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:36.236047 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbcce8b-639a-421e-b0c5-d38af53693ac admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:36.236424 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbcce8b-639a-421e-b0c5-d38af53693ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:36.236810 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbcce8b-639a-421e-b0c5-d38af53693ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:36.237643 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbcce8b-639a-421e-b0c5-d38af53693ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:36.239386 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbcce8b-639a-421e-b0c5-d38af53693ac admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:36.251174 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 911/1840] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:05:36.255343 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a469d9-ba18-4e84-807f-63c824f26abb admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:36.278166 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a469d9-ba18-4e84-807f-63c824f26abb admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:36.283320 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd261bbc-f8bc-475c-8b75-23434a20467a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:36.284099 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd261bbc-f8bc-475c-8b75-23434a20467a admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:36.284388 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd261bbc-f8bc-475c-8b75-23434a20467a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:36.284670 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd261bbc-f8bc-475c-8b75-23434a20467a admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:36.285516 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd261bbc-f8bc-475c-8b75-23434a20467a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:36.287096 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd261bbc-f8bc-475c-8b75-23434a20467a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:36.301165 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 930/1841] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:05:36.305305 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbcce8b-639a-421e-b0c5-d38af53693ac admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:36.321206 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbcce8b-639a-421e-b0c5-d38af53693ac admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:36.328203 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62273d7c-35c4-404e-a72c-c257a1e621ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:36.328560 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62273d7c-35c4-404e-a72c-c257a1e621ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:36.328840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62273d7c-35c4-404e-a72c-c257a1e621ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:36.329117 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62273d7c-35c4-404e-a72c-c257a1e621ef admin admin] PATH_INFO: `/v3/projects/46a47a37327f4b64be43ee592d8aa381/users/5fd153a660044ebfbd809e55cc6479c7/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:36.362436 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62273d7c-35c4-404e-a72c-c257a1e621ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=46a47a37327f4b64be43ee592d8aa381, user_id=5fd153a660044ebfbd809e55cc6479c7, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:36.366120 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62273d7c-35c4-404e-a72c-c257a1e621ef admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:36.666019 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 912/1842] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:05:36 2022] PUT /identity/v3/projects/46a47a37327f4b64be43ee592d8aa381/users/5fd153a660044ebfbd809e55cc6479c7/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:36.686015 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df0728-7148-498e-a8ee-2a0903ecd25c None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:36.686777 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df0728-7148-498e-a8ee-2a0903ecd25c None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:36.687633 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df0728-7148-498e-a8ee-2a0903ecd25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:36.728479 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-41df0728-7148-498e-a8ee-2a0903ecd25c None None] MFA Rules not processed for user `5fd153a660044ebfbd809e55cc6479c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:36.730445 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-41df0728-7148-498e-a8ee-2a0903ecd25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:36.818789 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 931/1843] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:36.823791 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62273d7c-35c4-404e-a72c-c257a1e621ef admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:36.901027 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62273d7c-35c4-404e-a72c-c257a1e621ef admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:36.913822 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95994411-1444-4217-ad1c-d3d9f33e2477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:36.914535 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95994411-1444-4217-ad1c-d3d9f33e2477 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:36.914816 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95994411-1444-4217-ad1c-d3d9f33e2477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:36.915088 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95994411-1444-4217-ad1c-d3d9f33e2477 admin admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:36.918907 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95994411-1444-4217-ad1c-d3d9f33e2477 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:36.918907 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95994411-1444-4217-ad1c-d3d9f33e2477 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:36.950251 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df0728-7148-498e-a8ee-2a0903ecd25c None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:36.957088 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-41df0728-7148-498e-a8ee-2a0903ecd25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:37.012780 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df0728-7148-498e-a8ee-2a0903ecd25c None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:37.018216 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa89ac-1f21-470a-b43f-bc02244d064f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:37.025947 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa89ac-1f21-470a-b43f-bc02244d064f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:37.025947 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa89ac-1f21-470a-b43f-bc02244d064f admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:37.025947 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa89ac-1f21-470a-b43f-bc02244d064f admin admin] PATH_INFO: `/v3/projects/57f28af32c8042c1b0e43df047a89a3e` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:37.025947 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aa89ac-1f21-470a-b43f-bc02244d064f admin admin] RBAC: Authorizing `identity:delete_project(project_id=57f28af32c8042c1b0e43df047a89a3e)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:37.025947 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aa89ac-1f21-470a-b43f-bc02244d064f admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:37.112620 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 913/1844] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:05:36 2022] POST /identity/v3/projects => generated 383 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:05:37.117097 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95994411-1444-4217-ad1c-d3d9f33e2477 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:37.210770 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-44aa89ac-1f21-470a-b43f-bc02244d064f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57f28af32c8042c1b0e43df047a89a3e', 'request_id': 'req-44aa89ac-1f21-470a-b43f-bc02244d064f'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:37.238354 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95994411-1444-4217-ad1c-d3d9f33e2477 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:37.310177 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec680fbb-6446-4294-8e9c-279c29468e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:37.310858 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec680fbb-6446-4294-8e9c-279c29468e3f admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:37.311141 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec680fbb-6446-4294-8e9c-279c29468e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:37.311414 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec680fbb-6446-4294-8e9c-279c29468e3f admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:37.312396 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec680fbb-6446-4294-8e9c-279c29468e3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:37.314495 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec680fbb-6446-4294-8e9c-279c29468e3f admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:37.324829 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-44aa89ac-1f21-470a-b43f-bc02244d064f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57f28af32c8042c1b0e43df047a89a3e', 'request_id': 'req-44aa89ac-1f21-470a-b43f-bc02244d064f'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:37.337626 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-44aa89ac-1f21-470a-b43f-bc02244d064f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57f28af32c8042c1b0e43df047a89a3e', 'request_id': 'req-44aa89ac-1f21-470a-b43f-bc02244d064f'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:37.352024 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-44aa89ac-1f21-470a-b43f-bc02244d064f admin admin] The token cache is being invalidate because project 57f28af32c8042c1b0e43df047a89a3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:05:37.352223 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-44aa89ac-1f21-470a-b43f-bc02244d064f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:37.352880 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-44aa89ac-1f21-470a-b43f-bc02244d064f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:37.355145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 932/1845] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:05:36 2022] DELETE /identity/v3/projects/57f28af32c8042c1b0e43df047a89a3e => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:05:37.360130 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59b79d-efd4-4ebe-8cfe-7a69bf158470 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:37.368063 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59b79d-efd4-4ebe-8cfe-7a69bf158470 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:37.368063 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59b79d-efd4-4ebe-8cfe-7a69bf158470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:37.380074 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-2c59b79d-efd4-4ebe-8cfe-7a69bf158470 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:37.381293 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2c59b79d-efd4-4ebe-8cfe-7a69bf158470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:37.390533 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 933/1846] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 04:05:37.411549 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e104ec-1ec5-46c7-9ad2-a2589946e2df None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:37.411843 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e104ec-1ec5-46c7-9ad2-a2589946e2df None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:37.412122 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e104ec-1ec5-46c7-9ad2-a2589946e2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:37.429811 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 914/1847] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:05:37 2022] POST /identity/v3/users => generated 298 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:05:37.431325 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-51e104ec-1ec5-46c7-9ad2-a2589946e2df None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:37.433269 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-51e104ec-1ec5-46c7-9ad2-a2589946e2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:37.434193 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec680fbb-6446-4294-8e9c-279c29468e3f admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:37.435896 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-ec680fbb-6446-4294-8e9c-279c29468e3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:37.442935 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 934/1848] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 04:05:37.445928 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e104ec-1ec5-46c7-9ad2-a2589946e2df None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:37.447963 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec680fbb-6446-4294-8e9c-279c29468e3f admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:37.452663 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c565c97-d6e5-45ae-9a38-2ddd208209ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:37.453327 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c565c97-d6e5-45ae-9a38-2ddd208209ba admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:37.453607 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c565c97-d6e5-45ae-9a38-2ddd208209ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:37.453877 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c565c97-d6e5-45ae-9a38-2ddd208209ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:37.454596 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c565c97-d6e5-45ae-9a38-2ddd208209ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:37.455032 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e104ec-1ec5-46c7-9ad2-a2589946e2df None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:37.456223 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c565c97-d6e5-45ae-9a38-2ddd208209ba admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:37.459934 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b774584-900e-4ed8-a09f-64e02821e99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:37.464316 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b774584-900e-4ed8-a09f-64e02821e99b admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:37.464316 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b774584-900e-4ed8-a09f-64e02821e99b admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:37.464316 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b774584-900e-4ed8-a09f-64e02821e99b admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:37.464316 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b774584-900e-4ed8-a09f-64e02821e99b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:05:37.464316 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b774584-900e-4ed8-a09f-64e02821e99b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:37.464316 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b774584-900e-4ed8-a09f-64e02821e99b admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:37.470975 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 915/1849] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 04:05:37.472025 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c565c97-d6e5-45ae-9a38-2ddd208209ba admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:37.486693 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 935/1850] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:05:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 04:05:37.487298 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c565c97-d6e5-45ae-9a38-2ddd208209ba admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:37.487908 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b774584-900e-4ed8-a09f-64e02821e99b admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:37.491703 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1130e1-2ed6-4fd5-b5fb-a0df59c1660e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:37.492603 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1130e1-2ed6-4fd5-b5fb-a0df59c1660e admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:37.492884 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1130e1-2ed6-4fd5-b5fb-a0df59c1660e admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:37.493154 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1130e1-2ed6-4fd5-b5fb-a0df59c1660e admin admin] PATH_INFO: `/v3/projects/4bf0b38d4e7448e2ab9f2fbd41a52c78/users/986c0509603c452ead9edd29438f9dfb/roles/681755518698445fabd9a8accec13c0f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:37.498556 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b774584-900e-4ed8-a09f-64e02821e99b admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:37.503876 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3bfd7-2243-4599-a834-b09c2a456155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:37.504599 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3bfd7-2243-4599-a834-b09c2a456155 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:37.504881 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3bfd7-2243-4599-a834-b09c2a456155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:37.505160 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3bfd7-2243-4599-a834-b09c2a456155 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:37.505865 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3bfd7-2243-4599-a834-b09c2a456155 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:37.508572 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3bfd7-2243-4599-a834-b09c2a456155 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:37.511514 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1130e1-2ed6-4fd5-b5fb-a0df59c1660e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bf0b38d4e7448e2ab9f2fbd41a52c78, user_id=986c0509603c452ead9edd29438f9dfb, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:37.514387 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1130e1-2ed6-4fd5-b5fb-a0df59c1660e admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:37.637029 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 916/1851] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:05:37 2022] PUT /identity/v3/projects/4bf0b38d4e7448e2ab9f2fbd41a52c78/users/986c0509603c452ead9edd29438f9dfb/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:05:37.641169 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1130e1-2ed6-4fd5-b5fb-a0df59c1660e admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:37.680017 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 936/1852] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:05:37 2022] POST /identity/v3/projects => generated 391 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 04:05:37.683922 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3bfd7-2243-4599-a834-b09c2a456155 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:37.741760 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1130e1-2ed6-4fd5-b5fb-a0df59c1660e admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:37.778141 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3bfd7-2243-4599-a834-b09c2a456155 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:37.786408 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0370917-b566-499d-b49d-842992e3d21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:37.787669 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0370917-b566-499d-b49d-842992e3d21d admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:37.788150 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0370917-b566-499d-b49d-842992e3d21d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:37.788624 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0370917-b566-499d-b49d-842992e3d21d admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:37.789520 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0370917-b566-499d-b49d-842992e3d21d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:37.792550 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0370917-b566-499d-b49d-842992e3d21d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:37.845390 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32348013-d0d8-4aa0-84c1-ce7b4d784b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:37.850322 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32348013-d0d8-4aa0-84c1-ce7b4d784b9a admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:37.850322 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32348013-d0d8-4aa0-84c1-ce7b4d784b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:37.850322 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32348013-d0d8-4aa0-84c1-ce7b4d784b9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:37.850322 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32348013-d0d8-4aa0-84c1-ce7b4d784b9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:37.850322 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32348013-d0d8-4aa0-84c1-ce7b4d784b9a admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:37.861908 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 917/1853] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 04:05:37.865437 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32348013-d0d8-4aa0-84c1-ce7b4d784b9a admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:37.877621 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32348013-d0d8-4aa0-84c1-ce7b4d784b9a admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:37.886137 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad9167-d246-44ba-a83d-39d12671613a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:37.888321 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad9167-d246-44ba-a83d-39d12671613a admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:37.888321 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad9167-d246-44ba-a83d-39d12671613a admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:37.888321 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad9167-d246-44ba-a83d-39d12671613a admin admin] PATH_INFO: `/v3/projects/4bf0b38d4e7448e2ab9f2fbd41a52c78/users/986c0509603c452ead9edd29438f9dfb/roles/681755518698445fabd9a8accec13c0f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:37.890122 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cad9167-d246-44ba-a83d-39d12671613a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bf0b38d4e7448e2ab9f2fbd41a52c78, user_id=986c0509603c452ead9edd29438f9dfb, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:37.893060 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cad9167-d246-44ba-a83d-39d12671613a admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:37.907541 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 918/1854] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:05:37 2022] PUT /identity/v3/projects/4bf0b38d4e7448e2ab9f2fbd41a52c78/users/986c0509603c452ead9edd29438f9dfb/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:05:37.918719 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925b247-f4bb-4dfd-b357-888ea2679b2a None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:37.919279 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925b247-f4bb-4dfd-b357-888ea2679b2a None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:37.919425 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925b247-f4bb-4dfd-b357-888ea2679b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:37.929285 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 937/1855] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:05:37 2022] POST /identity/v3/users => generated 296 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:05:37.930264 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0370917-b566-499d-b49d-842992e3d21d admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:37.940561 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0370917-b566-499d-b49d-842992e3d21d admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:37.978677 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-7925b247-f4bb-4dfd-b357-888ea2679b2a None None] MFA Rules not processed for user `986c0509603c452ead9edd29438f9dfb`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:37.982808 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-7925b247-f4bb-4dfd-b357-888ea2679b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:38.068158 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852f202-081c-4ee4-963a-fc421ab90a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:38.068158 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852f202-081c-4ee4-963a-fc421ab90a76 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:38.068158 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852f202-081c-4ee4-963a-fc421ab90a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:38.068408 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852f202-081c-4ee4-963a-fc421ab90a76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:38.069376 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852f202-081c-4ee4-963a-fc421ab90a76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:38.071326 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852f202-081c-4ee4-963a-fc421ab90a76 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:38.083556 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 938/1856] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:05:38.087400 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852f202-081c-4ee4-963a-fc421ab90a76 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:38.099657 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852f202-081c-4ee4-963a-fc421ab90a76 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:38.100016 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 919/1857] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:37 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 04:05:38.112646 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6201f-3c19-4230-a680-75c1cf4f78cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:38.113625 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6201f-3c19-4230-a680-75c1cf4f78cc admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:38.113790 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6201f-3c19-4230-a680-75c1cf4f78cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:38.114084 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6201f-3c19-4230-a680-75c1cf4f78cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:38.114829 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff6201f-3c19-4230-a680-75c1cf4f78cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:38.115626 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925b247-f4bb-4dfd-b357-888ea2679b2a None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:38.116615 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff6201f-3c19-4230-a680-75c1cf4f78cc admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:38.119089 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-7925b247-f4bb-4dfd-b357-888ea2679b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:38.136543 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 939/1858] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 04:05:38.141632 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6201f-3c19-4230-a680-75c1cf4f78cc admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:38.155162 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6201f-3c19-4230-a680-75c1cf4f78cc admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:38.163054 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb82673-732c-42b7-a8bd-06377219c989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:38.164083 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb82673-732c-42b7-a8bd-06377219c989 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:38.164386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb82673-732c-42b7-a8bd-06377219c989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:38.164845 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb82673-732c-42b7-a8bd-06377219c989 admin admin] PATH_INFO: `/v3/projects/dc43e3b74438453a956830ae126660ae/users/35506d4b6f204e3b9ef3ec34aa746154/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:38.182525 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb82673-732c-42b7-a8bd-06377219c989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc43e3b74438453a956830ae126660ae, user_id=35506d4b6f204e3b9ef3ec34aa746154, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:38.185863 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb82673-732c-42b7-a8bd-06377219c989 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:38.211032 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925b247-f4bb-4dfd-b357-888ea2679b2a None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:38.216312 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815f212-40dc-493b-abf7-aa99a2e89022 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:38.217603 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815f212-40dc-493b-abf7-aa99a2e89022 service cinder] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:38.217603 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815f212-40dc-493b-abf7-aa99a2e89022 service cinder] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:38.217996 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815f212-40dc-493b-abf7-aa99a2e89022 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:38.229098 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815f212-40dc-493b-abf7-aa99a2e89022 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:38.231495 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815f212-40dc-493b-abf7-aa99a2e89022 service cinder] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:38.242909 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 920/1859] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:05:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:05:38.303578 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 940/1860] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:05:38 2022] PUT /identity/v3/projects/dc43e3b74438453a956830ae126660ae/users/35506d4b6f204e3b9ef3ec34aa746154/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:38.315836 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68413f10-7b0e-41ad-9f02-1dec0d57aca1 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:38.316154 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68413f10-7b0e-41ad-9f02-1dec0d57aca1 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:38.316393 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68413f10-7b0e-41ad-9f02-1dec0d57aca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:38.352048 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-68413f10-7b0e-41ad-9f02-1dec0d57aca1 None None] MFA Rules not processed for user `35506d4b6f204e3b9ef3ec34aa746154`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:38.354165 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-68413f10-7b0e-41ad-9f02-1dec0d57aca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:38.485507 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb82673-732c-42b7-a8bd-06377219c989 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:38.487175 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 921/1861] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 04:05:38.494268 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68413f10-7b0e-41ad-9f02-1dec0d57aca1 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:38.562618 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb82673-732c-42b7-a8bd-06377219c989 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:38.571780 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d76ec-3bb4-44ff-9406-aab244342427 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:38.577250 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d76ec-3bb4-44ff-9406-aab244342427 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:38.577250 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d76ec-3bb4-44ff-9406-aab244342427 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:38.577250 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d76ec-3bb4-44ff-9406-aab244342427 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:38.577250 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-874d76ec-3bb4-44ff-9406-aab244342427 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:38.624976 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68413f10-7b0e-41ad-9f02-1dec0d57aca1 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:38.631928 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac15a34-a119-455a-8dfa-942229b19cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:38.631928 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac15a34-a119-455a-8dfa-942229b19cda admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:38.632279 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac15a34-a119-455a-8dfa-942229b19cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:38.632358 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac15a34-a119-455a-8dfa-942229b19cda admin admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:38.633146 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac15a34-a119-455a-8dfa-942229b19cda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:38.635185 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac15a34-a119-455a-8dfa-942229b19cda admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:38.728481 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874d76ec-3bb4-44ff-9406-aab244342427 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:38.732401 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874d76ec-3bb4-44ff-9406-aab244342427 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:38.775358 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 922/1862] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:05:38 2022] POST /identity/v3/projects => generated 393 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 04:05:38.781597 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac15a34-a119-455a-8dfa-942229b19cda admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:38.787300 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 941/1863] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:05:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 04:05:38.935824 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac15a34-a119-455a-8dfa-942229b19cda admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:38.941336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d7b97-f46b-41f6-ad8f-fac2cd12075d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:38.942102 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d7b97-f46b-41f6-ad8f-fac2cd12075d admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:38.942455 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d7b97-f46b-41f6-ad8f-fac2cd12075d admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:38.942796 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d7b97-f46b-41f6-ad8f-fac2cd12075d admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:38.943598 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d7b97-f46b-41f6-ad8f-fac2cd12075d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:38.945582 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d7b97-f46b-41f6-ad8f-fac2cd12075d admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:39.032072 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 923/1864] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:05:38 2022] POST /identity/v3/users => generated 303 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:05:39.037656 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d76ec-3bb4-44ff-9406-aab244342427 service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:39.054366 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d76ec-3bb4-44ff-9406-aab244342427 service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:39.065474 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87b1f9-d067-4997-9cdd-47a3b3f7e4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:39.066724 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87b1f9-d067-4997-9cdd-47a3b3f7e4e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:39.067012 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87b1f9-d067-4997-9cdd-47a3b3f7e4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:39.067295 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87b1f9-d067-4997-9cdd-47a3b3f7e4e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:39.068277 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c87b1f9-d067-4997-9cdd-47a3b3f7e4e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:39.070198 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c87b1f9-d067-4997-9cdd-47a3b3f7e4e0 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:39.091617 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 942/1865] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 04:05:39.095916 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d7b97-f46b-41f6-ad8f-fac2cd12075d admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:39.113480 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d7b97-f46b-41f6-ad8f-fac2cd12075d admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:39.121109 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1afc137-07c1-448d-9a86-6229d6a8a745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:39.121684 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afc137-07c1-448d-9a86-6229d6a8a745 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:39.121983 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afc137-07c1-448d-9a86-6229d6a8a745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:39.122316 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afc137-07c1-448d-9a86-6229d6a8a745 admin admin] PATH_INFO: `/v3/projects/f2004201af3743078ed30390760ed1fb/users/652e4ba766e847a68d562dde19b51f09/roles/681755518698445fabd9a8accec13c0f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:39.153876 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1afc137-07c1-448d-9a86-6229d6a8a745 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2004201af3743078ed30390760ed1fb, user_id=652e4ba766e847a68d562dde19b51f09, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:39.164957 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1afc137-07c1-448d-9a86-6229d6a8a745 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:39.325154 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 924/1866] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:05:39 2022] PUT /identity/v3/projects/f2004201af3743078ed30390760ed1fb/users/652e4ba766e847a68d562dde19b51f09/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:39.328118 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87b1f9-d067-4997-9cdd-47a3b3f7e4e0 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:39.371468 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87b1f9-d067-4997-9cdd-47a3b3f7e4e0 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:39.446357 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb26b3e-868b-4796-93bf-9d452d4d0a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:39.447480 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb26b3e-868b-4796-93bf-9d452d4d0a64 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:39.447835 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb26b3e-868b-4796-93bf-9d452d4d0a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:39.449119 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb26b3e-868b-4796-93bf-9d452d4d0a64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:39.449424 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb26b3e-868b-4796-93bf-9d452d4d0a64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:39.451260 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb26b3e-868b-4796-93bf-9d452d4d0a64 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:39.464882 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 943/1867] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:05:39.468965 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1afc137-07c1-448d-9a86-6229d6a8a745 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:39.481839 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1afc137-07c1-448d-9a86-6229d6a8a745 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:39.495550 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267a4fd-968e-484a-936d-587ce2a25b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:39.496999 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267a4fd-968e-484a-936d-587ce2a25b63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:39.496999 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267a4fd-968e-484a-936d-587ce2a25b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:39.497238 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267a4fd-968e-484a-936d-587ce2a25b63 admin admin] PATH_INFO: `/v3/projects/f2004201af3743078ed30390760ed1fb/users/652e4ba766e847a68d562dde19b51f09/roles/681755518698445fabd9a8accec13c0f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:39.499441 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b267a4fd-968e-484a-936d-587ce2a25b63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2004201af3743078ed30390760ed1fb, user_id=652e4ba766e847a68d562dde19b51f09, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:39.502221 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b267a4fd-968e-484a-936d-587ce2a25b63 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:39.515775 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 925/1868] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:05:39 2022] PUT /identity/v3/projects/f2004201af3743078ed30390760ed1fb/users/652e4ba766e847a68d562dde19b51f09/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:39.525815 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4fe4de-38f1-4e61-ba2f-9610b7a040b3 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:39.527011 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4fe4de-38f1-4e61-ba2f-9610b7a040b3 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:39.527299 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4fe4de-38f1-4e61-ba2f-9610b7a040b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:39.558064 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-2b4fe4de-38f1-4e61-ba2f-9610b7a040b3 None None] MFA Rules not processed for user `652e4ba766e847a68d562dde19b51f09`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:39.559717 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2b4fe4de-38f1-4e61-ba2f-9610b7a040b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:39.640963 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 944/1869] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:39 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:40.372572 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267a4fd-968e-484a-936d-587ce2a25b63 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:40.449281 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267a4fd-968e-484a-936d-587ce2a25b63 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:40.461412 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f1af7-1156-4827-85e9-d1f87fd68b8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:40.461412 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f1af7-1156-4827-85e9-d1f87fd68b8e service cinder] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:40.461412 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f1af7-1156-4827-85e9-d1f87fd68b8e service cinder] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:40.461970 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f1af7-1156-4827-85e9-d1f87fd68b8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:40.476684 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f1af7-1156-4827-85e9-d1f87fd68b8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:40.478232 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f1af7-1156-4827-85e9-d1f87fd68b8e service cinder] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:40.490513 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:40.515512 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 926/1870] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:05:40 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:05:40.688071 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4fe4de-38f1-4e61-ba2f-9610b7a040b3 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:40.698907 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4fe4de-38f1-4e61-ba2f-9610b7a040b3 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:40.703592 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39674476-24fe-44be-b440-aa768fa94eab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:40.704284 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39674476-24fe-44be-b440-aa768fa94eab service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:40.704563 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39674476-24fe-44be-b440-aa768fa94eab service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:40.704841 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39674476-24fe-44be-b440-aa768fa94eab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:40.786132 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39674476-24fe-44be-b440-aa768fa94eab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:40.787669 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39674476-24fe-44be-b440-aa768fa94eab service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:40.806096 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 945/1871] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:05:40 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:05:41.376740 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:41.976481 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f1af7-1156-4827-85e9-d1f87fd68b8e service cinder] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:42.075484 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f1af7-1156-4827-85e9-d1f87fd68b8e service cinder] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:42.081325 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18259e3-49a4-4273-92ea-217948222570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:42.084379 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18259e3-49a4-4273-92ea-217948222570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:42.084996 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18259e3-49a4-4273-92ea-217948222570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:42.085467 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18259e3-49a4-4273-92ea-217948222570 admin admin] PATH_INFO: `/v3/users/5fd153a660044ebfbd809e55cc6479c7` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:42.087366 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18259e3-49a4-4273-92ea-217948222570 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fd153a660044ebfbd809e55cc6479c7)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:42.092569 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18259e3-49a4-4273-92ea-217948222570 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:42.325463 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-d18259e3-49a4-4273-92ea-217948222570 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fd153a660044ebfbd809e55cc6479c7'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:42.326744 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-d18259e3-49a4-4273-92ea-217948222570 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fd153a660044ebfbd809e55cc6479c7'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:42.404954 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-d18259e3-49a4-4273-92ea-217948222570 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fd153a660044ebfbd809e55cc6479c7'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:42.405051 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-d18259e3-49a4-4273-92ea-217948222570 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fd153a660044ebfbd809e55cc6479c7'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:42.414782 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-d18259e3-49a4-4273-92ea-217948222570 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fd153a660044ebfbd809e55cc6479c7'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:42.437279 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 927/1872] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:05:41 2022] DELETE /identity/v3/users/5fd153a660044ebfbd809e55cc6479c7 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:42.442470 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ada15-0e34-4920-9752-a10413afab68 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:42.442978 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ada15-0e34-4920-9752-a10413afab68 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:42.443071 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ada15-0e34-4920-9752-a10413afab68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:42.462268 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-b98ada15-0e34-4920-9752-a10413afab68 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:42.463531 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b98ada15-0e34-4920-9752-a10413afab68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:42.551283 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 946/1873] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:42.562231 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18259e3-49a4-4273-92ea-217948222570 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:42.563813 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-d18259e3-49a4-4273-92ea-217948222570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:42.664212 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18259e3-49a4-4273-92ea-217948222570 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:42.672137 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80741f7e-fe21-46bc-8fe5-3d51bb838f19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:42.673263 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80741f7e-fe21-46bc-8fe5-3d51bb838f19 service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:42.673761 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80741f7e-fe21-46bc-8fe5-3d51bb838f19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:42.674239 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80741f7e-fe21-46bc-8fe5-3d51bb838f19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:42.693072 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80741f7e-fe21-46bc-8fe5-3d51bb838f19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:42.695056 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80741f7e-fe21-46bc-8fe5-3d51bb838f19 service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:42.719725 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 928/1874] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:05:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 04:05:43.292960 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ada15-0e34-4920-9752-a10413afab68 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:43.295388 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b98ada15-0e34-4920-9752-a10413afab68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:43.321129 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ada15-0e34-4920-9752-a10413afab68 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:43.328251 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec7eaa-52f4-45ea-911a-a04e25ee59e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:43.329782 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec7eaa-52f4-45ea-911a-a04e25ee59e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:43.330087 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec7eaa-52f4-45ea-911a-a04e25ee59e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:43.330559 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec7eaa-52f4-45ea-911a-a04e25ee59e7 admin admin] PATH_INFO: `/v3/projects/46a47a37327f4b64be43ee592d8aa381` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:43.332822 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ec7eaa-52f4-45ea-911a-a04e25ee59e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46a47a37327f4b64be43ee592d8aa381)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:43.349279 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ec7eaa-52f4-45ea-911a-a04e25ee59e7 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:43.525230 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-74ec7eaa-52f4-45ea-911a-a04e25ee59e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46a47a37327f4b64be43ee592d8aa381', 'request_id': 'req-74ec7eaa-52f4-45ea-911a-a04e25ee59e7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:43.639114 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-74ec7eaa-52f4-45ea-911a-a04e25ee59e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46a47a37327f4b64be43ee592d8aa381', 'request_id': 'req-74ec7eaa-52f4-45ea-911a-a04e25ee59e7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:43.646003 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-74ec7eaa-52f4-45ea-911a-a04e25ee59e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46a47a37327f4b64be43ee592d8aa381', 'request_id': 'req-74ec7eaa-52f4-45ea-911a-a04e25ee59e7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:43.659573 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-74ec7eaa-52f4-45ea-911a-a04e25ee59e7 admin admin] The token cache is being invalidate because project 46a47a37327f4b64be43ee592d8aa381 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:05:43.659869 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-74ec7eaa-52f4-45ea-911a-a04e25ee59e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:43.660631 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-74ec7eaa-52f4-45ea-911a-a04e25ee59e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:43.662309 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 947/1875] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:05:43 2022] DELETE /identity/v3/projects/46a47a37327f4b64be43ee592d8aa381 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:43.668250 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80741f7e-fe21-46bc-8fe5-3d51bb838f19 service neutron] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:43.679328 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80741f7e-fe21-46bc-8fe5-3d51bb838f19 service neutron] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:43.751068 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b12a4c-43fa-41c0-a299-d727a788a279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:43.751913 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b12a4c-43fa-41c0-a299-d727a788a279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:43.752194 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b12a4c-43fa-41c0-a299-d727a788a279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:43.752472 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b12a4c-43fa-41c0-a299-d727a788a279 admin admin] PATH_INFO: `/v3/users/986c0509603c452ead9edd29438f9dfb` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:43.753759 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b12a4c-43fa-41c0-a299-d727a788a279 admin admin] RBAC: Authorizing `identity:delete_user(user_id=986c0509603c452ead9edd29438f9dfb)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:43.755729 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b12a4c-43fa-41c0-a299-d727a788a279 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:44.110187 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:44.128619 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-14b12a4c-43fa-41c0-a299-d727a788a279 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '986c0509603c452ead9edd29438f9dfb'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:44.129885 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-14b12a4c-43fa-41c0-a299-d727a788a279 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '986c0509603c452ead9edd29438f9dfb'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:44.282142 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-14b12a4c-43fa-41c0-a299-d727a788a279 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '986c0509603c452ead9edd29438f9dfb'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:44.284708 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-14b12a4c-43fa-41c0-a299-d727a788a279 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '986c0509603c452ead9edd29438f9dfb'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:44.309507 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-14b12a4c-43fa-41c0-a299-d727a788a279 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '986c0509603c452ead9edd29438f9dfb'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:44.338297 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 929/1876] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:05:43 2022] DELETE /identity/v3/users/986c0509603c452ead9edd29438f9dfb => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:44.348355 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:45.198869 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec7eaa-52f4-45ea-911a-a04e25ee59e7 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:45.202985 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-74ec7eaa-52f4-45ea-911a-a04e25ee59e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:45.251367 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec7eaa-52f4-45ea-911a-a04e25ee59e7 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:45.398260 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb9a49-3cf3-4d13-aac3-ea4dc33c1f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:45.401508 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb9a49-3cf3-4d13-aac3-ea4dc33c1f9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:45.402236 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb9a49-3cf3-4d13-aac3-ea4dc33c1f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:45.403138 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb9a49-3cf3-4d13-aac3-ea4dc33c1f9c admin admin] PATH_INFO: `/v3/projects/4bf0b38d4e7448e2ab9f2fbd41a52c78` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:45.407355 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb9a49-3cf3-4d13-aac3-ea4dc33c1f9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bf0b38d4e7448e2ab9f2fbd41a52c78)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:45.412883 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb9a49-3cf3-4d13-aac3-ea4dc33c1f9c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:45.692529 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-cffb9a49-3cf3-4d13-aac3-ea4dc33c1f9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bf0b38d4e7448e2ab9f2fbd41a52c78', 'request_id': 'req-cffb9a49-3cf3-4d13-aac3-ea4dc33c1f9c'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:45.814289 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-cffb9a49-3cf3-4d13-aac3-ea4dc33c1f9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bf0b38d4e7448e2ab9f2fbd41a52c78', 'request_id': 'req-cffb9a49-3cf3-4d13-aac3-ea4dc33c1f9c'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:45.822170 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-cffb9a49-3cf3-4d13-aac3-ea4dc33c1f9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bf0b38d4e7448e2ab9f2fbd41a52c78', 'request_id': 'req-cffb9a49-3cf3-4d13-aac3-ea4dc33c1f9c'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:45.842160 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-cffb9a49-3cf3-4d13-aac3-ea4dc33c1f9c admin admin] The token cache is being invalidate because project 4bf0b38d4e7448e2ab9f2fbd41a52c78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:05:45.842770 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-cffb9a49-3cf3-4d13-aac3-ea4dc33c1f9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:45.844068 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-cffb9a49-3cf3-4d13-aac3-ea4dc33c1f9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:45.845708 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 948/1877] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:05:45 2022] DELETE /identity/v3/projects/4bf0b38d4e7448e2ab9f2fbd41a52c78 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:45.852206 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94a472-0368-4f41-abcc-8af07fe419d5 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:45.852825 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94a472-0368-4f41-abcc-8af07fe419d5 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:45.853190 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94a472-0368-4f41-abcc-8af07fe419d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:45.885999 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-dc94a472-0368-4f41-abcc-8af07fe419d5 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:45.888224 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-dc94a472-0368-4f41-abcc-8af07fe419d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:46.003993 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 930/1878] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:46.012183 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5834748-b696-4df8-bf12-9d6a13ee3099 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:46.012611 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5834748-b696-4df8-bf12-9d6a13ee3099 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:46.013815 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5834748-b696-4df8-bf12-9d6a13ee3099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:46.042517 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-b5834748-b696-4df8-bf12-9d6a13ee3099 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:46.043812 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b5834748-b696-4df8-bf12-9d6a13ee3099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:46.056779 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 949/1879] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:46.060311 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94a472-0368-4f41-abcc-8af07fe419d5 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:46.081149 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94a472-0368-4f41-abcc-8af07fe419d5 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:46.089938 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4aa62-b35e-45d8-b9cb-57b649324483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:46.091432 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4aa62-b35e-45d8-b9cb-57b649324483 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:46.092112 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4aa62-b35e-45d8-b9cb-57b649324483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:46.092623 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4aa62-b35e-45d8-b9cb-57b649324483 admin admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:46.094049 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4aa62-b35e-45d8-b9cb-57b649324483 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:05:46.094604 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4aa62-b35e-45d8-b9cb-57b649324483 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:46.098080 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4aa62-b35e-45d8-b9cb-57b649324483 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:46.121986 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:46.138273 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 931/1880] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:05:46.138651 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5834748-b696-4df8-bf12-9d6a13ee3099 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:46.155250 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5834748-b696-4df8-bf12-9d6a13ee3099 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:46.160468 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445bb28-1009-480b-952c-f6128ad82537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:46.161507 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445bb28-1009-480b-952c-f6128ad82537 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:46.161854 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445bb28-1009-480b-952c-f6128ad82537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:46.162133 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445bb28-1009-480b-952c-f6128ad82537 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:46.162848 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445bb28-1009-480b-952c-f6128ad82537 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:46.164915 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445bb28-1009-480b-952c-f6128ad82537 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:46.300015 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 950/1881] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:05:46 2022] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:05:46.304881 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4aa62-b35e-45d8-b9cb-57b649324483 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:46.315698 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4aa62-b35e-45d8-b9cb-57b649324483 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:46.326802 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:46.429197 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88921944-90db-47a1-a07e-133a795f4288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:46.430374 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88921944-90db-47a1-a07e-133a795f4288 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:46.430880 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88921944-90db-47a1-a07e-133a795f4288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:46.431388 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88921944-90db-47a1-a07e-133a795f4288 admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:46.433458 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88921944-90db-47a1-a07e-133a795f4288 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:46.437478 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88921944-90db-47a1-a07e-133a795f4288 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:46.571510 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 932/1882] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:05:46 2022] POST /identity/v3/users => generated 293 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 04:05:46.574686 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445bb28-1009-480b-952c-f6128ad82537 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:46.587935 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445bb28-1009-480b-952c-f6128ad82537 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:46.603741 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ac942-2447-41de-b469-6a5c07fc89f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:46.603741 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ac942-2447-41de-b469-6a5c07fc89f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:46.603741 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ac942-2447-41de-b469-6a5c07fc89f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:46.603741 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ac942-2447-41de-b469-6a5c07fc89f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:46.604289 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1ac942-2447-41de-b469-6a5c07fc89f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:46.604289 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1ac942-2447-41de-b469-6a5c07fc89f8 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:46.624464 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 951/1883] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 04:05:46.625788 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88921944-90db-47a1-a07e-133a795f4288 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:46.642534 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88921944-90db-47a1-a07e-133a795f4288 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:46.647911 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949e577-1128-40a0-bb7c-d67350696907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:46.648597 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949e577-1128-40a0-bb7c-d67350696907 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:46.649316 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949e577-1128-40a0-bb7c-d67350696907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:46.649604 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949e577-1128-40a0-bb7c-d67350696907 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:46.650344 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949e577-1128-40a0-bb7c-d67350696907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:46.653610 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949e577-1128-40a0-bb7c-d67350696907 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:46.671349 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ac942-2447-41de-b469-6a5c07fc89f8 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:46.675868 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 933/1884] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:05:46.688178 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ac942-2447-41de-b469-6a5c07fc89f8 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:46.696342 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab3337-5ec4-420c-99f2-adde85156205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:46.697350 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab3337-5ec4-420c-99f2-adde85156205 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:46.697696 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab3337-5ec4-420c-99f2-adde85156205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:46.697946 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab3337-5ec4-420c-99f2-adde85156205 admin admin] PATH_INFO: `/v3/projects/3e2eae469ab3406c9346724af731833b/users/5614c16fe7ed4d1cacd1245296968796/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:46.731180 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ab3337-5ec4-420c-99f2-adde85156205 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e2eae469ab3406c9346724af731833b, user_id=5614c16fe7ed4d1cacd1245296968796, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:46.735429 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ab3337-5ec4-420c-99f2-adde85156205 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:46.856880 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 952/1885] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:05:46 2022] PUT /identity/v3/projects/3e2eae469ab3406c9346724af731833b/users/5614c16fe7ed4d1cacd1245296968796/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:05:46.862637 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f45a7d-701a-461b-bc26-3964956d1f2c None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:46.863966 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f45a7d-701a-461b-bc26-3964956d1f2c None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:46.864746 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f45a7d-701a-461b-bc26-3964956d1f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:46.920645 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-c7f45a7d-701a-461b-bc26-3964956d1f2c None None] MFA Rules not processed for user `5614c16fe7ed4d1cacd1245296968796`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:46.924039 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-c7f45a7d-701a-461b-bc26-3964956d1f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:47.077780 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 934/1886] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:47.183808 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab3337-5ec4-420c-99f2-adde85156205 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:47.186612 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-84ab3337-5ec4-420c-99f2-adde85156205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:47.261639 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab3337-5ec4-420c-99f2-adde85156205 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:47.265788 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5ab0c-c648-48e3-b829-fcf0be1f6102 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:47.266467 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5ab0c-c648-48e3-b829-fcf0be1f6102 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:47.266751 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5ab0c-c648-48e3-b829-fcf0be1f6102 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:47.267027 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5ab0c-c648-48e3-b829-fcf0be1f6102 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:47.277921 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c5ab0c-c648-48e3-b829-fcf0be1f6102 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:47.279398 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c5ab0c-c648-48e3-b829-fcf0be1f6102 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:47.295843 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 953/1887] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:05:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:05:47.550813 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f45a7d-701a-461b-bc26-3964956d1f2c None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:47.550813 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-c7f45a7d-701a-461b-bc26-3964956d1f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:47.641433 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f45a7d-701a-461b-bc26-3964956d1f2c None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:47.647061 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822d173-28cd-482d-9002-bf8ed835fdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:47.648012 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822d173-28cd-482d-9002-bf8ed835fdef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:47.648348 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822d173-28cd-482d-9002-bf8ed835fdef admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:47.648782 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822d173-28cd-482d-9002-bf8ed835fdef admin admin] PATH_INFO: `/v3/users/35506d4b6f204e3b9ef3ec34aa746154` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:47.650150 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b822d173-28cd-482d-9002-bf8ed835fdef admin admin] RBAC: Authorizing `identity:delete_user(user_id=35506d4b6f204e3b9ef3ec34aa746154)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:47.652555 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b822d173-28cd-482d-9002-bf8ed835fdef admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:47.973825 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-b822d173-28cd-482d-9002-bf8ed835fdef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35506d4b6f204e3b9ef3ec34aa746154'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:47.976497 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-b822d173-28cd-482d-9002-bf8ed835fdef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35506d4b6f204e3b9ef3ec34aa746154'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:48.084909 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-b822d173-28cd-482d-9002-bf8ed835fdef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35506d4b6f204e3b9ef3ec34aa746154'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:48.085625 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-b822d173-28cd-482d-9002-bf8ed835fdef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35506d4b6f204e3b9ef3ec34aa746154'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:48.095722 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-b822d173-28cd-482d-9002-bf8ed835fdef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35506d4b6f204e3b9ef3ec34aa746154'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:48.120336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 935/1888] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:05:47 2022] DELETE /identity/v3/users/35506d4b6f204e3b9ef3ec34aa746154 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:48.125709 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5175a0-65c7-48a0-989d-67d2a6ff81c0 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:48.126326 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5175a0-65c7-48a0-989d-67d2a6ff81c0 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:48.126326 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5175a0-65c7-48a0-989d-67d2a6ff81c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:48.147830 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-0c5175a0-65c7-48a0-989d-67d2a6ff81c0 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:48.149090 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0c5175a0-65c7-48a0-989d-67d2a6ff81c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:48.223752 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 954/1889] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 04:05:48.241502 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822d173-28cd-482d-9002-bf8ed835fdef admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:48.243297 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-b822d173-28cd-482d-9002-bf8ed835fdef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:48.347573 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822d173-28cd-482d-9002-bf8ed835fdef admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:48.351784 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3379f-19ee-43e6-8507-93151e609d5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:48.352450 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3379f-19ee-43e6-8507-93151e609d5b service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:48.352962 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3379f-19ee-43e6-8507-93151e609d5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:48.353395 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3379f-19ee-43e6-8507-93151e609d5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:48.376722 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e3379f-19ee-43e6-8507-93151e609d5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:48.378254 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e3379f-19ee-43e6-8507-93151e609d5b service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:48.399857 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 936/1890] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:05:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:05:48.992220 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5175a0-65c7-48a0-989d-67d2a6ff81c0 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:48.994127 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0c5175a0-65c7-48a0-989d-67d2a6ff81c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:49.011245 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5175a0-65c7-48a0-989d-67d2a6ff81c0 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:49.025598 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cda550-5c4f-44a9-8a42-19a15dbd8d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:49.027753 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cda550-5c4f-44a9-8a42-19a15dbd8d6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:49.028217 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cda550-5c4f-44a9-8a42-19a15dbd8d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:49.028729 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cda550-5c4f-44a9-8a42-19a15dbd8d6d admin admin] PATH_INFO: `/v3/projects/dc43e3b74438453a956830ae126660ae` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:49.033062 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cda550-5c4f-44a9-8a42-19a15dbd8d6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc43e3b74438453a956830ae126660ae)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:49.035850 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cda550-5c4f-44a9-8a42-19a15dbd8d6d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:49.235502 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-06cda550-5c4f-44a9-8a42-19a15dbd8d6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc43e3b74438453a956830ae126660ae', 'request_id': 'req-06cda550-5c4f-44a9-8a42-19a15dbd8d6d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:49.240545 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:49.338362 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-06cda550-5c4f-44a9-8a42-19a15dbd8d6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc43e3b74438453a956830ae126660ae', 'request_id': 'req-06cda550-5c4f-44a9-8a42-19a15dbd8d6d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:49.340708 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:49.350290 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-06cda550-5c4f-44a9-8a42-19a15dbd8d6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc43e3b74438453a956830ae126660ae', 'request_id': 'req-06cda550-5c4f-44a9-8a42-19a15dbd8d6d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:49.367166 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-06cda550-5c4f-44a9-8a42-19a15dbd8d6d admin admin] The token cache is being invalidate because project dc43e3b74438453a956830ae126660ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:05:49.367608 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-06cda550-5c4f-44a9-8a42-19a15dbd8d6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:49.368420 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-06cda550-5c4f-44a9-8a42-19a15dbd8d6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:49.370145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 955/1891] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:05:48 2022] DELETE /identity/v3/projects/dc43e3b74438453a956830ae126660ae => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:49.375268 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3379f-19ee-43e6-8507-93151e609d5b service neutron] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:49.388008 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3379f-19ee-43e6-8507-93151e609d5b service neutron] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:49.455694 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034ea18-d623-416f-b30b-8d9c3b49c635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:49.456825 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034ea18-d623-416f-b30b-8d9c3b49c635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:49.457545 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034ea18-d623-416f-b30b-8d9c3b49c635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:49.457545 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034ea18-d623-416f-b30b-8d9c3b49c635 admin admin] PATH_INFO: `/v3/users/652e4ba766e847a68d562dde19b51f09` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:49.468299 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4034ea18-d623-416f-b30b-8d9c3b49c635 admin admin] RBAC: Authorizing `identity:delete_user(user_id=652e4ba766e847a68d562dde19b51f09)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:49.470517 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4034ea18-d623-416f-b30b-8d9c3b49c635 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:49.920863 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-4034ea18-d623-416f-b30b-8d9c3b49c635 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '652e4ba766e847a68d562dde19b51f09'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:49.920863 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-4034ea18-d623-416f-b30b-8d9c3b49c635 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '652e4ba766e847a68d562dde19b51f09'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:50.102499 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-4034ea18-d623-416f-b30b-8d9c3b49c635 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '652e4ba766e847a68d562dde19b51f09'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:50.103641 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-4034ea18-d623-416f-b30b-8d9c3b49c635 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '652e4ba766e847a68d562dde19b51f09'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:50.113761 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-4034ea18-d623-416f-b30b-8d9c3b49c635 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '652e4ba766e847a68d562dde19b51f09'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:50.141499 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 937/1892] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:05:49 2022] DELETE /identity/v3/users/652e4ba766e847a68d562dde19b51f09 => generated 0 bytes in 767 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:50.514920 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:50.650310 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:50.738511 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cda550-5c4f-44a9-8a42-19a15dbd8d6d admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:50.741366 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-06cda550-5c4f-44a9-8a42-19a15dbd8d6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:50.760704 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cda550-5c4f-44a9-8a42-19a15dbd8d6d admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:50.904719 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9a909-8bd5-4d2d-87dd-968db8284972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:50.905873 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9a909-8bd5-4d2d-87dd-968db8284972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:50.906324 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9a909-8bd5-4d2d-87dd-968db8284972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:50.906601 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9a909-8bd5-4d2d-87dd-968db8284972 admin admin] PATH_INFO: `/v3/projects/f2004201af3743078ed30390760ed1fb` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:50.907953 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b9a909-8bd5-4d2d-87dd-968db8284972 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2004201af3743078ed30390760ed1fb)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:50.910033 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b9a909-8bd5-4d2d-87dd-968db8284972 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:51.115327 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-48b9a909-8bd5-4d2d-87dd-968db8284972 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2004201af3743078ed30390760ed1fb', 'request_id': 'req-48b9a909-8bd5-4d2d-87dd-968db8284972'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:51.249542 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034ea18-d623-416f-b30b-8d9c3b49c635 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:51.251059 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-4034ea18-d623-416f-b30b-8d9c3b49c635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:51.264353 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034ea18-d623-416f-b30b-8d9c3b49c635 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:51.297281 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-48b9a909-8bd5-4d2d-87dd-968db8284972 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2004201af3743078ed30390760ed1fb', 'request_id': 'req-48b9a909-8bd5-4d2d-87dd-968db8284972'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:51.308394 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-48b9a909-8bd5-4d2d-87dd-968db8284972 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2004201af3743078ed30390760ed1fb', 'request_id': 'req-48b9a909-8bd5-4d2d-87dd-968db8284972'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:51.329748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-48b9a909-8bd5-4d2d-87dd-968db8284972 admin admin] The token cache is being invalidate because project f2004201af3743078ed30390760ed1fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:05:51.330343 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-48b9a909-8bd5-4d2d-87dd-968db8284972 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:51.331537 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-48b9a909-8bd5-4d2d-87dd-968db8284972 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:51.347913 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 956/1893] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:05:50 2022] DELETE /identity/v3/projects/f2004201af3743078ed30390760ed1fb => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:51.347913 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ced38-6f9a-4049-9776-9b9d2bc6cbba None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:51.347913 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ced38-6f9a-4049-9776-9b9d2bc6cbba None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:51.347913 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ced38-6f9a-4049-9776-9b9d2bc6cbba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:51.355870 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7165906a-f511-443f-a380-4d909861c633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:51.356857 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165906a-f511-443f-a380-4d909861c633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:51.357148 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165906a-f511-443f-a380-4d909861c633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:51.357434 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165906a-f511-443f-a380-4d909861c633 admin admin] PATH_INFO: `/v3/users/212d00a72e8948c681158e3f92e028a4` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:51.358757 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7165906a-f511-443f-a380-4d909861c633 admin admin] RBAC: Authorizing `identity:delete_user(user_id=212d00a72e8948c681158e3f92e028a4)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:51.360873 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7165906a-f511-443f-a380-4d909861c633 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:51.378753 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-e72ced38-6f9a-4049-9776-9b9d2bc6cbba None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:51.380802 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e72ced38-6f9a-4049-9776-9b9d2bc6cbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:51.392808 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 957/1894] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:51.405292 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63cdd8-4ff5-4ee5-912f-87c27a3a7da5 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:51.405646 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63cdd8-4ff5-4ee5-912f-87c27a3a7da5 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:51.405851 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63cdd8-4ff5-4ee5-912f-87c27a3a7da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:51.429516 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-ef63cdd8-4ff5-4ee5-912f-87c27a3a7da5 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:51.431641 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ef63cdd8-4ff5-4ee5-912f-87c27a3a7da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:51.440512 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 958/1895] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 04:05:51.445022 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63cdd8-4ff5-4ee5-912f-87c27a3a7da5 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:51.458583 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63cdd8-4ff5-4ee5-912f-87c27a3a7da5 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:51.462297 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab23724-c749-422f-9f16-423021d47848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:51.463183 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab23724-c749-422f-9f16-423021d47848 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:51.463661 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab23724-c749-422f-9f16-423021d47848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:51.464608 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab23724-c749-422f-9f16-423021d47848 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:51.465799 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab23724-c749-422f-9f16-423021d47848 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:05:51.466253 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab23724-c749-422f-9f16-423021d47848 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:51.468385 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab23724-c749-422f-9f16-423021d47848 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:51.482114 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 959/1896] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 04:05:51.487109 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab23724-c749-422f-9f16-423021d47848 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:51.498285 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab23724-c749-422f-9f16-423021d47848 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:51.503432 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78969639-2aab-4267-ad99-36596603fa16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:51.504149 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78969639-2aab-4267-ad99-36596603fa16 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:51.504437 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78969639-2aab-4267-ad99-36596603fa16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:51.504718 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78969639-2aab-4267-ad99-36596603fa16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:51.505441 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78969639-2aab-4267-ad99-36596603fa16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:51.507566 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78969639-2aab-4267-ad99-36596603fa16 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:51.612141 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-7165906a-f511-443f-a380-4d909861c633 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '212d00a72e8948c681158e3f92e028a4'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:51.613200 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-7165906a-f511-443f-a380-4d909861c633 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '212d00a72e8948c681158e3f92e028a4'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:51.672379 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 960/1897] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:05:51 2022] POST /identity/v3/projects => generated 365 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 04:05:51.676748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78969639-2aab-4267-ad99-36596603fa16 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:51.679211 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-78969639-2aab-4267-ad99-36596603fa16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:51.712928 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-7165906a-f511-443f-a380-4d909861c633 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '212d00a72e8948c681158e3f92e028a4'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:51.713961 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-7165906a-f511-443f-a380-4d909861c633 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '212d00a72e8948c681158e3f92e028a4'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:51.722439 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-7165906a-f511-443f-a380-4d909861c633 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '212d00a72e8948c681158e3f92e028a4'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:51.741334 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 938/1898] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:05:51 2022] DELETE /identity/v3/users/212d00a72e8948c681158e3f92e028a4 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:05:51.752784 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7838c64-8667-40aa-a0e7-9c9c1dc0d6a8 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:51.753076 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7838c64-8667-40aa-a0e7-9c9c1dc0d6a8 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:51.753358 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7838c64-8667-40aa-a0e7-9c9c1dc0d6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:51.754089 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78969639-2aab-4267-ad99-36596603fa16 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:51.788023 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-b7838c64-8667-40aa-a0e7-9c9c1dc0d6a8 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:51.789304 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-b7838c64-8667-40aa-a0e7-9c9c1dc0d6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:51.827219 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39bb140-1dc3-4800-90fc-6b2e00e5e036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:51.828149 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39bb140-1dc3-4800-90fc-6b2e00e5e036 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:51.829172 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39bb140-1dc3-4800-90fc-6b2e00e5e036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:51.829607 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39bb140-1dc3-4800-90fc-6b2e00e5e036 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:51.830473 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39bb140-1dc3-4800-90fc-6b2e00e5e036 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:51.832530 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39bb140-1dc3-4800-90fc-6b2e00e5e036 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:51.873282 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 939/1899] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:51.882930 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7838c64-8667-40aa-a0e7-9c9c1dc0d6a8 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:51.884665 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-b7838c64-8667-40aa-a0e7-9c9c1dc0d6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:51.965404 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7838c64-8667-40aa-a0e7-9c9c1dc0d6a8 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:51.970540 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796494b-fb54-49b5-8655-28d116697fcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:51.971387 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796494b-fb54-49b5-8655-28d116697fcc service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:51.971866 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796494b-fb54-49b5-8655-28d116697fcc service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:51.972305 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796494b-fb54-49b5-8655-28d116697fcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:51.989464 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f796494b-fb54-49b5-8655-28d116697fcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:51.989464 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f796494b-fb54-49b5-8655-28d116697fcc service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:51.995102 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 961/1900] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:05:51 2022] POST /identity/v3/users => generated 283 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 04:05:51.999416 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39bb140-1dc3-4800-90fc-6b2e00e5e036 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:52.001869 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 940/1901] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:05:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 04:05:52.032897 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39bb140-1dc3-4800-90fc-6b2e00e5e036 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:52.038529 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc130140-6c86-4627-8f0d-4bdef38fa89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:52.039577 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc130140-6c86-4627-8f0d-4bdef38fa89d admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:52.040069 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc130140-6c86-4627-8f0d-4bdef38fa89d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:52.040536 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc130140-6c86-4627-8f0d-4bdef38fa89d admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:52.041783 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc130140-6c86-4627-8f0d-4bdef38fa89d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:52.044471 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc130140-6c86-4627-8f0d-4bdef38fa89d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:52.058273 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 962/1902] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:05:52.062463 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796494b-fb54-49b5-8655-28d116697fcc service neutron] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:52.074604 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796494b-fb54-49b5-8655-28d116697fcc service neutron] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:52.080707 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f235b-694d-4500-8a23-203bc45e68f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:52.081875 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f235b-694d-4500-8a23-203bc45e68f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:52.082109 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f235b-694d-4500-8a23-203bc45e68f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:52.082498 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f235b-694d-4500-8a23-203bc45e68f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:52.083337 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f235b-694d-4500-8a23-203bc45e68f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:52.085461 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f235b-694d-4500-8a23-203bc45e68f7 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:52.102916 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc130140-6c86-4627-8f0d-4bdef38fa89d admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:52.109204 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 941/1903] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:05:52.117205 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc130140-6c86-4627-8f0d-4bdef38fa89d admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:52.121917 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe304b-0962-4d66-aa79-5a67feb1605f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:52.124769 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe304b-0962-4d66-aa79-5a67feb1605f admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:52.125096 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe304b-0962-4d66-aa79-5a67feb1605f admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:52.125354 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe304b-0962-4d66-aa79-5a67feb1605f admin admin] PATH_INFO: `/v3/projects/e60bb51d2f5948f9a77b50d75227d14d/users/fd6631020d97498097db83c542447db5/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:52.150334 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe304b-0962-4d66-aa79-5a67feb1605f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e60bb51d2f5948f9a77b50d75227d14d, user_id=fd6631020d97498097db83c542447db5, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:52.156002 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe304b-0962-4d66-aa79-5a67feb1605f admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:52.335503 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 963/1904] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:05:52 2022] PUT /identity/v3/projects/e60bb51d2f5948f9a77b50d75227d14d/users/fd6631020d97498097db83c542447db5/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:52.347354 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee4888-4aaa-4684-abb8-8005e16940a3 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:52.347720 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee4888-4aaa-4684-abb8-8005e16940a3 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:52.348007 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee4888-4aaa-4684-abb8-8005e16940a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:52.384413 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-b3ee4888-4aaa-4684-abb8-8005e16940a3 None None] MFA Rules not processed for user `fd6631020d97498097db83c542447db5`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:52.387303 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-b3ee4888-4aaa-4684-abb8-8005e16940a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:52.456965 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe304b-0962-4d66-aa79-5a67feb1605f admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:52.460570 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8efe304b-0962-4d66-aa79-5a67feb1605f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:52.513952 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 942/1905] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:52 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 04:05:52.520932 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee4888-4aaa-4684-abb8-8005e16940a3 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:52.591376 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe304b-0962-4d66-aa79-5a67feb1605f admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:52.600314 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba459974-938c-4fb8-9633-8f45676b674d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:52.602116 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba459974-938c-4fb8-9633-8f45676b674d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:52.602615 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba459974-938c-4fb8-9633-8f45676b674d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:52.603290 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba459974-938c-4fb8-9633-8f45676b674d admin admin] PATH_INFO: `/v3/users/d66158194ffe49b9b70abdea5e41abd4` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:52.606617 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba459974-938c-4fb8-9633-8f45676b674d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d66158194ffe49b9b70abdea5e41abd4)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:52.610869 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba459974-938c-4fb8-9633-8f45676b674d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:52.632482 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee4888-4aaa-4684-abb8-8005e16940a3 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:52.640487 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffb05a-55f2-4f12-acbc-2a95c7e79032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:52.640487 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffb05a-55f2-4f12-acbc-2a95c7e79032 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:52.640487 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffb05a-55f2-4f12-acbc-2a95c7e79032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:52.640487 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffb05a-55f2-4f12-acbc-2a95c7e79032 admin admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:52.641035 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afffb05a-55f2-4f12-acbc-2a95c7e79032 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:52.642117 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afffb05a-55f2-4f12-acbc-2a95c7e79032 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:52.754910 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 943/1906] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:05:52 2022] POST /identity/v3/projects => generated 367 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:05:52.758553 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffb05a-55f2-4f12-acbc-2a95c7e79032 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:52.759382 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-afffb05a-55f2-4f12-acbc-2a95c7e79032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:52.867620 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:52.883247 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffb05a-55f2-4f12-acbc-2a95c7e79032 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:52.889459 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ba459974-938c-4fb8-9633-8f45676b674d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd66158194ffe49b9b70abdea5e41abd4'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:52.890333 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ba459974-938c-4fb8-9633-8f45676b674d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd66158194ffe49b9b70abdea5e41abd4'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:52.897445 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87874ce-6f96-4008-a243-e24e812ae680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:52.899319 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87874ce-6f96-4008-a243-e24e812ae680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:52.900118 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87874ce-6f96-4008-a243-e24e812ae680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:52.900825 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87874ce-6f96-4008-a243-e24e812ae680 admin admin] PATH_INFO: `/v3/projects/3fa4f8472d7444b6ae9c4409da6d8d9e` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:52.904893 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87874ce-6f96-4008-a243-e24e812ae680 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fa4f8472d7444b6ae9c4409da6d8d9e)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:52.911598 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87874ce-6f96-4008-a243-e24e812ae680 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:52.915099 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ba459974-938c-4fb8-9633-8f45676b674d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd66158194ffe49b9b70abdea5e41abd4'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:52.925093 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ba459974-938c-4fb8-9633-8f45676b674d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd66158194ffe49b9b70abdea5e41abd4'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:52.926417 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ba459974-938c-4fb8-9633-8f45676b674d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd66158194ffe49b9b70abdea5e41abd4'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:52.972991 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:53.023106 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 964/1907] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:05:52 2022] DELETE /identity/v3/users/d66158194ffe49b9b70abdea5e41abd4 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:05:53.024092 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba459974-938c-4fb8-9633-8f45676b674d admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:53.025583 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ba459974-938c-4fb8-9633-8f45676b674d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:53.093411 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-d87874ce-6f96-4008-a243-e24e812ae680 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fa4f8472d7444b6ae9c4409da6d8d9e', 'request_id': 'req-d87874ce-6f96-4008-a243-e24e812ae680'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:53.114221 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-d87874ce-6f96-4008-a243-e24e812ae680 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fa4f8472d7444b6ae9c4409da6d8d9e', 'request_id': 'req-d87874ce-6f96-4008-a243-e24e812ae680'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:53.119409 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba459974-938c-4fb8-9633-8f45676b674d admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:53.121040 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-d87874ce-6f96-4008-a243-e24e812ae680 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fa4f8472d7444b6ae9c4409da6d8d9e', 'request_id': 'req-d87874ce-6f96-4008-a243-e24e812ae680'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:53.232609 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987817af-b0da-44b0-b9fc-92f67c431043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:53.234119 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987817af-b0da-44b0-b9fc-92f67c431043 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:53.234616 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987817af-b0da-44b0-b9fc-92f67c431043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:53.235099 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987817af-b0da-44b0-b9fc-92f67c431043 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:53.236415 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987817af-b0da-44b0-b9fc-92f67c431043 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:53.240239 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987817af-b0da-44b0-b9fc-92f67c431043 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:53.269916 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-d87874ce-6f96-4008-a243-e24e812ae680 admin admin] The token cache is being invalidate because project 3fa4f8472d7444b6ae9c4409da6d8d9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:05:53.270441 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-d87874ce-6f96-4008-a243-e24e812ae680 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:53.271679 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-d87874ce-6f96-4008-a243-e24e812ae680 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:53.274456 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 944/1908] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:05:52 2022] DELETE /identity/v3/projects/3fa4f8472d7444b6ae9c4409da6d8d9e => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:53.277237 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca0686-27a5-4d5b-8bdd-a4483ed18dae None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:53.278047 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca0686-27a5-4d5b-8bdd-a4483ed18dae None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:53.278547 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca0686-27a5-4d5b-8bdd-a4483ed18dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:53.310319 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-16ca0686-27a5-4d5b-8bdd-a4483ed18dae None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:53.312859 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-16ca0686-27a5-4d5b-8bdd-a4483ed18dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:53.326914 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 945/1909] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:53.327827 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca0686-27a5-4d5b-8bdd-a4483ed18dae None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:53.329312 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-16ca0686-27a5-4d5b-8bdd-a4483ed18dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:53.343331 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca0686-27a5-4d5b-8bdd-a4483ed18dae None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:53.349253 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3f2f9-6e4b-4a03-8ac2-9b5d515c83ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:53.351050 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3f2f9-6e4b-4a03-8ac2-9b5d515c83ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:53.351571 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3f2f9-6e4b-4a03-8ac2-9b5d515c83ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:53.352036 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3f2f9-6e4b-4a03-8ac2-9b5d515c83ea admin admin] PATH_INFO: `/v3/users/aa7c5db53b004482829f263a623f33d7` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:53.355105 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa3f2f9-6e4b-4a03-8ac2-9b5d515c83ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa7c5db53b004482829f263a623f33d7)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:53.359365 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa3f2f9-6e4b-4a03-8ac2-9b5d515c83ea admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:53.425388 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 965/1910] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:05:53 2022] POST /identity/v3/users => generated 290 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:05:53.425388 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987817af-b0da-44b0-b9fc-92f67c431043 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:53.425806 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-987817af-b0da-44b0-b9fc-92f67c431043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:53.526680 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987817af-b0da-44b0-b9fc-92f67c431043 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:53.531948 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45183c9-5f9a-4726-a381-8383dfa82d07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:53.532945 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45183c9-5f9a-4726-a381-8383dfa82d07 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:53.535566 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45183c9-5f9a-4726-a381-8383dfa82d07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:53.535566 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45183c9-5f9a-4726-a381-8383dfa82d07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:53.548342 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45183c9-5f9a-4726-a381-8383dfa82d07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:53.549863 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45183c9-5f9a-4726-a381-8383dfa82d07 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:53.565252 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 966/1911] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:05:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:05:53.565252 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45183c9-5f9a-4726-a381-8383dfa82d07 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:53.565252 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d45183c9-5f9a-4726-a381-8383dfa82d07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:53.577589 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45183c9-5f9a-4726-a381-8383dfa82d07 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:53.582936 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33647c7-b8ac-4cd4-a366-66c52ca26bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:53.583846 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33647c7-b8ac-4cd4-a366-66c52ca26bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:53.584132 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33647c7-b8ac-4cd4-a366-66c52ca26bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:53.584412 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33647c7-b8ac-4cd4-a366-66c52ca26bd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:53.585208 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33647c7-b8ac-4cd4-a366-66c52ca26bd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:53.586863 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33647c7-b8ac-4cd4-a366-66c52ca26bd9 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:53.597963 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 967/1912] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:05:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:05:53.602705 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33647c7-b8ac-4cd4-a366-66c52ca26bd9 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:53.613477 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33647c7-b8ac-4cd4-a366-66c52ca26bd9 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:53.619065 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004d0f8-25e3-4213-a93e-bb25b521423d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:53.620096 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004d0f8-25e3-4213-a93e-bb25b521423d admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:53.620909 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004d0f8-25e3-4213-a93e-bb25b521423d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:53.621189 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004d0f8-25e3-4213-a93e-bb25b521423d admin admin] PATH_INFO: `/v3/projects/00468fee8a804d5f864b980f0ab27e32/users/ec14a4e1917e469480d585c46687ab3f/roles/681755518698445fabd9a8accec13c0f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:53.640329 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004d0f8-25e3-4213-a93e-bb25b521423d admin admin] RBAC: Authorizing `identity:create_grant(project_id=00468fee8a804d5f864b980f0ab27e32, user_id=ec14a4e1917e469480d585c46687ab3f, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:53.641151 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-aaa3f2f9-6e4b-4a03-8ac2-9b5d515c83ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa7c5db53b004482829f263a623f33d7'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:53.642037 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-aaa3f2f9-6e4b-4a03-8ac2-9b5d515c83ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa7c5db53b004482829f263a623f33d7'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:53.643082 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004d0f8-25e3-4213-a93e-bb25b521423d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:53.797745 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-aaa3f2f9-6e4b-4a03-8ac2-9b5d515c83ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa7c5db53b004482829f263a623f33d7'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:53.803534 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-aaa3f2f9-6e4b-4a03-8ac2-9b5d515c83ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa7c5db53b004482829f263a623f33d7'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:53.811214 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-aaa3f2f9-6e4b-4a03-8ac2-9b5d515c83ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa7c5db53b004482829f263a623f33d7'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:53.817904 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 968/1913] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:05:53 2022] PUT /identity/v3/projects/00468fee8a804d5f864b980f0ab27e32/users/ec14a4e1917e469480d585c46687ab3f/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:05:53.822863 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004d0f8-25e3-4213-a93e-bb25b521423d admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:53.827871 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-4004d0f8-25e3-4213-a93e-bb25b521423d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:53.856093 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 946/1914] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:05:53 2022] DELETE /identity/v3/users/aa7c5db53b004482829f263a623f33d7 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:53.882198 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3f2f9-6e4b-4a03-8ac2-9b5d515c83ea admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:53.883841 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-aaa3f2f9-6e4b-4a03-8ac2-9b5d515c83ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:53.963570 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004d0f8-25e3-4213-a93e-bb25b521423d admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:53.969285 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3f2f9-6e4b-4a03-8ac2-9b5d515c83ea admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:53.974738 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c0b32f-f6dc-4962-b08e-67180e3c69cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:53.975789 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0b32f-f6dc-4962-b08e-67180e3c69cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:53.976083 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0b32f-f6dc-4962-b08e-67180e3c69cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:53.976366 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0b32f-f6dc-4962-b08e-67180e3c69cf admin admin] PATH_INFO: `/v3/users/8cf04e8a59744ef49d9bf5f492bd2e3d` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:53.978002 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c0b32f-f6dc-4962-b08e-67180e3c69cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cf04e8a59744ef49d9bf5f492bd2e3d)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:53.980734 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c0b32f-f6dc-4962-b08e-67180e3c69cf admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:53.987148 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5269f-bfe0-41b0-a866-9136928a7e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:53.988084 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5269f-bfe0-41b0-a866-9136928a7e91 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:53.988427 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5269f-bfe0-41b0-a866-9136928a7e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:53.988758 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5269f-bfe0-41b0-a866-9136928a7e91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:53.989898 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac5269f-bfe0-41b0-a866-9136928a7e91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:53.991942 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac5269f-bfe0-41b0-a866-9136928a7e91 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:54.007250 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 969/1915] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:05:53 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:05:54.012183 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5269f-bfe0-41b0-a866-9136928a7e91 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:54.028585 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5269f-bfe0-41b0-a866-9136928a7e91 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:54.035475 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6c59b-a2b5-40f9-a82d-42e53dfac149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:54.036414 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6c59b-a2b5-40f9-a82d-42e53dfac149 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:54.036981 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6c59b-a2b5-40f9-a82d-42e53dfac149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:54.037327 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6c59b-a2b5-40f9-a82d-42e53dfac149 admin admin] PATH_INFO: `/v3/projects/00468fee8a804d5f864b980f0ab27e32/users/ec14a4e1917e469480d585c46687ab3f/roles/681755518698445fabd9a8accec13c0f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:54.040246 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd6c59b-a2b5-40f9-a82d-42e53dfac149 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00468fee8a804d5f864b980f0ab27e32, user_id=ec14a4e1917e469480d585c46687ab3f, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:54.053964 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd6c59b-a2b5-40f9-a82d-42e53dfac149 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:54.068689 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 970/1916] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:05:54 2022] PUT /identity/v3/projects/00468fee8a804d5f864b980f0ab27e32/users/ec14a4e1917e469480d585c46687ab3f/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:54.080333 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a470d5-06f1-4590-b2e6-b1f38793a97e None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:54.080663 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a470d5-06f1-4590-b2e6-b1f38793a97e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:54.080887 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a470d5-06f1-4590-b2e6-b1f38793a97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:54.113533 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-51a470d5-06f1-4590-b2e6-b1f38793a97e None None] MFA Rules not processed for user `ec14a4e1917e469480d585c46687ab3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:54.114806 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-51a470d5-06f1-4590-b2e6-b1f38793a97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:54.206692 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 971/1917] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:54 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 04:05:54.219876 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a470d5-06f1-4590-b2e6-b1f38793a97e None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:54.221991 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-51a470d5-06f1-4590-b2e6-b1f38793a97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:54.332355 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-d1c0b32f-f6dc-4962-b08e-67180e3c69cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cf04e8a59744ef49d9bf5f492bd2e3d'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:54.332355 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-d1c0b32f-f6dc-4962-b08e-67180e3c69cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cf04e8a59744ef49d9bf5f492bd2e3d'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:54.342174 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a470d5-06f1-4590-b2e6-b1f38793a97e None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:54.354328 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f680f-5f48-4ddf-9db3-e416df8dd6a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:54.355048 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f680f-5f48-4ddf-9db3-e416df8dd6a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:54.355334 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f680f-5f48-4ddf-9db3-e416df8dd6a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:54.357079 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f680f-5f48-4ddf-9db3-e416df8dd6a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:54.357890 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-699f680f-5f48-4ddf-9db3-e416df8dd6a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:54.371666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699f680f-5f48-4ddf-9db3-e416df8dd6a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:54.373147 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699f680f-5f48-4ddf-9db3-e416df8dd6a6 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:54.390569 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 972/1918] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:05:54 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:05:54.392267 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f680f-5f48-4ddf-9db3-e416df8dd6a6 service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:54.394284 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-699f680f-5f48-4ddf-9db3-e416df8dd6a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:54.434605 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-d1c0b32f-f6dc-4962-b08e-67180e3c69cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cf04e8a59744ef49d9bf5f492bd2e3d'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:54.436902 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-d1c0b32f-f6dc-4962-b08e-67180e3c69cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cf04e8a59744ef49d9bf5f492bd2e3d'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:54.447303 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-d1c0b32f-f6dc-4962-b08e-67180e3c69cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cf04e8a59744ef49d9bf5f492bd2e3d'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:54.484123 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 947/1919] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:05:53 2022] DELETE /identity/v3/users/8cf04e8a59744ef49d9bf5f492bd2e3d => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:54.501757 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11ee9c-3b91-4c9d-8265-4bdb70125cec None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:54.502622 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11ee9c-3b91-4c9d-8265-4bdb70125cec None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:54.503328 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11ee9c-3b91-4c9d-8265-4bdb70125cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:54.511162 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f680f-5f48-4ddf-9db3-e416df8dd6a6 service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:54.558520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-5a11ee9c-3b91-4c9d-8265-4bdb70125cec None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:54.559770 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-5a11ee9c-3b91-4c9d-8265-4bdb70125cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:54.605653 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f7695-0337-49c0-9e38-1d44d6594ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:54.606845 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f7695-0337-49c0-9e38-1d44d6594ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:54.607371 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f7695-0337-49c0-9e38-1d44d6594ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:54.608144 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f7695-0337-49c0-9e38-1d44d6594ac8 admin admin] PATH_INFO: `/v3/projects/75ae98d33a7f4a25a3fbf6ae92e8461e` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:54.611207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f7695-0337-49c0-9e38-1d44d6594ac8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75ae98d33a7f4a25a3fbf6ae92e8461e)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:54.619983 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f7695-0337-49c0-9e38-1d44d6594ac8 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:54.643696 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 948/1920] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:54.655207 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11ee9c-3b91-4c9d-8265-4bdb70125cec None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:54.656643 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-5a11ee9c-3b91-4c9d-8265-4bdb70125cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:54.721410 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:54.735273 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11ee9c-3b91-4c9d-8265-4bdb70125cec None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:54.735273 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f987791-6f3a-4515-b458-ccc379c6aecd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:54.738413 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f987791-6f3a-4515-b458-ccc379c6aecd service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:54.738733 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f987791-6f3a-4515-b458-ccc379c6aecd service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:54.739015 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f987791-6f3a-4515-b458-ccc379c6aecd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:54.750988 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f987791-6f3a-4515-b458-ccc379c6aecd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:54.752487 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f987791-6f3a-4515-b458-ccc379c6aecd service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:54.764938 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 949/1921] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:05:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 04:05:54.765809 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f987791-6f3a-4515-b458-ccc379c6aecd service neutron] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:54.767144 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-3f987791-6f3a-4515-b458-ccc379c6aecd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:54.781301 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f987791-6f3a-4515-b458-ccc379c6aecd service neutron] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:54.787081 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d5e78-221a-42fc-9731-0c0450202949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:54.788412 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d5e78-221a-42fc-9731-0c0450202949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:54.788527 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d5e78-221a-42fc-9731-0c0450202949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:54.788787 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d5e78-221a-42fc-9731-0c0450202949 admin admin] PATH_INFO: `/v3/projects/10a7e1cfcd9a45979be5dbe9c6201818` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:54.790309 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d5e78-221a-42fc-9731-0c0450202949 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10a7e1cfcd9a45979be5dbe9c6201818)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:54.792796 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d5e78-221a-42fc-9731-0c0450202949 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:54.840508 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c80f7695-0337-49c0-9e38-1d44d6594ac8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75ae98d33a7f4a25a3fbf6ae92e8461e', 'request_id': 'req-c80f7695-0337-49c0-9e38-1d44d6594ac8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:54.859289 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:54.969775 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-db1d5e78-221a-42fc-9731-0c0450202949 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10a7e1cfcd9a45979be5dbe9c6201818', 'request_id': 'req-db1d5e78-221a-42fc-9731-0c0450202949'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:54.977526 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-db1d5e78-221a-42fc-9731-0c0450202949 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10a7e1cfcd9a45979be5dbe9c6201818', 'request_id': 'req-db1d5e78-221a-42fc-9731-0c0450202949'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:54.984080 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c80f7695-0337-49c0-9e38-1d44d6594ac8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75ae98d33a7f4a25a3fbf6ae92e8461e', 'request_id': 'req-c80f7695-0337-49c0-9e38-1d44d6594ac8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:54.984959 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-db1d5e78-221a-42fc-9731-0c0450202949 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10a7e1cfcd9a45979be5dbe9c6201818', 'request_id': 'req-db1d5e78-221a-42fc-9731-0c0450202949'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:54.994523 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c80f7695-0337-49c0-9e38-1d44d6594ac8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75ae98d33a7f4a25a3fbf6ae92e8461e', 'request_id': 'req-c80f7695-0337-49c0-9e38-1d44d6594ac8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:55.030065 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c80f7695-0337-49c0-9e38-1d44d6594ac8 admin admin] The token cache is being invalidate because project 75ae98d33a7f4a25a3fbf6ae92e8461e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:05:55.030380 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c80f7695-0337-49c0-9e38-1d44d6594ac8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:55.031047 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c80f7695-0337-49c0-9e38-1d44d6594ac8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:55.033838 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 973/1922] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:05:54 2022] DELETE /identity/v3/projects/75ae98d33a7f4a25a3fbf6ae92e8461e => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:55.034383 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f7695-0337-49c0-9e38-1d44d6594ac8 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:55.035937 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c80f7695-0337-49c0-9e38-1d44d6594ac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:55.115415 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-db1d5e78-221a-42fc-9731-0c0450202949 admin admin] The token cache is being invalidate because project 10a7e1cfcd9a45979be5dbe9c6201818 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:05:55.115415 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-db1d5e78-221a-42fc-9731-0c0450202949 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:55.115415 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-db1d5e78-221a-42fc-9731-0c0450202949 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:55.115415 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 950/1923] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:05:54 2022] DELETE /identity/v3/projects/10a7e1cfcd9a45979be5dbe9c6201818 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:55.115415 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d5e78-221a-42fc-9731-0c0450202949 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:55.116277 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-db1d5e78-221a-42fc-9731-0c0450202949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:55.133316 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f7695-0337-49c0-9e38-1d44d6594ac8 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:55.191830 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d5e78-221a-42fc-9731-0c0450202949 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:55.197638 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb0cc3-15c4-4b6e-aee0-590d99be9548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:55.198670 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb0cc3-15c4-4b6e-aee0-590d99be9548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:55.198992 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb0cc3-15c4-4b6e-aee0-590d99be9548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:55.199399 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb0cc3-15c4-4b6e-aee0-590d99be9548 admin admin] PATH_INFO: `/v3/users/1918e10bc4b14ddab8e9572d645d7db7` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:55.201158 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb0cc3-15c4-4b6e-aee0-590d99be9548 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1918e10bc4b14ddab8e9572d645d7db7)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:55.201528 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d05c75-054d-47b0-aad4-25d4050eafe6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:55.202301 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d05c75-054d-47b0-aad4-25d4050eafe6 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:55.202686 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d05c75-054d-47b0-aad4-25d4050eafe6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:55.203056 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d05c75-054d-47b0-aad4-25d4050eafe6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:55.203316 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb0cc3-15c4-4b6e-aee0-590d99be9548 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:55.205914 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f8d05c75-054d-47b0-aad4-25d4050eafe6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:55.286260 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d05c75-054d-47b0-aad4-25d4050eafe6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:55.287770 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d05c75-054d-47b0-aad4-25d4050eafe6 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:55.301249 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 974/1924] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:05:55 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:05:55.303330 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26705d66-e6a1-446c-b1f1-0a62c8fe5129 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:55.303865 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26705d66-e6a1-446c-b1f1-0a62c8fe5129 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:55.304362 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26705d66-e6a1-446c-b1f1-0a62c8fe5129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:55.337902 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-26705d66-e6a1-446c-b1f1-0a62c8fe5129 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:55.340654 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-26705d66-e6a1-446c-b1f1-0a62c8fe5129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:55.355651 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 975/1925] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:55.368173 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26705d66-e6a1-446c-b1f1-0a62c8fe5129 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:55.371198 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-26705d66-e6a1-446c-b1f1-0a62c8fe5129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:55.395233 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26705d66-e6a1-446c-b1f1-0a62c8fe5129 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:55.405561 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ab0a6-f87a-4774-971e-41705c8025c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:55.407310 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ab0a6-f87a-4774-971e-41705c8025c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:55.407923 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ab0a6-f87a-4774-971e-41705c8025c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:55.408627 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ab0a6-f87a-4774-971e-41705c8025c3 admin admin] PATH_INFO: `/v3/projects/30252c2c80d741758dbeafe74f570494` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:55.411566 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042ab0a6-f87a-4774-971e-41705c8025c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30252c2c80d741758dbeafe74f570494)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:55.423144 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042ab0a6-f87a-4774-971e-41705c8025c3 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:55.498451 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-7bbb0cc3-15c4-4b6e-aee0-590d99be9548 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1918e10bc4b14ddab8e9572d645d7db7'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:55.499140 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-7bbb0cc3-15c4-4b6e-aee0-590d99be9548 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1918e10bc4b14ddab8e9572d645d7db7'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:55.613366 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-042ab0a6-f87a-4774-971e-41705c8025c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30252c2c80d741758dbeafe74f570494', 'request_id': 'req-042ab0a6-f87a-4774-971e-41705c8025c3'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:55.688835 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-7bbb0cc3-15c4-4b6e-aee0-590d99be9548 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1918e10bc4b14ddab8e9572d645d7db7'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:55.689661 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-7bbb0cc3-15c4-4b6e-aee0-590d99be9548 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1918e10bc4b14ddab8e9572d645d7db7'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:55.700611 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-7bbb0cc3-15c4-4b6e-aee0-590d99be9548 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1918e10bc4b14ddab8e9572d645d7db7'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:55.723167 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 951/1926] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:05:55 2022] DELETE /identity/v3/users/1918e10bc4b14ddab8e9572d645d7db7 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:55.724911 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39d3cf-94f6-4de0-bbef-eb764a20bbf7 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:55.725378 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39d3cf-94f6-4de0-bbef-eb764a20bbf7 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:55.725757 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39d3cf-94f6-4de0-bbef-eb764a20bbf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:55.764166 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-8e39d3cf-94f6-4de0-bbef-eb764a20bbf7 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:55.765851 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-8e39d3cf-94f6-4de0-bbef-eb764a20bbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:55.852951 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-042ab0a6-f87a-4774-971e-41705c8025c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30252c2c80d741758dbeafe74f570494', 'request_id': 'req-042ab0a6-f87a-4774-971e-41705c8025c3'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:55.860228 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-042ab0a6-f87a-4774-971e-41705c8025c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30252c2c80d741758dbeafe74f570494', 'request_id': 'req-042ab0a6-f87a-4774-971e-41705c8025c3'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:55.873622 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-042ab0a6-f87a-4774-971e-41705c8025c3 admin admin] The token cache is being invalidate because project 30252c2c80d741758dbeafe74f570494 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:05:55.874102 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-042ab0a6-f87a-4774-971e-41705c8025c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:55.874824 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-042ab0a6-f87a-4774-971e-41705c8025c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:55.875758 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 952/1927] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:55.878549 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 976/1928] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:05:55 2022] DELETE /identity/v3/projects/30252c2c80d741758dbeafe74f570494 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:55.881517 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39d3cf-94f6-4de0-bbef-eb764a20bbf7 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:55.883075 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ab0a6-f87a-4774-971e-41705c8025c3 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:55.889181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-042ab0a6-f87a-4774-971e-41705c8025c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:55.894219 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39d3cf-94f6-4de0-bbef-eb764a20bbf7 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:55.899422 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418f806-90fc-4427-ba34-9a6d500e7a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:55.900372 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418f806-90fc-4427-ba34-9a6d500e7a7a admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:55.900508 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418f806-90fc-4427-ba34-9a6d500e7a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:55.900728 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418f806-90fc-4427-ba34-9a6d500e7a7a admin admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:55.902062 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418f806-90fc-4427-ba34-9a6d500e7a7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:05:55.903260 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418f806-90fc-4427-ba34-9a6d500e7a7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:55.913637 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418f806-90fc-4427-ba34-9a6d500e7a7a admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:55.924739 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 953/1929] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:05:55.929601 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418f806-90fc-4427-ba34-9a6d500e7a7a admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:55.931931 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-3418f806-90fc-4427-ba34-9a6d500e7a7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:55.948791 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418f806-90fc-4427-ba34-9a6d500e7a7a admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:55.954116 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e06af6-8d9f-4803-8fff-cae72b87c4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:55.954802 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e06af6-8d9f-4803-8fff-cae72b87c4d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:55.955088 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e06af6-8d9f-4803-8fff-cae72b87c4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:55.955383 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e06af6-8d9f-4803-8fff-cae72b87c4d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:55.956151 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e06af6-8d9f-4803-8fff-cae72b87c4d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:55.958231 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e06af6-8d9f-4803-8fff-cae72b87c4d5 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:55.986866 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ab0a6-f87a-4774-971e-41705c8025c3 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:55.992378 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f765f8-2c7f-487d-9cd9-1b7893672627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:55.993329 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f765f8-2c7f-487d-9cd9-1b7893672627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:55.993617 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f765f8-2c7f-487d-9cd9-1b7893672627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:55.993893 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f765f8-2c7f-487d-9cd9-1b7893672627 admin admin] PATH_INFO: `/v3/users/bef18e4087ca446587e1c329881280a0` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:55.995898 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f765f8-2c7f-487d-9cd9-1b7893672627 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bef18e4087ca446587e1c329881280a0)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:55.998249 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f765f8-2c7f-487d-9cd9-1b7893672627 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:56.132254 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 954/1930] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:05:55 2022] POST /identity/v3/projects => generated 367 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:05:56.139409 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e06af6-8d9f-4803-8fff-cae72b87c4d5 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:56.274520 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-86f765f8-2c7f-487d-9cd9-1b7893672627 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bef18e4087ca446587e1c329881280a0'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:56.275045 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-86f765f8-2c7f-487d-9cd9-1b7893672627 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bef18e4087ca446587e1c329881280a0'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:56.300039 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-86f765f8-2c7f-487d-9cd9-1b7893672627 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bef18e4087ca446587e1c329881280a0'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:56.303305 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e06af6-8d9f-4803-8fff-cae72b87c4d5 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:56.315925 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-86f765f8-2c7f-487d-9cd9-1b7893672627 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bef18e4087ca446587e1c329881280a0'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:56.317259 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-86f765f8-2c7f-487d-9cd9-1b7893672627 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bef18e4087ca446587e1c329881280a0'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:56.318121 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84a84a-d971-491a-8720-aae078d1bf06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:56.330109 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84a84a-d971-491a-8720-aae078d1bf06 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:56.330109 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84a84a-d971-491a-8720-aae078d1bf06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:56.330109 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84a84a-d971-491a-8720-aae078d1bf06 admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:56.330109 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84a84a-d971-491a-8720-aae078d1bf06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:56.333771 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84a84a-d971-491a-8720-aae078d1bf06 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:56.437107 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 977/1931] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:05:55 2022] DELETE /identity/v3/users/bef18e4087ca446587e1c329881280a0 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:56.485384 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 955/1932] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:05:56 2022] POST /identity/v3/users => generated 284 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:05:56.492396 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f765f8-2c7f-487d-9cd9-1b7893672627 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:56.494977 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-86f765f8-2c7f-487d-9cd9-1b7893672627 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:56.525812 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84a84a-d971-491a-8720-aae078d1bf06 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:56.525812 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-ca84a84a-d971-491a-8720-aae078d1bf06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:56.569311 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84a84a-d971-491a-8720-aae078d1bf06 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:56.623097 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:56.657496 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f765f8-2c7f-487d-9cd9-1b7893672627 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:56.664090 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb919a16-05dc-4284-a9a0-5bc4b5351fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:56.665537 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb919a16-05dc-4284-a9a0-5bc4b5351fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:56.665983 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb919a16-05dc-4284-a9a0-5bc4b5351fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:56.666481 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb919a16-05dc-4284-a9a0-5bc4b5351fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:56.670182 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb919a16-05dc-4284-a9a0-5bc4b5351fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:56.673359 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb919a16-05dc-4284-a9a0-5bc4b5351fa9 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:56.702645 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 978/1933] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:05:56.704507 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb919a16-05dc-4284-a9a0-5bc4b5351fa9 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:56.707568 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40fe273-2e55-4392-a5fb-6b9c8a5a46e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:56.707729 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-cb919a16-05dc-4284-a9a0-5bc4b5351fa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:56.708839 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40fe273-2e55-4392-a5fb-6b9c8a5a46e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:56.709299 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40fe273-2e55-4392-a5fb-6b9c8a5a46e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:56.709739 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40fe273-2e55-4392-a5fb-6b9c8a5a46e1 admin admin] PATH_INFO: `/v3/projects/e552c16c13a7488a8ac7f1e935db3da0` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:56.711159 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40fe273-2e55-4392-a5fb-6b9c8a5a46e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e552c16c13a7488a8ac7f1e935db3da0)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:56.715631 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40fe273-2e55-4392-a5fb-6b9c8a5a46e1 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:56.731650 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb919a16-05dc-4284-a9a0-5bc4b5351fa9 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:56.740427 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7704034b-f14e-4b46-97ff-7daae90daf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:56.742194 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704034b-f14e-4b46-97ff-7daae90daf54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:56.745474 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704034b-f14e-4b46-97ff-7daae90daf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:56.745474 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704034b-f14e-4b46-97ff-7daae90daf54 admin admin] PATH_INFO: `/v3/users/5614c16fe7ed4d1cacd1245296968796` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:56.745474 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7704034b-f14e-4b46-97ff-7daae90daf54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5614c16fe7ed4d1cacd1245296968796)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:56.747478 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7704034b-f14e-4b46-97ff-7daae90daf54 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:56.940014 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-e40fe273-2e55-4392-a5fb-6b9c8a5a46e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e552c16c13a7488a8ac7f1e935db3da0', 'request_id': 'req-e40fe273-2e55-4392-a5fb-6b9c8a5a46e1'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:56.950216 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-e40fe273-2e55-4392-a5fb-6b9c8a5a46e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e552c16c13a7488a8ac7f1e935db3da0', 'request_id': 'req-e40fe273-2e55-4392-a5fb-6b9c8a5a46e1'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:56.960192 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-e40fe273-2e55-4392-a5fb-6b9c8a5a46e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e552c16c13a7488a8ac7f1e935db3da0', 'request_id': 'req-e40fe273-2e55-4392-a5fb-6b9c8a5a46e1'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:57.115032 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-e40fe273-2e55-4392-a5fb-6b9c8a5a46e1 admin admin] The token cache is being invalidate because project e552c16c13a7488a8ac7f1e935db3da0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:05:57.115396 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-e40fe273-2e55-4392-a5fb-6b9c8a5a46e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:57.116721 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-e40fe273-2e55-4392-a5fb-6b9c8a5a46e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:57.123349 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 956/1934] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:05:56 2022] DELETE /identity/v3/projects/e552c16c13a7488a8ac7f1e935db3da0 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:05:57.123349 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40fe273-2e55-4392-a5fb-6b9c8a5a46e1 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:57.123349 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-e40fe273-2e55-4392-a5fb-6b9c8a5a46e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:57.131210 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-7704034b-f14e-4b46-97ff-7daae90daf54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5614c16fe7ed4d1cacd1245296968796'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:57.132558 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-7704034b-f14e-4b46-97ff-7daae90daf54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5614c16fe7ed4d1cacd1245296968796'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:57.159838 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-7704034b-f14e-4b46-97ff-7daae90daf54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5614c16fe7ed4d1cacd1245296968796'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:57.173070 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-7704034b-f14e-4b46-97ff-7daae90daf54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5614c16fe7ed4d1cacd1245296968796'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:57.173937 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-7704034b-f14e-4b46-97ff-7daae90daf54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5614c16fe7ed4d1cacd1245296968796'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:57.231706 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40fe273-2e55-4392-a5fb-6b9c8a5a46e1 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:57.241507 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee71a9a-3bd5-4d94-9d88-f7403760f313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:57.241507 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee71a9a-3bd5-4d94-9d88-f7403760f313 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:57.241507 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee71a9a-3bd5-4d94-9d88-f7403760f313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:57.242041 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee71a9a-3bd5-4d94-9d88-f7403760f313 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:57.242999 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee71a9a-3bd5-4d94-9d88-f7403760f313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:57.246048 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee71a9a-3bd5-4d94-9d88-f7403760f313 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:57.257950 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 957/1935] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:05:57.259302 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7cf12e-1711-4cf6-98d0-6a1f8ab00080 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:57.259605 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7cf12e-1711-4cf6-98d0-6a1f8ab00080 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:57.259920 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7cf12e-1711-4cf6-98d0-6a1f8ab00080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:57.271687 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 979/1936] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:05:56 2022] DELETE /identity/v3/users/5614c16fe7ed4d1cacd1245296968796 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:57.276759 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7704034b-f14e-4b46-97ff-7daae90daf54 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:57.278709 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-7704034b-f14e-4b46-97ff-7daae90daf54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:57.290590 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-4b7cf12e-1711-4cf6-98d0-6a1f8ab00080 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:57.293423 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-4b7cf12e-1711-4cf6-98d0-6a1f8ab00080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:57.374326 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7704034b-f14e-4b46-97ff-7daae90daf54 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:57.379017 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700640c-564a-4fb9-a10f-1d9797794749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:57.379965 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700640c-564a-4fb9-a10f-1d9797794749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:57.380246 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700640c-564a-4fb9-a10f-1d9797794749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:57.380521 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700640c-564a-4fb9-a10f-1d9797794749 admin admin] PATH_INFO: `/v3/projects/017081ebfba446fbb736468138f469d7` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:57.381052 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 958/1937] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:57.381707 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7cf12e-1711-4cf6-98d0-6a1f8ab00080 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:57.383132 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-4b7cf12e-1711-4cf6-98d0-6a1f8ab00080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:57.385841 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9700640c-564a-4fb9-a10f-1d9797794749 admin admin] RBAC: Authorizing `identity:delete_project(project_id=017081ebfba446fbb736468138f469d7)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:57.390562 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9700640c-564a-4fb9-a10f-1d9797794749 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:57.395029 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:57.398524 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7cf12e-1711-4cf6-98d0-6a1f8ab00080 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:57.404128 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f52708a-d141-4511-9fd9-cd9296b1ab92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:57.405048 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52708a-d141-4511-9fd9-cd9296b1ab92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:57.405518 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52708a-d141-4511-9fd9-cd9296b1ab92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:57.405784 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52708a-d141-4511-9fd9-cd9296b1ab92 admin admin] PATH_INFO: `/v3/projects/53940a84b07e4dcca512f4f90a1061d3/users/6a6124937aac421a91a4766c38643960/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:57.423670 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f52708a-d141-4511-9fd9-cd9296b1ab92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53940a84b07e4dcca512f4f90a1061d3, user_id=6a6124937aac421a91a4766c38643960, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:57.427098 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f52708a-d141-4511-9fd9-cd9296b1ab92 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:57.596945 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 959/1938] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:05:57 2022] PUT /identity/v3/projects/53940a84b07e4dcca512f4f90a1061d3/users/6a6124937aac421a91a4766c38643960/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:57.598640 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca0b60-88d4-453b-8496-15dd0a928a1f None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:57.599098 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca0b60-88d4-453b-8496-15dd0a928a1f None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:57.599635 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca0b60-88d4-453b-8496-15dd0a928a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:57.608152 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-9700640c-564a-4fb9-a10f-1d9797794749 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '017081ebfba446fbb736468138f469d7', 'request_id': 'req-9700640c-564a-4fb9-a10f-1d9797794749'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:57.626842 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-56ca0b60-88d4-453b-8496-15dd0a928a1f None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:57.627774 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-56ca0b60-88d4-453b-8496-15dd0a928a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:57.695893 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-9700640c-564a-4fb9-a10f-1d9797794749 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '017081ebfba446fbb736468138f469d7', 'request_id': 'req-9700640c-564a-4fb9-a10f-1d9797794749'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:57.703761 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-9700640c-564a-4fb9-a10f-1d9797794749 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '017081ebfba446fbb736468138f469d7', 'request_id': 'req-9700640c-564a-4fb9-a10f-1d9797794749'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:57.707339 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 960/1939] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:57.712096 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d309bf-5d8d-4d8a-9f87-30e606598576 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:57.712445 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d309bf-5d8d-4d8a-9f87-30e606598576 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:57.713107 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d309bf-5d8d-4d8a-9f87-30e606598576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:57.722694 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-9700640c-564a-4fb9-a10f-1d9797794749 admin admin] The token cache is being invalidate because project 017081ebfba446fbb736468138f469d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:05:57.723007 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-9700640c-564a-4fb9-a10f-1d9797794749 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:57.723782 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-9700640c-564a-4fb9-a10f-1d9797794749 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:57.729252 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 980/1940] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:05:57 2022] DELETE /identity/v3/projects/017081ebfba446fbb736468138f469d7 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:57.732143 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc0a86-b6a9-42c2-b1e2-41c4ca2d5ca3 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:57.732492 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc0a86-b6a9-42c2-b1e2-41c4ca2d5ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:57.738519 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc0a86-b6a9-42c2-b1e2-41c4ca2d5ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:57.738644 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-08d309bf-5d8d-4d8a-9f87-30e606598576 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:57.738644 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-08d309bf-5d8d-4d8a-9f87-30e606598576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:57.745791 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 961/1941] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:57.746794 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d309bf-5d8d-4d8a-9f87-30e606598576 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:57.748514 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-08d309bf-5d8d-4d8a-9f87-30e606598576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:57.773969 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-c6fc0a86-b6a9-42c2-b1e2-41c4ca2d5ca3 None None] MFA Rules not processed for user `6a6124937aac421a91a4766c38643960`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:57.775206 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c6fc0a86-b6a9-42c2-b1e2-41c4ca2d5ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:57.811041 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d309bf-5d8d-4d8a-9f87-30e606598576 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:57.814965 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82697b30-a8c7-4348-b456-0e752f90cab9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:57.815672 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82697b30-a8c7-4348-b456-0e752f90cab9 service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:57.815959 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82697b30-a8c7-4348-b456-0e752f90cab9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:57.816237 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82697b30-a8c7-4348-b456-0e752f90cab9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:57.818645 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-82697b30-a8c7-4348-b456-0e752f90cab9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:57.831137 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82697b30-a8c7-4348-b456-0e752f90cab9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:57.832634 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82697b30-a8c7-4348-b456-0e752f90cab9 service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:57.843416 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 962/1942] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:05:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:05:57.844693 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b916a9b-d238-4c0d-9929-7ccb3ae70db7 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:57.844982 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b916a9b-d238-4c0d-9929-7ccb3ae70db7 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:57.845259 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b916a9b-d238-4c0d-9929-7ccb3ae70db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:57.856066 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 981/1943] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:57 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:57.857705 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc0a86-b6a9-42c2-b1e2-41c4ca2d5ca3 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:57.872323 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-7b916a9b-d238-4c0d-9929-7ccb3ae70db7 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:57.873768 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-7b916a9b-d238-4c0d-9929-7ccb3ae70db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:57.874061 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc0a86-b6a9-42c2-b1e2-41c4ca2d5ca3 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:57.879864 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d46a1-4470-45a7-923b-dbdd4438ed13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:57.880825 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d46a1-4470-45a7-923b-dbdd4438ed13 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:57.881285 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d46a1-4470-45a7-923b-dbdd4438ed13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:57.881698 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d46a1-4470-45a7-923b-dbdd4438ed13 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:57.882584 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d46a1-4470-45a7-923b-dbdd4438ed13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:05:57.883292 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d46a1-4470-45a7-923b-dbdd4438ed13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:57.883966 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 963/1944] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:57.885054 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b916a9b-d238-4c0d-9929-7ccb3ae70db7 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:57.885248 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d46a1-4470-45a7-923b-dbdd4438ed13 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:57.889561 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-7b916a9b-d238-4c0d-9929-7ccb3ae70db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:57.898294 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 982/1945] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:05:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:05:57.899888 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d02e76-79c4-436c-b3af-ed94a527dd9a None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:57.904483 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d02e76-79c4-436c-b3af-ed94a527dd9a None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:57.904483 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d02e76-79c4-436c-b3af-ed94a527dd9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:57.911040 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b916a9b-d238-4c0d-9929-7ccb3ae70db7 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:57.916801 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec5fd5-9453-420a-91a7-8e719095848f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:57.919294 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec5fd5-9453-420a-91a7-8e719095848f admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:57.919294 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec5fd5-9453-420a-91a7-8e719095848f admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:57.919543 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec5fd5-9453-420a-91a7-8e719095848f admin admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:57.925610 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-89d02e76-79c4-436c-b3af-ed94a527dd9a None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:57.936411 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-89d02e76-79c4-436c-b3af-ed94a527dd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:57.936592 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec5fd5-9453-420a-91a7-8e719095848f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:57.936667 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 983/1946] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:57.937174 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d02e76-79c4-436c-b3af-ed94a527dd9a None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:57.943397 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec5fd5-9453-420a-91a7-8e719095848f admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:57.964234 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d02e76-79c4-436c-b3af-ed94a527dd9a None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:57.970723 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764fcc86-4768-4ade-9928-d710e182768c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:57.971693 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764fcc86-4768-4ade-9928-d710e182768c admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:57.971977 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764fcc86-4768-4ade-9928-d710e182768c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:57.972405 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764fcc86-4768-4ade-9928-d710e182768c admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:57.973327 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764fcc86-4768-4ade-9928-d710e182768c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:57.976008 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764fcc86-4768-4ade-9928-d710e182768c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:58.146468 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 964/1947] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:05:57 2022] POST /identity/v3/projects => generated 369 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:05:58.150240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec5fd5-9453-420a-91a7-8e719095848f admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:58.232862 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 984/1948] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:05:57 2022] POST /identity/v3/projects => generated 379 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:05:58.235914 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764fcc86-4768-4ade-9928-d710e182768c admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:58.306816 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec5fd5-9453-420a-91a7-8e719095848f admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:58.352173 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764fcc86-4768-4ade-9928-d710e182768c admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:58.359266 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548744d-18c9-4ddf-8ec2-645c9ac2242e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:58.360766 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548744d-18c9-4ddf-8ec2-645c9ac2242e admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:58.360918 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548744d-18c9-4ddf-8ec2-645c9ac2242e admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:58.361214 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548744d-18c9-4ddf-8ec2-645c9ac2242e admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:58.361954 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6548744d-18c9-4ddf-8ec2-645c9ac2242e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:58.365118 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6548744d-18c9-4ddf-8ec2-645c9ac2242e admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:58.442695 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa25e8-f6d6-4026-9f28-501ab61cccda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:58.443931 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa25e8-f6d6-4026-9f28-501ab61cccda admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:58.444352 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa25e8-f6d6-4026-9f28-501ab61cccda admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:58.444939 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa25e8-f6d6-4026-9f28-501ab61cccda admin admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:58.446013 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fa25e8-f6d6-4026-9f28-501ab61cccda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:05:58.446447 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fa25e8-f6d6-4026-9f28-501ab61cccda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:58.449001 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fa25e8-f6d6-4026-9f28-501ab61cccda admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:58.466153 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 965/1949] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:05:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:05:58.468251 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa25e8-f6d6-4026-9f28-501ab61cccda admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:58.488824 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 985/1950] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:05:58 2022] POST /identity/v3/users => generated 291 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:05:58.490507 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548744d-18c9-4ddf-8ec2-645c9ac2242e admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:58.507438 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548744d-18c9-4ddf-8ec2-645c9ac2242e admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:58.515932 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d8fd71-42c7-40f6-817a-90fb393c6748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:58.515932 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8fd71-42c7-40f6-817a-90fb393c6748 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:58.515932 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8fd71-42c7-40f6-817a-90fb393c6748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:58.515932 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8fd71-42c7-40f6-817a-90fb393c6748 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:58.516603 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d8fd71-42c7-40f6-817a-90fb393c6748 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:58.517488 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d8fd71-42c7-40f6-817a-90fb393c6748 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:58.531067 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa25e8-f6d6-4026-9f28-501ab61cccda admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:58.543216 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a5beb-d8f0-4600-b946-bfa466e3afeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:58.547478 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a5beb-d8f0-4600-b946-bfa466e3afeb admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:58.547478 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a5beb-d8f0-4600-b946-bfa466e3afeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:58.547478 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a5beb-d8f0-4600-b946-bfa466e3afeb admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:58.547478 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48a5beb-d8f0-4600-b946-bfa466e3afeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:58.552876 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48a5beb-d8f0-4600-b946-bfa466e3afeb admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:58.569368 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:05:58.642264 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 986/1951] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:05:58 2022] POST /identity/v3/projects => generated 387 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:05:58.643442 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d8fd71-42c7-40f6-817a-90fb393c6748 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:58.694131 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 966/1952] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:05:58 2022] POST /identity/v3/users => generated 290 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:05:58.697294 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a5beb-d8f0-4600-b946-bfa466e3afeb admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:58.724212 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a5beb-d8f0-4600-b946-bfa466e3afeb admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:58.744705 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d8fd71-42c7-40f6-817a-90fb393c6748 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:58.750842 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6028c6-a5a6-4677-9141-47ec3ddc7a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:58.751490 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6028c6-a5a6-4677-9141-47ec3ddc7a1d admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:58.751790 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6028c6-a5a6-4677-9141-47ec3ddc7a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:58.752090 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6028c6-a5a6-4677-9141-47ec3ddc7a1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:58.752820 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6028c6-a5a6-4677-9141-47ec3ddc7a1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:58.754500 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6028c6-a5a6-4677-9141-47ec3ddc7a1d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:58.781007 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 987/1953] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:05:58.781909 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6028c6-a5a6-4677-9141-47ec3ddc7a1d admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:58.810454 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6028c6-a5a6-4677-9141-47ec3ddc7a1d admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:58.820468 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09987c-d908-4298-b534-b9b8f92efba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:58.821652 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09987c-d908-4298-b534-b9b8f92efba0 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:58.822142 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09987c-d908-4298-b534-b9b8f92efba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:58.822758 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09987c-d908-4298-b534-b9b8f92efba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:58.824886 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da09987c-d908-4298-b534-b9b8f92efba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:58.835539 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da09987c-d908-4298-b534-b9b8f92efba0 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:58.841040 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ce692-6150-4102-9d58-0269d2adff8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:58.841919 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ce692-6150-4102-9d58-0269d2adff8b admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:58.842310 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ce692-6150-4102-9d58-0269d2adff8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:58.842691 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ce692-6150-4102-9d58-0269d2adff8b admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:58.843539 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78ce692-6150-4102-9d58-0269d2adff8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:58.846275 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78ce692-6150-4102-9d58-0269d2adff8b admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:58.850199 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 988/1954] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:05:58.851235 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09987c-d908-4298-b534-b9b8f92efba0 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:58.853809 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-da09987c-d908-4298-b534-b9b8f92efba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:58.872415 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09987c-d908-4298-b534-b9b8f92efba0 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:58.877799 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb595da3-05be-41f9-ba85-d467856cc428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:58.879204 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb595da3-05be-41f9-ba85-d467856cc428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:58.879677 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb595da3-05be-41f9-ba85-d467856cc428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:58.879888 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb595da3-05be-41f9-ba85-d467856cc428 admin admin] PATH_INFO: `/v3/projects/3e2eae469ab3406c9346724af731833b` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:58.881326 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb595da3-05be-41f9-ba85-d467856cc428 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e2eae469ab3406c9346724af731833b)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:58.883441 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb595da3-05be-41f9-ba85-d467856cc428 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:58.935056 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 967/1955] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:05:58 2022] POST /identity/v3/users => generated 294 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:05:58.936337 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ce692-6150-4102-9d58-0269d2adff8b admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:58.947658 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ce692-6150-4102-9d58-0269d2adff8b admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:58.953171 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259605f-681e-4691-a961-97eb5eef4691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:58.954090 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259605f-681e-4691-a961-97eb5eef4691 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:58.954492 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259605f-681e-4691-a961-97eb5eef4691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:58.954794 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259605f-681e-4691-a961-97eb5eef4691 admin admin] PATH_INFO: `/v3/projects/53e110b294514eb68300b23acd85fc04/users/4015dc009ce74c8eb7bc6d6d6c7a0a7b/roles/681755518698445fabd9a8accec13c0f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:58.980877 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d259605f-681e-4691-a961-97eb5eef4691 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53e110b294514eb68300b23acd85fc04, user_id=4015dc009ce74c8eb7bc6d6d6c7a0a7b, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:58.985905 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d259605f-681e-4691-a961-97eb5eef4691 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:59.004912 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-eb595da3-05be-41f9-ba85-d467856cc428 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e2eae469ab3406c9346724af731833b', 'request_id': 'req-eb595da3-05be-41f9-ba85-d467856cc428'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:59.079402 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 968/1956] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:05:58 2022] PUT /identity/v3/projects/53e110b294514eb68300b23acd85fc04/users/4015dc009ce74c8eb7bc6d6d6c7a0a7b/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:59.080170 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259605f-681e-4691-a961-97eb5eef4691 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:59.104920 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-eb595da3-05be-41f9-ba85-d467856cc428 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e2eae469ab3406c9346724af731833b', 'request_id': 'req-eb595da3-05be-41f9-ba85-d467856cc428'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:59.119732 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-eb595da3-05be-41f9-ba85-d467856cc428 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e2eae469ab3406c9346724af731833b', 'request_id': 'req-eb595da3-05be-41f9-ba85-d467856cc428'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:59.138368 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-eb595da3-05be-41f9-ba85-d467856cc428 admin admin] The token cache is being invalidate because project 3e2eae469ab3406c9346724af731833b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:05:59.140433 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-eb595da3-05be-41f9-ba85-d467856cc428 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:59.140433 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-eb595da3-05be-41f9-ba85-d467856cc428 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:05:59.143192 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 989/1957] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:05:58 2022] DELETE /identity/v3/projects/3e2eae469ab3406c9346724af731833b => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:59.144124 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb595da3-05be-41f9-ba85-d467856cc428 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:59.146528 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-eb595da3-05be-41f9-ba85-d467856cc428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:59.243034 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259605f-681e-4691-a961-97eb5eef4691 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:59.247689 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb595da3-05be-41f9-ba85-d467856cc428 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:59.249325 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db1560-f367-452c-a700-421ee596e1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:59.250869 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db1560-f367-452c-a700-421ee596e1dd admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:59.251747 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db1560-f367-452c-a700-421ee596e1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:59.252373 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db1560-f367-452c-a700-421ee596e1dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:59.253926 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db1560-f367-452c-a700-421ee596e1dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:59.255118 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb65d3c-e9ab-4ad6-a650-442757e54a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:59.256186 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb65d3c-e9ab-4ad6-a650-442757e54a6a admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:59.256632 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb65d3c-e9ab-4ad6-a650-442757e54a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:59.257068 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb65d3c-e9ab-4ad6-a650-442757e54a6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:59.258329 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb65d3c-e9ab-4ad6-a650-442757e54a6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:59.260236 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb65d3c-e9ab-4ad6-a650-442757e54a6a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:59.262927 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db1560-f367-452c-a700-421ee596e1dd admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:59.274517 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 990/1958] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:05:59.275769 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb65d3c-e9ab-4ad6-a650-442757e54a6a admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:59.278903 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-acb65d3c-e9ab-4ad6-a650-442757e54a6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:59.298751 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb65d3c-e9ab-4ad6-a650-442757e54a6a admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:59.302056 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 969/1959] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:05:59.308090 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c59668-abee-46fc-9c12-88d098598af1 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:59.310518 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c59668-abee-46fc-9c12-88d098598af1 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:59.311353 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c59668-abee-46fc-9c12-88d098598af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:59.316135 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df31acf9-6373-44da-a529-ab44f93f5ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:59.318557 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31acf9-6373-44da-a529-ab44f93f5ecb admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:59.319067 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31acf9-6373-44da-a529-ab44f93f5ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:59.319769 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31acf9-6373-44da-a529-ab44f93f5ecb admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:59.321010 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df31acf9-6373-44da-a529-ab44f93f5ecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:59.327502 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df31acf9-6373-44da-a529-ab44f93f5ecb admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:59.349384 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-d9c59668-abee-46fc-9c12-88d098598af1 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:59.351783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-d9c59668-abee-46fc-9c12-88d098598af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:59.362741 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 991/1960] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:05:59.362741 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df31acf9-6373-44da-a529-ab44f93f5ecb admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:59.372027 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 970/1961] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:59.373105 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c59668-abee-46fc-9c12-88d098598af1 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:59.375430 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-d9c59668-abee-46fc-9c12-88d098598af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:59.381127 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df31acf9-6373-44da-a529-ab44f93f5ecb admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:59.390963 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c59668-abee-46fc-9c12-88d098598af1 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:59.391192 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d34c13-116f-4476-b41a-e3634dd136af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:59.392448 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d34c13-116f-4476-b41a-e3634dd136af admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:59.392930 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d34c13-116f-4476-b41a-e3634dd136af admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:59.393395 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d34c13-116f-4476-b41a-e3634dd136af admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:59.394683 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d34c13-116f-4476-b41a-e3634dd136af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:59.397991 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d34c13-116f-4476-b41a-e3634dd136af admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:59.398361 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e5864-e1e1-47f6-b4ff-26f208f3f926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:59.403035 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e5864-e1e1-47f6-b4ff-26f208f3f926 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:59.403035 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e5864-e1e1-47f6-b4ff-26f208f3f926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:59.403035 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e5864-e1e1-47f6-b4ff-26f208f3f926 admin admin] PATH_INFO: `/v3/projects/1bf904f683434235aa89ee86393d124d/users/18aeb3e057df4d3296259904786b422b/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:59.423787 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0e5864-e1e1-47f6-b4ff-26f208f3f926 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bf904f683434235aa89ee86393d124d, user_id=18aeb3e057df4d3296259904786b422b, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:59.426835 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0e5864-e1e1-47f6-b4ff-26f208f3f926 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:59.430455 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 992/1962] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:05:59.430455 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d34c13-116f-4476-b41a-e3634dd136af admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:59.450564 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d34c13-116f-4476-b41a-e3634dd136af admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:59.461948 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a429d3-1cc7-4c74-a7a3-28b025859b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:59.463678 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a429d3-1cc7-4c74-a7a3-28b025859b2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:59.464213 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a429d3-1cc7-4c74-a7a3-28b025859b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:59.464702 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a429d3-1cc7-4c74-a7a3-28b025859b2b admin admin] PATH_INFO: `/v3/projects/53e110b294514eb68300b23acd85fc04/users/4015dc009ce74c8eb7bc6d6d6c7a0a7b/roles/681755518698445fabd9a8accec13c0f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:59.468529 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a429d3-1cc7-4c74-a7a3-28b025859b2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=53e110b294514eb68300b23acd85fc04, user_id=4015dc009ce74c8eb7bc6d6d6c7a0a7b, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:59.473939 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a429d3-1cc7-4c74-a7a3-28b025859b2b admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:59.497386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 993/1963] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:05:59 2022] PUT /identity/v3/projects/53e110b294514eb68300b23acd85fc04/users/4015dc009ce74c8eb7bc6d6d6c7a0a7b/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:59.499131 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e4f2a-c02c-4b36-ae6e-77dc5d4ce743 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:59.499131 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e4f2a-c02c-4b36-ae6e-77dc5d4ce743 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:59.499131 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e4f2a-c02c-4b36-ae6e-77dc5d4ce743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:59.527830 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-5e0e4f2a-c02c-4b36-ae6e-77dc5d4ce743 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:59.529784 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-5e0e4f2a-c02c-4b36-ae6e-77dc5d4ce743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:59.551390 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 971/1964] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:05:59 2022] PUT /identity/v3/projects/1bf904f683434235aa89ee86393d124d/users/18aeb3e057df4d3296259904786b422b/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:59.551390 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e5864-e1e1-47f6-b4ff-26f208f3f926 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:59.676650 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 994/1965] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:59.676650 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a48768-1a0f-4d00-98d9-2eca6709b53b None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:59.676650 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a48768-1a0f-4d00-98d9-2eca6709b53b None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:59.676650 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a48768-1a0f-4d00-98d9-2eca6709b53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:59.703244 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e5864-e1e1-47f6-b4ff-26f208f3f926 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:05:59.709446 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-e3a48768-1a0f-4d00-98d9-2eca6709b53b None None] MFA Rules not processed for user `4015dc009ce74c8eb7bc6d6d6c7a0a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:59.709446 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e3a48768-1a0f-4d00-98d9-2eca6709b53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:59.709660 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282b4cf-009c-4e6a-bf49-03063e223d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:05:59.709834 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282b4cf-009c-4e6a-bf49-03063e223d7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:59.710326 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282b4cf-009c-4e6a-bf49-03063e223d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:59.710667 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282b4cf-009c-4e6a-bf49-03063e223d7d admin admin] PATH_INFO: `/v3/projects/fa76ae4b64de4604b08c4d0eecef9cbf/users/a6e10e4b7caf4251922469abac752490/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:59.732071 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9282b4cf-009c-4e6a-bf49-03063e223d7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa76ae4b64de4604b08c4d0eecef9cbf, user_id=a6e10e4b7caf4251922469abac752490, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:05:59.735135 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9282b4cf-009c-4e6a-bf49-03063e223d7d admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:05:59.801650 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 995/1966] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:59 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:59.801650 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f9439-2c5c-4885-a94a-edbc7ff5b9d5 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:05:59.801650 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f9439-2c5c-4885-a94a-edbc7ff5b9d5 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:05:59.801650 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f9439-2c5c-4885-a94a-edbc7ff5b9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:05:59.838243 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-6c2f9439-2c5c-4885-a94a-edbc7ff5b9d5 None None] MFA Rules not processed for user `18aeb3e057df4d3296259904786b422b`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:05:59.840120 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-6c2f9439-2c5c-4885-a94a-edbc7ff5b9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:59.938792 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 996/1967] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:05:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:05:59.940352 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f9439-2c5c-4885-a94a-edbc7ff5b9d5 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:59.954319 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 972/1968] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:05:59 2022] PUT /identity/v3/projects/fa76ae4b64de4604b08c4d0eecef9cbf/users/a6e10e4b7caf4251922469abac752490/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:05:59.955229 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282b4cf-009c-4e6a-bf49-03063e223d7d admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:05:59.972646 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-9282b4cf-009c-4e6a-bf49-03063e223d7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:05:59.972799 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f9439-2c5c-4885-a94a-edbc7ff5b9d5 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:00.033139 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee317e8-eb40-4bc6-b747-320845d605fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:00.034165 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee317e8-eb40-4bc6-b747-320845d605fb admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:00.034670 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee317e8-eb40-4bc6-b747-320845d605fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:00.035152 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee317e8-eb40-4bc6-b747-320845d605fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:00.036509 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee317e8-eb40-4bc6-b747-320845d605fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:06:00.037097 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee317e8-eb40-4bc6-b747-320845d605fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:00.040309 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee317e8-eb40-4bc6-b747-320845d605fb admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:00.049738 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282b4cf-009c-4e6a-bf49-03063e223d7d admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:00.054320 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b590e6c-a934-4564-846d-d4c9f4e8b51f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:00.061299 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b590e6c-a934-4564-846d-d4c9f4e8b51f service cinder] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:00.061299 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b590e6c-a934-4564-846d-d4c9f4e8b51f service cinder] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:00.061299 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b590e6c-a934-4564-846d-d4c9f4e8b51f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:00.071602 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 997/1969] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:06:00.071602 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee317e8-eb40-4bc6-b747-320845d605fb admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:00.095533 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee317e8-eb40-4bc6-b747-320845d605fb admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:00.129290 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24719538-3778-4b86-9b0d-55f72b3a919d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:00.130448 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24719538-3778-4b86-9b0d-55f72b3a919d admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:00.132181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24719538-3778-4b86-9b0d-55f72b3a919d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:00.132690 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24719538-3778-4b86-9b0d-55f72b3a919d admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:00.134053 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24719538-3778-4b86-9b0d-55f72b3a919d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:00.138772 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24719538-3778-4b86-9b0d-55f72b3a919d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:00.164386 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b590e6c-a934-4564-846d-d4c9f4e8b51f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:00.164386 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b590e6c-a934-4564-846d-d4c9f4e8b51f service cinder] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:00.179115 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 973/1970] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:05:59 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:06:00.180671 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbf26f-1427-406c-9bbc-0f6d5fceb9bc None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:00.181072 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbf26f-1427-406c-9bbc-0f6d5fceb9bc None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:00.181492 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbf26f-1427-406c-9bbc-0f6d5fceb9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:00.213354 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-cbbbf26f-1427-406c-9bbc-0f6d5fceb9bc None None] MFA Rules not processed for user `a6e10e4b7caf4251922469abac752490`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:00.214851 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-cbbbf26f-1427-406c-9bbc-0f6d5fceb9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:00.263902 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:00.300663 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 998/1971] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:06:00 2022] POST /identity/v3/projects => generated 381 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:06:00.301752 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24719538-3778-4b86-9b0d-55f72b3a919d admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:00.328235 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 974/1972] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:00.328235 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbbf26f-1427-406c-9bbc-0f6d5fceb9bc None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:00.352886 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbbf26f-1427-406c-9bbc-0f6d5fceb9bc None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:00.414017 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:00.453605 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24719538-3778-4b86-9b0d-55f72b3a919d admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:00.457296 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe2da2-0b13-4263-bf06-e3b0b6be0cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:00.458079 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe2da2-0b13-4263-bf06-e3b0b6be0cbc admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:00.458428 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe2da2-0b13-4263-bf06-e3b0b6be0cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:00.458519 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7bddf4-7d4c-4c65-9f97-2c498f34687f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:00.458771 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe2da2-0b13-4263-bf06-e3b0b6be0cbc admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:00.459127 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7bddf4-7d4c-4c65-9f97-2c498f34687f admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:00.459412 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7bddf4-7d4c-4c65-9f97-2c498f34687f admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:00.459536 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe2da2-0b13-4263-bf06-e3b0b6be0cbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:00.459723 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7bddf4-7d4c-4c65-9f97-2c498f34687f admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:00.460413 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7bddf4-7d4c-4c65-9f97-2c498f34687f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:00.461455 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe2da2-0b13-4263-bf06-e3b0b6be0cbc admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:00.462492 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7bddf4-7d4c-4c65-9f97-2c498f34687f admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:00.577584 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 999/1973] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:06:00 2022] POST /identity/v3/projects => generated 375 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:06:00.578462 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7bddf4-7d4c-4c65-9f97-2c498f34687f admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:00.585019 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 975/1974] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:06:00 2022] POST /identity/v3/users => generated 297 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:06:00.589221 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe2da2-0b13-4263-bf06-e3b0b6be0cbc admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:00.629029 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe2da2-0b13-4263-bf06-e3b0b6be0cbc admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:00.746974 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7bddf4-7d4c-4c65-9f97-2c498f34687f admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:00.762982 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f185307-c47b-4c67-b589-60053029aa3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:00.765553 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f185307-c47b-4c67-b589-60053029aa3d admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:00.765553 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f185307-c47b-4c67-b589-60053029aa3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:00.765553 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f185307-c47b-4c67-b589-60053029aa3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:00.766575 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f185307-c47b-4c67-b589-60053029aa3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:00.768980 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f185307-c47b-4c67-b589-60053029aa3d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:00.774597 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5445d0-50f8-4457-b99c-4a0242baa754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:00.775571 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5445d0-50f8-4457-b99c-4a0242baa754 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:00.775861 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5445d0-50f8-4457-b99c-4a0242baa754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:00.776136 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5445d0-50f8-4457-b99c-4a0242baa754 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:00.790978 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5445d0-50f8-4457-b99c-4a0242baa754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:00.793490 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5445d0-50f8-4457-b99c-4a0242baa754 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:00.825730 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 976/1975] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:06:00.825730 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5445d0-50f8-4457-b99c-4a0242baa754 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:00.844982 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5445d0-50f8-4457-b99c-4a0242baa754 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:00.853922 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c2631-c0fd-4ce2-8a82-0fd2c3d96cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:00.855320 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c2631-c0fd-4ce2-8a82-0fd2c3d96cc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:00.855671 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c2631-c0fd-4ce2-8a82-0fd2c3d96cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:00.855954 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c2631-c0fd-4ce2-8a82-0fd2c3d96cc6 admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:00.856678 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9c2631-c0fd-4ce2-8a82-0fd2c3d96cc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:00.858982 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9c2631-c0fd-4ce2-8a82-0fd2c3d96cc6 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:00.986705 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1000/1976] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:06:00 2022] POST /identity/v3/projects => generated 385 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:06:00.988415 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f185307-c47b-4c67-b589-60053029aa3d admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:01.073108 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 977/1977] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:06:00 2022] POST /identity/v3/users => generated 288 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:06:01.075835 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c2631-c0fd-4ce2-8a82-0fd2c3d96cc6 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:01.092083 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c2631-c0fd-4ce2-8a82-0fd2c3d96cc6 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:01.094131 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f185307-c47b-4c67-b589-60053029aa3d admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:01.101614 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ba1ea-56f6-4328-b2a8-9c286f56fb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:01.101976 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94186a-fc81-4f64-8da4-9d9142dad984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:01.102871 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94186a-fc81-4f64-8da4-9d9142dad984 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:01.103155 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ba1ea-56f6-4328-b2a8-9c286f56fb26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:01.103630 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94186a-fc81-4f64-8da4-9d9142dad984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:01.103838 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ba1ea-56f6-4328-b2a8-9c286f56fb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:01.104130 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94186a-fc81-4f64-8da4-9d9142dad984 admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:01.104288 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ba1ea-56f6-4328-b2a8-9c286f56fb26 admin admin] PATH_INFO: `/v3/projects/50b5d9e2d227453ba1f2c4cf6b8ab7d3/users/60a711f7b96444cc89d151eaf319da97/roles/681755518698445fabd9a8accec13c0f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:01.106242 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce94186a-fc81-4f64-8da4-9d9142dad984 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:01.109571 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce94186a-fc81-4f64-8da4-9d9142dad984 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:01.136431 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ba1ea-56f6-4328-b2a8-9c286f56fb26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50b5d9e2d227453ba1f2c4cf6b8ab7d3, user_id=60a711f7b96444cc89d151eaf319da97, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:01.140307 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ba1ea-56f6-4328-b2a8-9c286f56fb26 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:01.252353 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 978/1978] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:06:01 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:06:01.253683 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94186a-fc81-4f64-8da4-9d9142dad984 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:01.268859 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94186a-fc81-4f64-8da4-9d9142dad984 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:01.284082 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1001/1979] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:06:00 2022] PUT /identity/v3/projects/50b5d9e2d227453ba1f2c4cf6b8ab7d3/users/60a711f7b96444cc89d151eaf319da97/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:01.284082 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ba1ea-56f6-4328-b2a8-9c286f56fb26 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:01.375366 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ba1ea-56f6-4328-b2a8-9c286f56fb26 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:01.384006 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b8300-c665-4822-836c-ed96148477a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:01.385373 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b8300-c665-4822-836c-ed96148477a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:01.386379 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b8300-c665-4822-836c-ed96148477a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:01.386749 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b8300-c665-4822-836c-ed96148477a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:01.388654 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b8300-c665-4822-836c-ed96148477a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:01.391067 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b8300-c665-4822-836c-ed96148477a3 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:01.411960 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1002/1980] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:06:01.413037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b8300-c665-4822-836c-ed96148477a3 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:01.415638 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74253350-ea59-4b1f-a278-651ee42b4e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:01.416480 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74253350-ea59-4b1f-a278-651ee42b4e9d admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:01.417024 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74253350-ea59-4b1f-a278-651ee42b4e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:01.417320 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74253350-ea59-4b1f-a278-651ee42b4e9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:01.418173 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74253350-ea59-4b1f-a278-651ee42b4e9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:01.420127 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74253350-ea59-4b1f-a278-651ee42b4e9d admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:01.425116 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b8300-c665-4822-836c-ed96148477a3 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:01.430293 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0668cd7f-46b6-40e3-b9e0-bf643a7fb5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:01.431422 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668cd7f-46b6-40e3-b9e0-bf643a7fb5bb admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:01.436968 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668cd7f-46b6-40e3-b9e0-bf643a7fb5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:01.436968 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668cd7f-46b6-40e3-b9e0-bf643a7fb5bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:01.437303 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 979/1981] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:06:01.437469 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0668cd7f-46b6-40e3-b9e0-bf643a7fb5bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:01.437622 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74253350-ea59-4b1f-a278-651ee42b4e9d admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:01.437788 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0668cd7f-46b6-40e3-b9e0-bf643a7fb5bb admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:01.447399 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74253350-ea59-4b1f-a278-651ee42b4e9d admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:01.453276 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1003/1982] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:06:01.453857 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0668cd7f-46b6-40e3-b9e0-bf643a7fb5bb admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:01.457699 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20af90-8b33-42de-903b-7ebf34453ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:01.458407 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20af90-8b33-42de-903b-7ebf34453ddb admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:01.458695 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20af90-8b33-42de-903b-7ebf34453ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:01.458977 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20af90-8b33-42de-903b-7ebf34453ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:01.459888 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20af90-8b33-42de-903b-7ebf34453ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:01.462069 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20af90-8b33-42de-903b-7ebf34453ddb admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:01.468111 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0668cd7f-46b6-40e3-b9e0-bf643a7fb5bb admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:01.478429 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 980/1983] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:06:01.478848 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa20553-0126-4ae1-9410-d21f9932ca91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:01.479325 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20af90-8b33-42de-903b-7ebf34453ddb admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:01.489499 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa20553-0126-4ae1-9410-d21f9932ca91 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:01.489848 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa20553-0126-4ae1-9410-d21f9932ca91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:01.490138 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa20553-0126-4ae1-9410-d21f9932ca91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:01.492149 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa20553-0126-4ae1-9410-d21f9932ca91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:01.493261 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20af90-8b33-42de-903b-7ebf34453ddb admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:01.494479 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa20553-0126-4ae1-9410-d21f9932ca91 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:01.499056 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e351260-47de-47b3-bd73-b966fd2a2ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:01.502474 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e351260-47de-47b3-bd73-b966fd2a2ede admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:01.502474 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e351260-47de-47b3-bd73-b966fd2a2ede admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:01.502474 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e351260-47de-47b3-bd73-b966fd2a2ede admin admin] PATH_INFO: `/v3/projects/50b5d9e2d227453ba1f2c4cf6b8ab7d3/users/60a711f7b96444cc89d151eaf319da97/roles/681755518698445fabd9a8accec13c0f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:01.506296 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e351260-47de-47b3-bd73-b966fd2a2ede admin admin] RBAC: Authorizing `identity:create_grant(project_id=50b5d9e2d227453ba1f2c4cf6b8ab7d3, user_id=60a711f7b96444cc89d151eaf319da97, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:01.509631 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e351260-47de-47b3-bd73-b966fd2a2ede admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:01.531215 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 981/1984] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:06:01 2022] PUT /identity/v3/projects/50b5d9e2d227453ba1f2c4cf6b8ab7d3/users/60a711f7b96444cc89d151eaf319da97/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:01.532570 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e351260-47de-47b3-bd73-b966fd2a2ede admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:01.562459 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1004/1985] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:06:01.562459 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83843d73-3508-49b1-bd56-7d1d1289a6ec None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:01.562459 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83843d73-3508-49b1-bd56-7d1d1289a6ec None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:01.562459 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83843d73-3508-49b1-bd56-7d1d1289a6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:01.608874 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-83843d73-3508-49b1-bd56-7d1d1289a6ec None None] MFA Rules not processed for user `60a711f7b96444cc89d151eaf319da97`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:01.614162 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-83843d73-3508-49b1-bd56-7d1d1289a6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:01.698573 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e351260-47de-47b3-bd73-b966fd2a2ede admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:01.712026 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc2fa6-df70-40c8-865e-3e325615d128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:01.717710 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc2fa6-df70-40c8-865e-3e325615d128 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:01.718380 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc2fa6-df70-40c8-865e-3e325615d128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:01.721024 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc2fa6-df70-40c8-865e-3e325615d128 admin admin] PATH_INFO: `/v3/projects/1b8758048cd247ad9850217fb1463a23/users/3d1490c107ad47a0befce2db7e61c64b/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:01.743036 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dc2fa6-df70-40c8-865e-3e325615d128 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b8758048cd247ad9850217fb1463a23, user_id=3d1490c107ad47a0befce2db7e61c64b, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:01.746581 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1005/1986] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:01.747533 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83843d73-3508-49b1-bd56-7d1d1289a6ec None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:01.747890 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dc2fa6-df70-40c8-865e-3e325615d128 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:01.760479 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83843d73-3508-49b1-bd56-7d1d1289a6ec None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:01.780250 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d653f3f5-28bb-4dcf-ae55-99da18577c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:01.780250 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653f3f5-28bb-4dcf-ae55-99da18577c35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:01.780250 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653f3f5-28bb-4dcf-ae55-99da18577c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:01.780250 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653f3f5-28bb-4dcf-ae55-99da18577c35 admin admin] PATH_INFO: `/v3/projects/0fa6595880a1408eaa69624e6b7dd04c/users/d7f6cc904a504e6f8abbd880c9f044d0/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:01.805118 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d653f3f5-28bb-4dcf-ae55-99da18577c35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fa6595880a1408eaa69624e6b7dd04c, user_id=d7f6cc904a504e6f8abbd880c9f044d0, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:01.812005 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d653f3f5-28bb-4dcf-ae55-99da18577c35 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:01.943965 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 982/1987] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:06:01 2022] PUT /identity/v3/projects/1b8758048cd247ad9850217fb1463a23/users/3d1490c107ad47a0befce2db7e61c64b/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:01.943965 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc2fa6-df70-40c8-865e-3e325615d128 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:01.954343 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-38dc2fa6-df70-40c8-865e-3e325615d128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:01.958029 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1006/1988] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:06:01 2022] PUT /identity/v3/projects/0fa6595880a1408eaa69624e6b7dd04c/users/d7f6cc904a504e6f8abbd880c9f044d0/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:01.959556 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e875c-81cf-4174-b1a9-44f783aa6cd4 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:01.960033 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e875c-81cf-4174-b1a9-44f783aa6cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:01.960557 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e875c-81cf-4174-b1a9-44f783aa6cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:02.018830 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-eb0e875c-81cf-4174-b1a9-44f783aa6cd4 None None] MFA Rules not processed for user `3d1490c107ad47a0befce2db7e61c64b`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:02.018830 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-eb0e875c-81cf-4174-b1a9-44f783aa6cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:02.077139 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:02.083953 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc2fa6-df70-40c8-865e-3e325615d128 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:02.156618 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15c98b-7fa9-4f96-902a-894a1cee9ae8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:02.157472 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15c98b-7fa9-4f96-902a-894a1cee9ae8 service cinder] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:02.157756 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15c98b-7fa9-4f96-902a-894a1cee9ae8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:02.158155 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15c98b-7fa9-4f96-902a-894a1cee9ae8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:02.180393 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1007/1989] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:02.187183 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ed8fb-97e9-4beb-8b20-ed975b1dc716 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:02.187548 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ed8fb-97e9-4beb-8b20-ed975b1dc716 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:02.187897 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ed8fb-97e9-4beb-8b20-ed975b1dc716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:02.233683 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-792ed8fb-97e9-4beb-8b20-ed975b1dc716 None None] MFA Rules not processed for user `d7f6cc904a504e6f8abbd880c9f044d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:02.235296 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-792ed8fb-97e9-4beb-8b20-ed975b1dc716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:02.322407 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15c98b-7fa9-4f96-902a-894a1cee9ae8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:02.324177 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15c98b-7fa9-4f96-902a-894a1cee9ae8 service cinder] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:02.354451 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 983/1990] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:06:01 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:06:02.354451 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15c98b-7fa9-4f96-902a-894a1cee9ae8 service cinder] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:02.378609 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1008/1991] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:02.388479 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225a989-654c-4933-9957-08b4ca0ac0b7 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:02.388864 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225a989-654c-4933-9957-08b4ca0ac0b7 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:02.389368 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225a989-654c-4933-9957-08b4ca0ac0b7 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:02.392162 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1009/1992] 10.222.0.46 () {54 vars in 921 bytes} [Fri Jul 1 04:06:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 04:06:02.394087 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225a989-654c-4933-9957-08b4ca0ac0b7 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:02.498699 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15c98b-7fa9-4f96-902a-894a1cee9ae8 service cinder] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:02.514708 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadabefd-b803-4442-a918-adb5ecac19f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:02.515780 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadabefd-b803-4442-a918-adb5ecac19f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:02.516382 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadabefd-b803-4442-a918-adb5ecac19f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:02.516932 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadabefd-b803-4442-a918-adb5ecac19f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:02.518249 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadabefd-b803-4442-a918-adb5ecac19f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:02.525548 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadabefd-b803-4442-a918-adb5ecac19f6 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:02.539333 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225a989-654c-4933-9957-08b4ca0ac0b7 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:02.546235 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e19a49-979d-4deb-b95e-67e657e4602e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:02.547670 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e19a49-979d-4deb-b95e-67e657e4602e admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:02.548191 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e19a49-979d-4deb-b95e-67e657e4602e admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:02.548852 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e19a49-979d-4deb-b95e-67e657e4602e admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:02.550107 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e19a49-979d-4deb-b95e-67e657e4602e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:02.553845 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e19a49-979d-4deb-b95e-67e657e4602e admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:02.669645 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 984/1993] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:06:02 2022] POST /identity/v3/projects => generated 387 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:06:02.671764 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b69992-acf0-47c8-a708-ba2199a72c78 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:02.672204 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b69992-acf0-47c8-a708-ba2199a72c78 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:02.672627 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b69992-acf0-47c8-a708-ba2199a72c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:02.706155 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-86b69992-acf0-47c8-a708-ba2199a72c78 None None] MFA Rules not processed for user `4efe4a6dd11047688892641a936e2914`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:02.708301 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-86b69992-acf0-47c8-a708-ba2199a72c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:02.730451 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1010/1994] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:06:02 2022] POST /identity/v3/projects => generated 375 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:06:02.734088 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e19a49-979d-4deb-b95e-67e657e4602e admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:02.736885 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c7e19a49-979d-4deb-b95e-67e657e4602e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:02.908496 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:02.958258 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e19a49-979d-4deb-b95e-67e657e4602e admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:02.962312 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 985/1995] 10.222.0.46 () {58 vars in 1018 bytes} [Fri Jul 1 04:06:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:02.963345 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b69992-acf0-47c8-a708-ba2199a72c78 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:02.968865 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c975894-a2af-4570-9b83-3dd75658431d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:02.970313 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c975894-a2af-4570-9b83-3dd75658431d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:02.970785 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c975894-a2af-4570-9b83-3dd75658431d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:02.971233 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c975894-a2af-4570-9b83-3dd75658431d admin admin] PATH_INFO: `/v3/users/28988559f6b1460f8f7dac1069c33456` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:02.977248 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c975894-a2af-4570-9b83-3dd75658431d admin admin] RBAC: Authorizing `identity:delete_user(user_id=28988559f6b1460f8f7dac1069c33456)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:02.978171 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c975894-a2af-4570-9b83-3dd75658431d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:03.066063 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b69992-acf0-47c8-a708-ba2199a72c78 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:03.072730 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3487a73f-efcd-48aa-95cc-1e9b3511d546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:03.074444 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487a73f-efcd-48aa-95cc-1e9b3511d546 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:03.074984 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487a73f-efcd-48aa-95cc-1e9b3511d546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:03.075573 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487a73f-efcd-48aa-95cc-1e9b3511d546 admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:03.081277 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3487a73f-efcd-48aa-95cc-1e9b3511d546 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:03.081277 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3487a73f-efcd-48aa-95cc-1e9b3511d546 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:03.187344 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 986/1996] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:06:02 2022] POST /identity/v3/users => generated 300 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:06:03.187344 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3487a73f-efcd-48aa-95cc-1e9b3511d546 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:03.197854 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3487a73f-efcd-48aa-95cc-1e9b3511d546 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:03.204362 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5b7c1-0a80-4ec8-a7f1-2e48bda00739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:03.205397 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5b7c1-0a80-4ec8-a7f1-2e48bda00739 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:03.205992 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5b7c1-0a80-4ec8-a7f1-2e48bda00739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:03.206357 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5b7c1-0a80-4ec8-a7f1-2e48bda00739 admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:03.207163 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5b7c1-0a80-4ec8-a7f1-2e48bda00739 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:03.209357 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5b7c1-0a80-4ec8-a7f1-2e48bda00739 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:03.296536 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5c975894-a2af-4570-9b83-3dd75658431d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28988559f6b1460f8f7dac1069c33456'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:03.297229 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5c975894-a2af-4570-9b83-3dd75658431d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28988559f6b1460f8f7dac1069c33456'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:03.310722 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5c975894-a2af-4570-9b83-3dd75658431d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28988559f6b1460f8f7dac1069c33456'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:03.323351 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5c975894-a2af-4570-9b83-3dd75658431d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28988559f6b1460f8f7dac1069c33456'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:03.324165 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5c975894-a2af-4570-9b83-3dd75658431d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28988559f6b1460f8f7dac1069c33456'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:03.348111 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 987/1997] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:06:03 2022] POST /identity/v3/users => generated 288 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:06:03.348965 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5b7c1-0a80-4ec8-a7f1-2e48bda00739 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:03.350684 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-08c5b7c1-0a80-4ec8-a7f1-2e48bda00739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:03.415858 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5b7c1-0a80-4ec8-a7f1-2e48bda00739 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:03.422942 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226e103-1af0-4e88-92df-056c5998c6b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:03.422942 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226e103-1af0-4e88-92df-056c5998c6b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:03.422942 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226e103-1af0-4e88-92df-056c5998c6b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:03.422942 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226e103-1af0-4e88-92df-056c5998c6b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:03.430866 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-0226e103-1af0-4e88-92df-056c5998c6b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:03.470148 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1011/1998] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:06:02 2022] DELETE /identity/v3/users/28988559f6b1460f8f7dac1069c33456 => generated 0 bytes in 739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:03.472112 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c975894-a2af-4570-9b83-3dd75658431d admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:03.475107 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-5c975894-a2af-4570-9b83-3dd75658431d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:03.501706 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0226e103-1af0-4e88-92df-056c5998c6b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:03.504030 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0226e103-1af0-4e88-92df-056c5998c6b6 service cinder] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:03.517150 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 988/1999] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:06:03 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:06:03.518498 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226e103-1af0-4e88-92df-056c5998c6b6 service cinder] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:03.525246 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-0226e103-1af0-4e88-92df-056c5998c6b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:03.596669 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226e103-1af0-4e88-92df-056c5998c6b6 service cinder] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:03.641454 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c975894-a2af-4570-9b83-3dd75658431d admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:03.654342 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1666d1c2-baab-4505-b82a-fa466ccffed5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efe4a6dd11047688892641a936e2914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:03.656347 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666d1c2-baab-4505-b82a-fa466ccffed5 service placement] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:03.657216 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666d1c2-baab-4505-b82a-fa466ccffed5 service placement] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:03.657964 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666d1c2-baab-4505-b82a-fa466ccffed5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:03.661703 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1666d1c2-baab-4505-b82a-fa466ccffed5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:03.686607 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1666d1c2-baab-4505-b82a-fa466ccffed5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:03.690218 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1666d1c2-baab-4505-b82a-fa466ccffed5 service placement] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:03.694630 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361c782-98e9-4b0a-bcd3-4f2d6d3c4d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:03.694815 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361c782-98e9-4b0a-bcd3-4f2d6d3c4d3b admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:03.695094 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361c782-98e9-4b0a-bcd3-4f2d6d3c4d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:03.695370 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361c782-98e9-4b0a-bcd3-4f2d6d3c4d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:03.696349 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9361c782-98e9-4b0a-bcd3-4f2d6d3c4d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:03.698549 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9361c782-98e9-4b0a-bcd3-4f2d6d3c4d3b admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:03.710767 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 989/2000] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:06:03.711521 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361c782-98e9-4b0a-bcd3-4f2d6d3c4d3b admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:03.713564 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-9361c782-98e9-4b0a-bcd3-4f2d6d3c4d3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:03.717666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1012/2001] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:06:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:06:03.719140 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1666d1c2-baab-4505-b82a-fa466ccffed5 service placement] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:03.729222 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361c782-98e9-4b0a-bcd3-4f2d6d3c4d3b admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:03.737070 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24532ef5-5cb6-40ee-9307-b033cd757164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:03.737767 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24532ef5-5cb6-40ee-9307-b033cd757164 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:03.738053 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24532ef5-5cb6-40ee-9307-b033cd757164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:03.738199 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1666d1c2-baab-4505-b82a-fa466ccffed5 service placement] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:03.738324 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24532ef5-5cb6-40ee-9307-b033cd757164 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:03.739353 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24532ef5-5cb6-40ee-9307-b033cd757164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:03.741497 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24532ef5-5cb6-40ee-9307-b033cd757164 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:03.746375 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb72ac-2760-4592-b4dc-7b4396fbb040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:03.748685 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb72ac-2760-4592-b4dc-7b4396fbb040 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:03.749176 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb72ac-2760-4592-b4dc-7b4396fbb040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:03.749649 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb72ac-2760-4592-b4dc-7b4396fbb040 admin admin] PATH_INFO: `/v3/projects/f768b8c0ce8246e7913c5d50452d97f9/users/1e4ebd5d64c546c0989d859e98f9fb2b/roles/681755518698445fabd9a8accec13c0f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:03.756491 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 990/2002] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:06:03.761766 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24532ef5-5cb6-40ee-9307-b033cd757164 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:03.781170 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:03.784485 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24532ef5-5cb6-40ee-9307-b033cd757164 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:03.792945 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb72ac-2760-4592-b4dc-7b4396fbb040 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f768b8c0ce8246e7913c5d50452d97f9, user_id=1e4ebd5d64c546c0989d859e98f9fb2b, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:03.799023 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c6715-084c-48ec-a3b1-e5768c86a24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:03.799784 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c6715-084c-48ec-a3b1-e5768c86a24b admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:03.800267 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c6715-084c-48ec-a3b1-e5768c86a24b admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:03.800389 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb72ac-2760-4592-b4dc-7b4396fbb040 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:03.800481 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c6715-084c-48ec-a3b1-e5768c86a24b admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:03.802897 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316c6715-084c-48ec-a3b1-e5768c86a24b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:03.807501 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316c6715-084c-48ec-a3b1-e5768c86a24b admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:03.834280 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 991/2003] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:06:03.840231 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c6715-084c-48ec-a3b1-e5768c86a24b admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:03.857152 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c6715-084c-48ec-a3b1-e5768c86a24b admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:03.863205 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b6ed4-7b28-4e00-89a2-f5d698b19004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:03.864178 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b6ed4-7b28-4e00-89a2-f5d698b19004 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:03.871978 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b6ed4-7b28-4e00-89a2-f5d698b19004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:03.871978 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b6ed4-7b28-4e00-89a2-f5d698b19004 admin admin] PATH_INFO: `/v3/projects/d2e4a5d00ddc4037a5cb0c65dafa4efe/users/bb2d731613424c818836fd97600d0365/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:03.886374 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b6ed4-7b28-4e00-89a2-f5d698b19004 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2e4a5d00ddc4037a5cb0c65dafa4efe, user_id=bb2d731613424c818836fd97600d0365, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:03.889108 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b6ed4-7b28-4e00-89a2-f5d698b19004 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:03.913782 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:03.996984 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1013/2004] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:06:03 2022] PUT /identity/v3/projects/f768b8c0ce8246e7913c5d50452d97f9/users/1e4ebd5d64c546c0989d859e98f9fb2b/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:03.997868 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb72ac-2760-4592-b4dc-7b4396fbb040 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:04.000737 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-edfb72ac-2760-4592-b4dc-7b4396fbb040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:04.045354 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 992/2005] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:06:03 2022] PUT /identity/v3/projects/d2e4a5d00ddc4037a5cb0c65dafa4efe/users/bb2d731613424c818836fd97600d0365/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:06:04.047971 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b6ed4-7b28-4e00-89a2-f5d698b19004 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:04.090887 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb72ac-2760-4592-b4dc-7b4396fbb040 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:04.136448 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b6ed4-7b28-4e00-89a2-f5d698b19004 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:04.141270 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789852a-f465-46d4-88d9-87ac36dd78a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:04.141957 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789852a-f465-46d4-88d9-87ac36dd78a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:04.142251 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789852a-f465-46d4-88d9-87ac36dd78a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:04.142689 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789852a-f465-46d4-88d9-87ac36dd78a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:04.143432 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789852a-f465-46d4-88d9-87ac36dd78a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:04.145114 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789852a-f465-46d4-88d9-87ac36dd78a3 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:04.156942 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 993/2006] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:06:04.158371 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff59e4-1e21-484b-a571-0fab0ea88d2b None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:04.158683 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff59e4-1e21-484b-a571-0fab0ea88d2b None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:04.158944 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff59e4-1e21-484b-a571-0fab0ea88d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:04.168443 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42509b9f-fbdd-4161-bdc6-c41da1df3de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:04.169824 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42509b9f-fbdd-4161-bdc6-c41da1df3de9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:04.170267 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42509b9f-fbdd-4161-bdc6-c41da1df3de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:04.170700 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42509b9f-fbdd-4161-bdc6-c41da1df3de9 admin admin] PATH_INFO: `/v3/projects/0e009f12cf8e48148dd3b57b9acccb02` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:04.172261 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42509b9f-fbdd-4161-bdc6-c41da1df3de9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e009f12cf8e48148dd3b57b9acccb02)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:04.174249 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42509b9f-fbdd-4161-bdc6-c41da1df3de9 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:04.197596 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-dfff59e4-1e21-484b-a571-0fab0ea88d2b None None] MFA Rules not processed for user `bb2d731613424c818836fd97600d0365`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:04.200647 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-dfff59e4-1e21-484b-a571-0fab0ea88d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:04.284754 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 994/2007] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:04.284754 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff59e4-1e21-484b-a571-0fab0ea88d2b None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:04.295156 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff59e4-1e21-484b-a571-0fab0ea88d2b None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:04.303931 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b99b60-3425-4c0c-a97b-0f77bee730e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:04.306098 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b99b60-3425-4c0c-a97b-0f77bee730e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:04.306181 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b99b60-3425-4c0c-a97b-0f77bee730e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:04.306460 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b99b60-3425-4c0c-a97b-0f77bee730e1 admin admin] PATH_INFO: `/v3/projects/f768b8c0ce8246e7913c5d50452d97f9/users/1e4ebd5d64c546c0989d859e98f9fb2b/roles/681755518698445fabd9a8accec13c0f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:04.309729 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b99b60-3425-4c0c-a97b-0f77bee730e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f768b8c0ce8246e7913c5d50452d97f9, user_id=1e4ebd5d64c546c0989d859e98f9fb2b, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:04.312628 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b99b60-3425-4c0c-a97b-0f77bee730e1 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:04.324733 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 995/2008] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:06:04 2022] PUT /identity/v3/projects/f768b8c0ce8246e7913c5d50452d97f9/users/1e4ebd5d64c546c0989d859e98f9fb2b/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:04.325652 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b99b60-3425-4c0c-a97b-0f77bee730e1 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:04.335686 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-42509b9f-fbdd-4161-bdc6-c41da1df3de9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e009f12cf8e48148dd3b57b9acccb02', 'request_id': 'req-42509b9f-fbdd-4161-bdc6-c41da1df3de9'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:04.412053 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b99b60-3425-4c0c-a97b-0f77bee730e1 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:04.417703 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1856d-e1cd-4419-993d-c27d95d6bb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:04.418566 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1856d-e1cd-4419-993d-c27d95d6bb93 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:04.420750 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1856d-e1cd-4419-993d-c27d95d6bb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:04.420750 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1856d-e1cd-4419-993d-c27d95d6bb93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:04.420750 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b1856d-e1cd-4419-993d-c27d95d6bb93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:04.421814 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b1856d-e1cd-4419-993d-c27d95d6bb93 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:04.450459 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-42509b9f-fbdd-4161-bdc6-c41da1df3de9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e009f12cf8e48148dd3b57b9acccb02', 'request_id': 'req-42509b9f-fbdd-4161-bdc6-c41da1df3de9'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:04.456620 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-42509b9f-fbdd-4161-bdc6-c41da1df3de9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e009f12cf8e48148dd3b57b9acccb02', 'request_id': 'req-42509b9f-fbdd-4161-bdc6-c41da1df3de9'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:04.468826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-42509b9f-fbdd-4161-bdc6-c41da1df3de9 admin admin] The token cache is being invalidate because project 0e009f12cf8e48148dd3b57b9acccb02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:06:04.469113 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-42509b9f-fbdd-4161-bdc6-c41da1df3de9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:04.469767 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-42509b9f-fbdd-4161-bdc6-c41da1df3de9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:04.471335 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1014/2009] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:06:03 2022] DELETE /identity/v3/projects/0e009f12cf8e48148dd3b57b9acccb02 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:04.473044 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84ab5e-f44e-4c7e-8234-df26fc952a90 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:04.473327 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84ab5e-f44e-4c7e-8234-df26fc952a90 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:04.473602 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84ab5e-f44e-4c7e-8234-df26fc952a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:04.503104 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-8a84ab5e-f44e-4c7e-8234-df26fc952a90 None None] MFA Rules not processed for user `1e4ebd5d64c546c0989d859e98f9fb2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:04.504376 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8a84ab5e-f44e-4c7e-8234-df26fc952a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:04.535496 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 996/2010] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:06:04 2022] POST /identity/v3/projects => generated 377 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:06:04.538128 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d5861-1c51-43fd-a2dd-b33194173a8c None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:04.539002 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d5861-1c51-43fd-a2dd-b33194173a8c None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:04.539286 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d5861-1c51-43fd-a2dd-b33194173a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:04.567680 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-462d5861-1c51-43fd-a2dd-b33194173a8c None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:04.569688 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-462d5861-1c51-43fd-a2dd-b33194173a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:04.605173 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1015/2011] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:04 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:04.608521 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84ab5e-f44e-4c7e-8234-df26fc952a90 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:04.608521 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8a84ab5e-f44e-4c7e-8234-df26fc952a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:04.628486 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84ab5e-f44e-4c7e-8234-df26fc952a90 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:04.646371 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 997/2012] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:04.654891 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d5861-1c51-43fd-a2dd-b33194173a8c None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:04.656333 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-462d5861-1c51-43fd-a2dd-b33194173a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:04.668621 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d5861-1c51-43fd-a2dd-b33194173a8c None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:04.673601 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8d82a-0030-47c4-b149-369b77b959ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:04.676332 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8d82a-0030-47c4-b149-369b77b959ba admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:04.676332 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8d82a-0030-47c4-b149-369b77b959ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:04.676332 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8d82a-0030-47c4-b149-369b77b959ba admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:04.676332 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb8d82a-0030-47c4-b149-369b77b959ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:04.677451 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb8d82a-0030-47c4-b149-369b77b959ba admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:04.695157 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b4788-0347-4dab-be7c-c6a769a7bd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:04.696076 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b4788-0347-4dab-be7c-c6a769a7bd9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:04.696355 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b4788-0347-4dab-be7c-c6a769a7bd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:04.696630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b4788-0347-4dab-be7c-c6a769a7bd9b admin admin] PATH_INFO: `/v3/users/fd6631020d97498097db83c542447db5` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:04.697842 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b4788-0347-4dab-be7c-c6a769a7bd9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd6631020d97498097db83c542447db5)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:04.699923 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b4788-0347-4dab-be7c-c6a769a7bd9b admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:04.798949 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 998/2013] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:06:04 2022] POST /identity/v3/users => generated 295 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:06:04.798949 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8d82a-0030-47c4-b149-369b77b959ba admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:04.802067 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-4eb8d82a-0030-47c4-b149-369b77b959ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:04.875528 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8d82a-0030-47c4-b149-369b77b959ba admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:04.879368 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb64cdb-11a0-4629-8837-35015d728fba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:04.879962 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb64cdb-11a0-4629-8837-35015d728fba service cinder] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:04.880350 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb64cdb-11a0-4629-8837-35015d728fba service cinder] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:04.880581 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb64cdb-11a0-4629-8837-35015d728fba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:04.962980 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb64cdb-11a0-4629-8837-35015d728fba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:04.965952 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb64cdb-11a0-4629-8837-35015d728fba service cinder] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:04.978336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 999/2014] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:06:04 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:06:04.980287 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4e47d-3062-463c-96c6-7c63da9bc129 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:04.983663 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4e47d-3062-463c-96c6-7c63da9bc129 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:04.983663 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4e47d-3062-463c-96c6-7c63da9bc129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:05.012609 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-9ce4e47d-3062-463c-96c6-7c63da9bc129 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:05.015212 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-9ce4e47d-3062-463c-96c6-7c63da9bc129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:05.033663 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1000/2015] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:05.035655 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4e47d-3062-463c-96c6-7c63da9bc129 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:05.060392 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4e47d-3062-463c-96c6-7c63da9bc129 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:05.068034 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f24b4788-0347-4dab-be7c-c6a769a7bd9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd6631020d97498097db83c542447db5'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:05.068894 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f24b4788-0347-4dab-be7c-c6a769a7bd9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd6631020d97498097db83c542447db5'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:05.069892 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37c747-bc4f-4bb9-81a2-5e89c6dd094e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:05.072119 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37c747-bc4f-4bb9-81a2-5e89c6dd094e admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:05.072592 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37c747-bc4f-4bb9-81a2-5e89c6dd094e admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:05.073086 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37c747-bc4f-4bb9-81a2-5e89c6dd094e admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:05.074914 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37c747-bc4f-4bb9-81a2-5e89c6dd094e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:05.078955 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37c747-bc4f-4bb9-81a2-5e89c6dd094e admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:05.086703 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f24b4788-0347-4dab-be7c-c6a769a7bd9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd6631020d97498097db83c542447db5'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:05.098722 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f24b4788-0347-4dab-be7c-c6a769a7bd9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd6631020d97498097db83c542447db5'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:05.098722 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f24b4788-0347-4dab-be7c-c6a769a7bd9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd6631020d97498097db83c542447db5'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:05.107495 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1001/2016] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:06:05.107495 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37c747-bc4f-4bb9-81a2-5e89c6dd094e admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:05.108125 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-ff37c747-bc4f-4bb9-81a2-5e89c6dd094e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:05.121949 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37c747-bc4f-4bb9-81a2-5e89c6dd094e admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:05.127039 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e72bb-388d-424c-b07d-816c477134b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:05.131765 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e72bb-388d-424c-b07d-816c477134b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:05.131765 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e72bb-388d-424c-b07d-816c477134b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:05.131765 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e72bb-388d-424c-b07d-816c477134b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:05.131765 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618e72bb-388d-424c-b07d-816c477134b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:06:05.131765 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618e72bb-388d-424c-b07d-816c477134b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:05.131765 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618e72bb-388d-424c-b07d-816c477134b8 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:05.158596 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1002/2017] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:06:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:06:05.160027 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e72bb-388d-424c-b07d-816c477134b8 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:05.162690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-618e72bb-388d-424c-b07d-816c477134b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:05.183749 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e72bb-388d-424c-b07d-816c477134b8 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:05.197454 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4fea7-ef0e-4c94-bf9d-cc7082959dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:05.199588 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4fea7-ef0e-4c94-bf9d-cc7082959dce admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:05.200276 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4fea7-ef0e-4c94-bf9d-cc7082959dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:05.202793 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4fea7-ef0e-4c94-bf9d-cc7082959dce admin admin] PATH_INFO: `/v3/projects/358293a86b4941039d23c3987ddea75f/users/e56169a18f854eabad63978418088854/roles/681755518698445fabd9a8accec13c0f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:05.202996 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1016/2018] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:06:04 2022] DELETE /identity/v3/users/fd6631020d97498097db83c542447db5 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:05.203322 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b4788-0347-4dab-be7c-c6a769a7bd9b admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:05.225314 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4fea7-ef0e-4c94-bf9d-cc7082959dce admin admin] RBAC: Authorizing `identity:create_grant(project_id=358293a86b4941039d23c3987ddea75f, user_id=e56169a18f854eabad63978418088854, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:05.228392 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4fea7-ef0e-4c94-bf9d-cc7082959dce admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:05.304755 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b4788-0347-4dab-be7c-c6a769a7bd9b admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:05.310103 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b077b92-56a1-4ab6-93ed-a0cf6874d413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:05.313064 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b077b92-56a1-4ab6-93ed-a0cf6874d413 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:05.313064 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b077b92-56a1-4ab6-93ed-a0cf6874d413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:05.313064 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b077b92-56a1-4ab6-93ed-a0cf6874d413 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:05.313064 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b077b92-56a1-4ab6-93ed-a0cf6874d413 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:05.314059 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b077b92-56a1-4ab6-93ed-a0cf6874d413 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:05.347975 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1003/2019] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:06:05 2022] PUT /identity/v3/projects/358293a86b4941039d23c3987ddea75f/users/e56169a18f854eabad63978418088854/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:05.349590 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4fea7-ef0e-4c94-bf9d-cc7082959dce admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:05.352297 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-eed4fea7-ef0e-4c94-bf9d-cc7082959dce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:05.439679 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4fea7-ef0e-4c94-bf9d-cc7082959dce admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:05.445074 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462f9cf-10fe-4d3f-926a-60c04bf8bc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:05.446020 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462f9cf-10fe-4d3f-926a-60c04bf8bc05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:05.446385 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1017/2020] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:06:05 2022] POST /identity/v3/projects => generated 385 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:06:05.446551 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462f9cf-10fe-4d3f-926a-60c04bf8bc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:05.446775 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462f9cf-10fe-4d3f-926a-60c04bf8bc05 admin admin] PATH_INFO: `/v3/users/6a6124937aac421a91a4766c38643960` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:05.453058 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e6cc0-6ba2-45a4-ba57-f046f336f678 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:05.453058 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e6cc0-6ba2-45a4-ba57-f046f336f678 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:05.453058 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e6cc0-6ba2-45a4-ba57-f046f336f678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:05.456620 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462f9cf-10fe-4d3f-926a-60c04bf8bc05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a6124937aac421a91a4766c38643960)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:05.460649 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462f9cf-10fe-4d3f-926a-60c04bf8bc05 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:05.497034 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-404e6cc0-6ba2-45a4-ba57-f046f336f678 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:05.498775 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-404e6cc0-6ba2-45a4-ba57-f046f336f678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:05.569546 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1018/2021] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:05.570566 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e6cc0-6ba2-45a4-ba57-f046f336f678 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:05.587563 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e6cc0-6ba2-45a4-ba57-f046f336f678 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:05.595777 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466f348-b206-481e-aaac-a32f68bc5c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:05.596909 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466f348-b206-481e-aaac-a32f68bc5c0a admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:05.597301 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466f348-b206-481e-aaac-a32f68bc5c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:05.597739 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466f348-b206-481e-aaac-a32f68bc5c0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:05.598631 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4466f348-b206-481e-aaac-a32f68bc5c0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:05.600950 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4466f348-b206-481e-aaac-a32f68bc5c0a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:05.623560 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1019/2022] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:06:05.624869 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466f348-b206-481e-aaac-a32f68bc5c0a admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:05.637845 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466f348-b206-481e-aaac-a32f68bc5c0a admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:05.643509 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293198df-34c7-4914-816c-241e4d3f2773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:05.644206 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293198df-34c7-4914-816c-241e4d3f2773 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:05.644486 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293198df-34c7-4914-816c-241e4d3f2773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:05.644756 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293198df-34c7-4914-816c-241e4d3f2773 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:05.645457 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293198df-34c7-4914-816c-241e4d3f2773 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:05.647555 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293198df-34c7-4914-816c-241e4d3f2773 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:05.779304 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1020/2023] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:06:05 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:06:05.780266 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293198df-34c7-4914-816c-241e4d3f2773 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:05.783864 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-293198df-34c7-4914-816c-241e4d3f2773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:05.792689 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-b462f9cf-10fe-4d3f-926a-60c04bf8bc05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a6124937aac421a91a4766c38643960'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:05.793343 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-b462f9cf-10fe-4d3f-926a-60c04bf8bc05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a6124937aac421a91a4766c38643960'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:05.847596 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293198df-34c7-4914-816c-241e4d3f2773 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:05.851389 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1443bbe-6f5a-4591-812d-bbe03df14a98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:05.852066 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1443bbe-6f5a-4591-812d-bbe03df14a98 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:05.852347 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1443bbe-6f5a-4591-812d-bbe03df14a98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:05.852631 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1443bbe-6f5a-4591-812d-bbe03df14a98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:05.854393 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e1443bbe-6f5a-4591-812d-bbe03df14a98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:05.867421 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1443bbe-6f5a-4591-812d-bbe03df14a98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:05.869025 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1443bbe-6f5a-4591-812d-bbe03df14a98 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:05.880075 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1021/2024] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:06:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:06:05.880865 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1443bbe-6f5a-4591-812d-bbe03df14a98 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:05.882205 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e1443bbe-6f5a-4591-812d-bbe03df14a98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:05.894198 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1443bbe-6f5a-4591-812d-bbe03df14a98 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:05.901073 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee7a8c-c3d6-4bd1-bba9-ebea8ef9f9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:05.901073 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee7a8c-c3d6-4bd1-bba9-ebea8ef9f9c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:05.901296 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee7a8c-c3d6-4bd1-bba9-ebea8ef9f9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:05.901461 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee7a8c-c3d6-4bd1-bba9-ebea8ef9f9c3 admin admin] PATH_INFO: `/v3/projects/358293a86b4941039d23c3987ddea75f/users/e56169a18f854eabad63978418088854/roles/681755518698445fabd9a8accec13c0f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:05.904101 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ee7a8c-c3d6-4bd1-bba9-ebea8ef9f9c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=358293a86b4941039d23c3987ddea75f, user_id=e56169a18f854eabad63978418088854, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:05.908288 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-b462f9cf-10fe-4d3f-926a-60c04bf8bc05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a6124937aac421a91a4766c38643960'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:05.909114 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-b462f9cf-10fe-4d3f-926a-60c04bf8bc05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a6124937aac421a91a4766c38643960'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:05.913554 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ee7a8c-c3d6-4bd1-bba9-ebea8ef9f9c3 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:05.921649 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-b462f9cf-10fe-4d3f-926a-60c04bf8bc05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a6124937aac421a91a4766c38643960'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:05.931213 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1022/2025] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:06:05 2022] PUT /identity/v3/projects/358293a86b4941039d23c3987ddea75f/users/e56169a18f854eabad63978418088854/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:05.932517 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee7a8c-c3d6-4bd1-bba9-ebea8ef9f9c3 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:05.935790 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-60ee7a8c-c3d6-4bd1-bba9-ebea8ef9f9c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:05.951224 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1004/2026] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:06:05 2022] DELETE /identity/v3/users/6a6124937aac421a91a4766c38643960 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:05.952770 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b19c59-e303-4067-a9bc-ba99de95e1d9 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:05.953060 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b19c59-e303-4067-a9bc-ba99de95e1d9 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:05.953790 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b19c59-e303-4067-a9bc-ba99de95e1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:05.984286 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-26b19c59-e303-4067-a9bc-ba99de95e1d9 None None] MFA Rules not processed for user `e56169a18f854eabad63978418088854`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:05.985586 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-26b19c59-e303-4067-a9bc-ba99de95e1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:06.010364 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee7a8c-c3d6-4bd1-bba9-ebea8ef9f9c3 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:06.067695 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1005/2027] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:05 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:06.069004 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9da26-5474-4884-8c43-fc9dc989137c None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:06.069300 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9da26-5474-4884-8c43-fc9dc989137c None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:06.069573 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9da26-5474-4884-8c43-fc9dc989137c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:06.073070 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28479e24-43bb-466a-9bf9-502f1d20a2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:06.073791 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28479e24-43bb-466a-9bf9-502f1d20a2f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:06.074209 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28479e24-43bb-466a-9bf9-502f1d20a2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:06.074429 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28479e24-43bb-466a-9bf9-502f1d20a2f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:06.075189 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28479e24-43bb-466a-9bf9-502f1d20a2f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:06.076975 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28479e24-43bb-466a-9bf9-502f1d20a2f1 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:06.087982 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-a7b9da26-5474-4884-8c43-fc9dc989137c None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:06.095652 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-a7b9da26-5474-4884-8c43-fc9dc989137c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:06.095859 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1023/2028] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:06:06.097549 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1006/2029] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:06.098622 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28479e24-43bb-466a-9bf9-502f1d20a2f1 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:06.109066 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b9da26-5474-4884-8c43-fc9dc989137c None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:06.111387 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-a7b9da26-5474-4884-8c43-fc9dc989137c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:06.114075 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28479e24-43bb-466a-9bf9-502f1d20a2f1 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:06.119788 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b7ced-dec8-48d5-b8b1-fd86a02379d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:06.120521 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b7ced-dec8-48d5-b8b1-fd86a02379d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:06.120807 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b7ced-dec8-48d5-b8b1-fd86a02379d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:06.121086 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b7ced-dec8-48d5-b8b1-fd86a02379d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:06.121827 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8b7ced-dec8-48d5-b8b1-fd86a02379d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:06.124895 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8b7ced-dec8-48d5-b8b1-fd86a02379d7 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:06.138741 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1024/2030] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:06:06.140300 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b7ced-dec8-48d5-b8b1-fd86a02379d7 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:06.152617 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b7ced-dec8-48d5-b8b1-fd86a02379d7 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:06.158314 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227cf23d-8655-4a91-8eaa-26340bf71321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:06.159657 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cf23d-8655-4a91-8eaa-26340bf71321 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:06.160022 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cf23d-8655-4a91-8eaa-26340bf71321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:06.160372 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cf23d-8655-4a91-8eaa-26340bf71321 admin admin] PATH_INFO: `/v3/projects/69dda41721014571baa82cfc8899d2e9/users/9afe0c6c75c44f7e98d2e5d19b45912c/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:06.191788 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227cf23d-8655-4a91-8eaa-26340bf71321 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69dda41721014571baa82cfc8899d2e9, user_id=9afe0c6c75c44f7e98d2e5d19b45912c, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:06.194834 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227cf23d-8655-4a91-8eaa-26340bf71321 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:06.199443 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b9da26-5474-4884-8c43-fc9dc989137c None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:06.207105 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35953f5-422c-47a3-ae39-9c09e1107645 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:06.207899 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35953f5-422c-47a3-ae39-9c09e1107645 service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:06.208115 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35953f5-422c-47a3-ae39-9c09e1107645 service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:06.208879 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35953f5-422c-47a3-ae39-9c09e1107645 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:06.222178 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35953f5-422c-47a3-ae39-9c09e1107645 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:06.223588 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35953f5-422c-47a3-ae39-9c09e1107645 service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:06.234924 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1007/2031] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:06:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:06:06.336757 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1025/2032] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:06:06 2022] PUT /identity/v3/projects/69dda41721014571baa82cfc8899d2e9/users/9afe0c6c75c44f7e98d2e5d19b45912c/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:06.340071 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf700b1-94c8-4cff-a80e-9c8adfcd8c42 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:06.341691 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf700b1-94c8-4cff-a80e-9c8adfcd8c42 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:06.345339 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf700b1-94c8-4cff-a80e-9c8adfcd8c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:06.350038 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227cf23d-8655-4a91-8eaa-26340bf71321 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:06.350038 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-227cf23d-8655-4a91-8eaa-26340bf71321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:06.402652 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-bdf700b1-94c8-4cff-a80e-9c8adfcd8c42 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:06.407170 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-bdf700b1-94c8-4cff-a80e-9c8adfcd8c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:06.469681 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227cf23d-8655-4a91-8eaa-26340bf71321 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:06.475818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ca7c8-0cc0-4588-a2ba-75bce6e5c122 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:06.475818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ca7c8-0cc0-4588-a2ba-75bce6e5c122 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:06.475818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ca7c8-0cc0-4588-a2ba-75bce6e5c122 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:06.475818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ca7c8-0cc0-4588-a2ba-75bce6e5c122 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:06.477603 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b45ca7c8-0cc0-4588-a2ba-75bce6e5c122 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:06.565526 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1008/2033] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 04:06:06.567153 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf700b1-94c8-4cff-a80e-9c8adfcd8c42 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:06.570601 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-bdf700b1-94c8-4cff-a80e-9c8adfcd8c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:06.594908 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45ca7c8-0cc0-4588-a2ba-75bce6e5c122 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:06.596820 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45ca7c8-0cc0-4588-a2ba-75bce6e5c122 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:06.598994 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf700b1-94c8-4cff-a80e-9c8adfcd8c42 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:06.609872 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5168d1-3cb6-43c8-8e2f-a6dd27a38e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:06.611466 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5168d1-3cb6-43c8-8e2f-a6dd27a38e3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:06.611975 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5168d1-3cb6-43c8-8e2f-a6dd27a38e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:06.612456 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5168d1-3cb6-43c8-8e2f-a6dd27a38e3b admin admin] PATH_INFO: `/v3/projects/e60bb51d2f5948f9a77b50d75227d14d` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:06.615609 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5168d1-3cb6-43c8-8e2f-a6dd27a38e3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e60bb51d2f5948f9a77b50d75227d14d)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:06.619976 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5168d1-3cb6-43c8-8e2f-a6dd27a38e3b admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:06.621474 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1026/2034] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:06:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:06:06.630231 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ca7c8-0cc0-4588-a2ba-75bce6e5c122 service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:06.641258 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b45ca7c8-0cc0-4588-a2ba-75bce6e5c122 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:06.727125 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ca7c8-0cc0-4588-a2ba-75bce6e5c122 service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:06.733725 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71beca1-0b6f-4fc0-bdd1-29531f1a027b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:06.734586 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71beca1-0b6f-4fc0-bdd1-29531f1a027b service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:06.735150 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71beca1-0b6f-4fc0-bdd1-29531f1a027b service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:06.735435 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71beca1-0b6f-4fc0-bdd1-29531f1a027b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:06.751803 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71beca1-0b6f-4fc0-bdd1-29531f1a027b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:06.754225 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71beca1-0b6f-4fc0-bdd1-29531f1a027b service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:06.781837 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:06.788528 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1027/2035] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:06:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:06:06.828049 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-fa5168d1-3cb6-43c8-8e2f-a6dd27a38e3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e60bb51d2f5948f9a77b50d75227d14d', 'request_id': 'req-fa5168d1-3cb6-43c8-8e2f-a6dd27a38e3b'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:06.836282 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-fa5168d1-3cb6-43c8-8e2f-a6dd27a38e3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e60bb51d2f5948f9a77b50d75227d14d', 'request_id': 'req-fa5168d1-3cb6-43c8-8e2f-a6dd27a38e3b'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:06.843654 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-fa5168d1-3cb6-43c8-8e2f-a6dd27a38e3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e60bb51d2f5948f9a77b50d75227d14d', 'request_id': 'req-fa5168d1-3cb6-43c8-8e2f-a6dd27a38e3b'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:06.865679 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:06.882361 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71beca1-0b6f-4fc0-bdd1-29531f1a027b service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:06.883803 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d71beca1-0b6f-4fc0-bdd1-29531f1a027b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:06.897555 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71beca1-0b6f-4fc0-bdd1-29531f1a027b service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:06.958440 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e094f0e-7356-413d-88e2-015443ccc9a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:06.959105 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e094f0e-7356-413d-88e2-015443ccc9a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:06.959385 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e094f0e-7356-413d-88e2-015443ccc9a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:06.959692 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e094f0e-7356-413d-88e2-015443ccc9a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:06.961655 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-7e094f0e-7356-413d-88e2-015443ccc9a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:07.034734 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-fa5168d1-3cb6-43c8-8e2f-a6dd27a38e3b admin admin] The token cache is being invalidate because project e60bb51d2f5948f9a77b50d75227d14d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:06:07.035253 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-fa5168d1-3cb6-43c8-8e2f-a6dd27a38e3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:07.035997 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-fa5168d1-3cb6-43c8-8e2f-a6dd27a38e3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:07.037917 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1009/2036] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:06:06 2022] DELETE /identity/v3/projects/e60bb51d2f5948f9a77b50d75227d14d => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:07.045016 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e094f0e-7356-413d-88e2-015443ccc9a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:07.045016 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e094f0e-7356-413d-88e2-015443ccc9a9 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:07.045541 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5168d1-3cb6-43c8-8e2f-a6dd27a38e3b admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:07.045541 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-fa5168d1-3cb6-43c8-8e2f-a6dd27a38e3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:07.052698 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1028/2037] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:06:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 04:06:07.128587 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5168d1-3cb6-43c8-8e2f-a6dd27a38e3b admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:07.133515 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23464861-c3bf-4966-958d-2673b7ddfc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:07.134547 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23464861-c3bf-4966-958d-2673b7ddfc38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:07.134831 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23464861-c3bf-4966-958d-2673b7ddfc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:07.135116 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23464861-c3bf-4966-958d-2673b7ddfc38 admin admin] PATH_INFO: `/v3/users/ec14a4e1917e469480d585c46687ab3f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:07.136462 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23464861-c3bf-4966-958d-2673b7ddfc38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec14a4e1917e469480d585c46687ab3f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:07.139332 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23464861-c3bf-4966-958d-2673b7ddfc38 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:07.212264 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e094f0e-7356-413d-88e2-015443ccc9a9 service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:07.215009 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-7e094f0e-7356-413d-88e2-015443ccc9a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:07.238742 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e094f0e-7356-413d-88e2-015443ccc9a9 service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:07.250264 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641238e-33fa-4711-a383-b00016978052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:07.250495 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641238e-33fa-4711-a383-b00016978052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:07.250951 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641238e-33fa-4711-a383-b00016978052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:07.251377 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641238e-33fa-4711-a383-b00016978052 admin admin] PATH_INFO: `/v3/projects/53940a84b07e4dcca512f4f90a1061d3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:07.253420 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0641238e-33fa-4711-a383-b00016978052 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53940a84b07e4dcca512f4f90a1061d3)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:07.255920 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0641238e-33fa-4711-a383-b00016978052 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:07.486035 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-23464861-c3bf-4966-958d-2673b7ddfc38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec14a4e1917e469480d585c46687ab3f'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:07.488640 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-23464861-c3bf-4966-958d-2673b7ddfc38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec14a4e1917e469480d585c46687ab3f'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:07.496634 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0641238e-33fa-4711-a383-b00016978052 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53940a84b07e4dcca512f4f90a1061d3', 'request_id': 'req-0641238e-33fa-4711-a383-b00016978052'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:07.574024 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-23464861-c3bf-4966-958d-2673b7ddfc38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec14a4e1917e469480d585c46687ab3f'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:07.574932 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-23464861-c3bf-4966-958d-2673b7ddfc38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec14a4e1917e469480d585c46687ab3f'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:07.604522 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-23464861-c3bf-4966-958d-2673b7ddfc38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec14a4e1917e469480d585c46687ab3f'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:07.641038 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1010/2038] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:06:07 2022] DELETE /identity/v3/users/ec14a4e1917e469480d585c46687ab3f => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:06:07.681023 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0641238e-33fa-4711-a383-b00016978052 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53940a84b07e4dcca512f4f90a1061d3', 'request_id': 'req-0641238e-33fa-4711-a383-b00016978052'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:07.688248 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0641238e-33fa-4711-a383-b00016978052 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53940a84b07e4dcca512f4f90a1061d3', 'request_id': 'req-0641238e-33fa-4711-a383-b00016978052'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:07.702902 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0641238e-33fa-4711-a383-b00016978052 admin admin] The token cache is being invalidate because project 53940a84b07e4dcca512f4f90a1061d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:06:07.703777 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0641238e-33fa-4711-a383-b00016978052 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:07.704724 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0641238e-33fa-4711-a383-b00016978052 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:07.707099 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1029/2039] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:06:07 2022] DELETE /identity/v3/projects/53940a84b07e4dcca512f4f90a1061d3 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:06:07.713344 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23464861-c3bf-4966-958d-2673b7ddfc38 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:07.717293 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-23464861-c3bf-4966-958d-2673b7ddfc38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:07.892338 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23464861-c3bf-4966-958d-2673b7ddfc38 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:07.900125 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ec2ae-70b0-4a4c-879e-a4e30e6279d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:07.902131 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ec2ae-70b0-4a4c-879e-a4e30e6279d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:07.902421 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ec2ae-70b0-4a4c-879e-a4e30e6279d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:07.902699 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ec2ae-70b0-4a4c-879e-a4e30e6279d2 admin admin] PATH_INFO: `/v3/users/4015dc009ce74c8eb7bc6d6d6c7a0a7b` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:07.904396 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ec2ae-70b0-4a4c-879e-a4e30e6279d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4015dc009ce74c8eb7bc6d6d6c7a0a7b)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:07.906490 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ec2ae-70b0-4a4c-879e-a4e30e6279d2 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:08.179190 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-6f4ec2ae-70b0-4a4c-879e-a4e30e6279d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4015dc009ce74c8eb7bc6d6d6c7a0a7b'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:08.183938 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-6f4ec2ae-70b0-4a4c-879e-a4e30e6279d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4015dc009ce74c8eb7bc6d6d6c7a0a7b'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:08.322177 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-6f4ec2ae-70b0-4a4c-879e-a4e30e6279d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4015dc009ce74c8eb7bc6d6d6c7a0a7b'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:08.330748 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-6f4ec2ae-70b0-4a4c-879e-a4e30e6279d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4015dc009ce74c8eb7bc6d6d6c7a0a7b'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:08.333969 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-6f4ec2ae-70b0-4a4c-879e-a4e30e6279d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4015dc009ce74c8eb7bc6d6d6c7a0a7b'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:08.360436 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1011/2040] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:06:07 2022] DELETE /identity/v3/users/4015dc009ce74c8eb7bc6d6d6c7a0a7b => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:08.480364 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641238e-33fa-4711-a383-b00016978052 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:08.480364 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0641238e-33fa-4711-a383-b00016978052 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:08.595511 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641238e-33fa-4711-a383-b00016978052 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:08.657243 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81324bf-cdaa-4b75-94e0-5a1377b3dbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:08.658146 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81324bf-cdaa-4b75-94e0-5a1377b3dbde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:08.658422 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81324bf-cdaa-4b75-94e0-5a1377b3dbde admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:08.658690 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81324bf-cdaa-4b75-94e0-5a1377b3dbde admin admin] PATH_INFO: `/v3/projects/00468fee8a804d5f864b980f0ab27e32` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:08.659964 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81324bf-cdaa-4b75-94e0-5a1377b3dbde admin admin] RBAC: Authorizing `identity:delete_project(project_id=00468fee8a804d5f864b980f0ab27e32)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:08.662189 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81324bf-cdaa-4b75-94e0-5a1377b3dbde admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:08.896267 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f81324bf-cdaa-4b75-94e0-5a1377b3dbde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00468fee8a804d5f864b980f0ab27e32', 'request_id': 'req-f81324bf-cdaa-4b75-94e0-5a1377b3dbde'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:09.066171 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f81324bf-cdaa-4b75-94e0-5a1377b3dbde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00468fee8a804d5f864b980f0ab27e32', 'request_id': 'req-f81324bf-cdaa-4b75-94e0-5a1377b3dbde'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:09.077966 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f81324bf-cdaa-4b75-94e0-5a1377b3dbde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00468fee8a804d5f864b980f0ab27e32', 'request_id': 'req-f81324bf-cdaa-4b75-94e0-5a1377b3dbde'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:09.114567 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f81324bf-cdaa-4b75-94e0-5a1377b3dbde admin admin] The token cache is being invalidate because project 00468fee8a804d5f864b980f0ab27e32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:06:09.114567 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f81324bf-cdaa-4b75-94e0-5a1377b3dbde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:09.114567 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f81324bf-cdaa-4b75-94e0-5a1377b3dbde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:09.114567 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1030/2041] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:06:08 2022] DELETE /identity/v3/projects/00468fee8a804d5f864b980f0ab27e32 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:09.116576 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ec2ae-70b0-4a4c-879e-a4e30e6279d2 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:09.119497 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-6f4ec2ae-70b0-4a4c-879e-a4e30e6279d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:09.124249 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa674da8-2a08-41c5-8cd5-a35eb39fc0f9 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:09.124249 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa674da8-2a08-41c5-8cd5-a35eb39fc0f9 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:09.124667 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa674da8-2a08-41c5-8cd5-a35eb39fc0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:09.163291 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ec2ae-70b0-4a4c-879e-a4e30e6279d2 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:09.172218 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-fa674da8-2a08-41c5-8cd5-a35eb39fc0f9 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:09.174156 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-fa674da8-2a08-41c5-8cd5-a35eb39fc0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:09.272369 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1031/2042] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:09.283248 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd55649-658e-4685-ac8b-8595bfff153d None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:09.285626 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd55649-658e-4685-ac8b-8595bfff153d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:09.287982 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd55649-658e-4685-ac8b-8595bfff153d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:09.324125 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38205896-3acc-41bd-bf5d-312dc6b5e2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:09.324125 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38205896-3acc-41bd-bf5d-312dc6b5e2bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:09.324125 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38205896-3acc-41bd-bf5d-312dc6b5e2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:09.324125 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38205896-3acc-41bd-bf5d-312dc6b5e2bf admin admin] PATH_INFO: `/v3/projects/53e110b294514eb68300b23acd85fc04` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:09.324472 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38205896-3acc-41bd-bf5d-312dc6b5e2bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=53e110b294514eb68300b23acd85fc04)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:09.325438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38205896-3acc-41bd-bf5d-312dc6b5e2bf admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:09.333910 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-4dd55649-658e-4685-ac8b-8595bfff153d None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:09.335631 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-4dd55649-658e-4685-ac8b-8595bfff153d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:09.361032 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1032/2043] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:09.361032 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd55649-658e-4685-ac8b-8595bfff153d None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:09.361032 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-4dd55649-658e-4685-ac8b-8595bfff153d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:09.431770 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd55649-658e-4685-ac8b-8595bfff153d None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:09.438148 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a6fae-a1d7-4042-b67e-f958e2d9a79c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:09.439620 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a6fae-a1d7-4042-b67e-f958e2d9a79c service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:09.440293 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a6fae-a1d7-4042-b67e-f958e2d9a79c service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:09.441345 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a6fae-a1d7-4042-b67e-f958e2d9a79c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:09.445000 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-713a6fae-a1d7-4042-b67e-f958e2d9a79c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:09.506661 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-38205896-3acc-41bd-bf5d-312dc6b5e2bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53e110b294514eb68300b23acd85fc04', 'request_id': 'req-38205896-3acc-41bd-bf5d-312dc6b5e2bf'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:09.509393 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:09.515725 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-38205896-3acc-41bd-bf5d-312dc6b5e2bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53e110b294514eb68300b23acd85fc04', 'request_id': 'req-38205896-3acc-41bd-bf5d-312dc6b5e2bf'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:09.522591 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-38205896-3acc-41bd-bf5d-312dc6b5e2bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53e110b294514eb68300b23acd85fc04', 'request_id': 'req-38205896-3acc-41bd-bf5d-312dc6b5e2bf'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:09.534224 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a6fae-a1d7-4042-b67e-f958e2d9a79c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:09.535719 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a6fae-a1d7-4042-b67e-f958e2d9a79c service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:09.546499 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1033/2044] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:06:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:06:09.547344 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a6fae-a1d7-4042-b67e-f958e2d9a79c service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:09.559335 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a6fae-a1d7-4042-b67e-f958e2d9a79c service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:09.629298 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-38205896-3acc-41bd-bf5d-312dc6b5e2bf admin admin] The token cache is being invalidate because project 53e110b294514eb68300b23acd85fc04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:06:09.630517 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-38205896-3acc-41bd-bf5d-312dc6b5e2bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:09.632403 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-38205896-3acc-41bd-bf5d-312dc6b5e2bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:09.639608 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1012/2045] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:06:09 2022] DELETE /identity/v3/projects/53e110b294514eb68300b23acd85fc04 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:06:09.641500 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00986c4-4c0c-4c21-8b33-318421a754d6 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:09.641786 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00986c4-4c0c-4c21-8b33-318421a754d6 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:09.642059 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00986c4-4c0c-4c21-8b33-318421a754d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:09.663627 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618fd4c0-13ba-4e79-9535-21cdb9fb414f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:09.664393 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fd4c0-13ba-4e79-9535-21cdb9fb414f admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:09.664823 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fd4c0-13ba-4e79-9535-21cdb9fb414f admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:09.665103 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fd4c0-13ba-4e79-9535-21cdb9fb414f admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:09.665957 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618fd4c0-13ba-4e79-9535-21cdb9fb414f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:06:09.666276 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618fd4c0-13ba-4e79-9535-21cdb9fb414f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:09.669095 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618fd4c0-13ba-4e79-9535-21cdb9fb414f admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:09.671359 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-a00986c4-4c0c-4c21-8b33-318421a754d6 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:09.672750 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-a00986c4-4c0c-4c21-8b33-318421a754d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:09.682383 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1013/2046] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:09.687289 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1034/2047] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:06:09.692760 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00986c4-4c0c-4c21-8b33-318421a754d6 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:09.695341 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b8150-3f00-4227-8703-9c88aa1e277f None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:09.696070 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b8150-3f00-4227-8703-9c88aa1e277f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:09.696858 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b8150-3f00-4227-8703-9c88aa1e277f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:09.698514 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-a00986c4-4c0c-4c21-8b33-318421a754d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:09.713397 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00986c4-4c0c-4c21-8b33-318421a754d6 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:09.721741 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b4255-adb2-4ec0-bd1a-2ede70613b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:09.722756 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b4255-adb2-4ec0-bd1a-2ede70613b72 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:09.723273 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b4255-adb2-4ec0-bd1a-2ede70613b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:09.723610 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b4255-adb2-4ec0-bd1a-2ede70613b72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:09.724524 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-9d6b8150-3f00-4227-8703-9c88aa1e277f None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:09.724744 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b4255-adb2-4ec0-bd1a-2ede70613b72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:09.725587 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9d6b8150-3f00-4227-8703-9c88aa1e277f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:09.726903 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b4255-adb2-4ec0-bd1a-2ede70613b72 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:09.739488 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1035/2048] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:09.740555 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b8150-3f00-4227-8703-9c88aa1e277f None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:09.752775 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b8150-3f00-4227-8703-9c88aa1e277f None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:09.780603 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48078c0e-08a2-4567-b0fc-6d41d0219c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:09.782138 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48078c0e-08a2-4567-b0fc-6d41d0219c02 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:09.782844 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48078c0e-08a2-4567-b0fc-6d41d0219c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:09.783569 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48078c0e-08a2-4567-b0fc-6d41d0219c02 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:09.785275 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48078c0e-08a2-4567-b0fc-6d41d0219c02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:06:09.785838 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48078c0e-08a2-4567-b0fc-6d41d0219c02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:09.789228 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48078c0e-08a2-4567-b0fc-6d41d0219c02 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:09.806520 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1036/2049] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:06:09.811779 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48078c0e-08a2-4567-b0fc-6d41d0219c02 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:09.825555 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48078c0e-08a2-4567-b0fc-6d41d0219c02 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:09.832667 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda31c4-7de8-4917-9285-bc4927fed160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:09.834406 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda31c4-7de8-4917-9285-bc4927fed160 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:09.834814 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda31c4-7de8-4917-9285-bc4927fed160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:09.835361 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda31c4-7de8-4917-9285-bc4927fed160 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:09.836174 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda31c4-7de8-4917-9285-bc4927fed160 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:09.840182 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda31c4-7de8-4917-9285-bc4927fed160 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:09.926850 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1014/2050] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:06:09 2022] POST /identity/v3/projects => generated 373 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:06:09.932189 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b4255-adb2-4ec0-bd1a-2ede70613b72 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:10.041429 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1037/2051] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:06:09 2022] POST /identity/v3/projects => generated 377 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 04:06:10.047837 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda31c4-7de8-4917-9285-bc4927fed160 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:10.178952 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b4255-adb2-4ec0-bd1a-2ede70613b72 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:10.292208 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda31c4-7de8-4917-9285-bc4927fed160 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:10.305394 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989e5e4-ffb2-4a69-8b65-be2b06be277c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:10.307747 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989e5e4-ffb2-4a69-8b65-be2b06be277c admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:10.308402 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989e5e4-ffb2-4a69-8b65-be2b06be277c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:10.309017 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989e5e4-ffb2-4a69-8b65-be2b06be277c admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:10.313469 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9989e5e4-ffb2-4a69-8b65-be2b06be277c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:10.324241 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9989e5e4-ffb2-4a69-8b65-be2b06be277c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:10.416078 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e950c-951a-488d-a61b-4aa6b3898ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:10.427271 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e950c-951a-488d-a61b-4aa6b3898ba0 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:10.427271 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e950c-951a-488d-a61b-4aa6b3898ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:10.427271 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e950c-951a-488d-a61b-4aa6b3898ba0 admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:10.427271 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e950c-951a-488d-a61b-4aa6b3898ba0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:10.434092 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e950c-951a-488d-a61b-4aa6b3898ba0 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:10.499837 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1038/2052] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:06:10 2022] POST /identity/v3/users => generated 289 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:06:10.504882 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989e5e4-ffb2-4a69-8b65-be2b06be277c admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:10.530253 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989e5e4-ffb2-4a69-8b65-be2b06be277c admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:10.537375 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247031ef-01cd-4d85-9565-57b26ad98adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:10.538849 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247031ef-01cd-4d85-9565-57b26ad98adc admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:10.539129 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247031ef-01cd-4d85-9565-57b26ad98adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:10.540008 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247031ef-01cd-4d85-9565-57b26ad98adc admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:10.541091 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247031ef-01cd-4d85-9565-57b26ad98adc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:10.543238 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247031ef-01cd-4d85-9565-57b26ad98adc admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:10.565540 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1039/2053] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:06:10.571802 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247031ef-01cd-4d85-9565-57b26ad98adc admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:10.594148 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247031ef-01cd-4d85-9565-57b26ad98adc admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:10.599690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1015/2054] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:06:09 2022] POST /identity/v3/users => generated 287 bytes in 669 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:06:10.604324 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e950c-951a-488d-a61b-4aa6b3898ba0 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:10.614070 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06269b-ed2a-4ff6-8718-1e1352f6aa16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:10.614691 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06269b-ed2a-4ff6-8718-1e1352f6aa16 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:10.617900 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06269b-ed2a-4ff6-8718-1e1352f6aa16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:10.618312 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06269b-ed2a-4ff6-8718-1e1352f6aa16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:10.619973 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e06269b-ed2a-4ff6-8718-1e1352f6aa16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:10.623671 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e06269b-ed2a-4ff6-8718-1e1352f6aa16 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:10.629256 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e950c-951a-488d-a61b-4aa6b3898ba0 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:10.655070 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e6c68-03a5-43e9-8e10-c14b472df95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:10.655813 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e6c68-03a5-43e9-8e10-c14b472df95f admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:10.656155 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e6c68-03a5-43e9-8e10-c14b472df95f admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:10.656442 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e6c68-03a5-43e9-8e10-c14b472df95f admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:10.657212 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e6c68-03a5-43e9-8e10-c14b472df95f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:10.665024 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e6c68-03a5-43e9-8e10-c14b472df95f admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:10.665465 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1040/2055] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:06:10.666574 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06269b-ed2a-4ff6-8718-1e1352f6aa16 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:10.707195 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1016/2056] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:06:10.707513 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06269b-ed2a-4ff6-8718-1e1352f6aa16 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:10.708212 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e6c68-03a5-43e9-8e10-c14b472df95f admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:10.724419 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e6c68-03a5-43e9-8e10-c14b472df95f admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:10.730282 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76869b91-3595-4d10-8a7b-df2eac9574f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:10.731302 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76869b91-3595-4d10-8a7b-df2eac9574f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:10.731867 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76869b91-3595-4d10-8a7b-df2eac9574f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:10.732303 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76869b91-3595-4d10-8a7b-df2eac9574f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:10.733303 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76869b91-3595-4d10-8a7b-df2eac9574f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:10.735723 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76869b91-3595-4d10-8a7b-df2eac9574f6 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:10.750742 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23415e2a-07dd-4c29-91ac-9fe9f0d94f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:10.760333 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23415e2a-07dd-4c29-91ac-9fe9f0d94f90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:10.760510 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1017/2057] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:06:10.760624 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23415e2a-07dd-4c29-91ac-9fe9f0d94f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:10.760624 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23415e2a-07dd-4c29-91ac-9fe9f0d94f90 admin admin] PATH_INFO: `/v3/projects/a2993989420f43c6be14e618552d872b/users/ffc289512e8445c0aa6d15886e1bc60d/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:10.761509 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76869b91-3595-4d10-8a7b-df2eac9574f6 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:10.771138 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76869b91-3595-4d10-8a7b-df2eac9574f6 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:10.780500 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fea8a4a-3c4a-4691-b4a7-37d5ddafaff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:10.782491 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea8a4a-3c4a-4691-b4a7-37d5ddafaff6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:10.782973 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea8a4a-3c4a-4691-b4a7-37d5ddafaff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:10.783497 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea8a4a-3c4a-4691-b4a7-37d5ddafaff6 admin admin] PATH_INFO: `/v3/projects/947e1f2e9a4b4ef08510e314ff195226/users/87d63f772da6431abd35221bc9efa038/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:10.809948 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23415e2a-07dd-4c29-91ac-9fe9f0d94f90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2993989420f43c6be14e618552d872b, user_id=ffc289512e8445c0aa6d15886e1bc60d, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:10.810367 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fea8a4a-3c4a-4691-b4a7-37d5ddafaff6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=947e1f2e9a4b4ef08510e314ff195226, user_id=87d63f772da6431abd35221bc9efa038, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:10.814177 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fea8a4a-3c4a-4691-b4a7-37d5ddafaff6 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:10.816083 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23415e2a-07dd-4c29-91ac-9fe9f0d94f90 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:10.982158 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:10.987473 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1018/2058] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:06:10 2022] PUT /identity/v3/projects/947e1f2e9a4b4ef08510e314ff195226/users/87d63f772da6431abd35221bc9efa038/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:10.998278 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1041/2059] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:06:10 2022] PUT /identity/v3/projects/a2993989420f43c6be14e618552d872b/users/ffc289512e8445c0aa6d15886e1bc60d/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:10.998525 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a1027-bcfd-447a-8e19-665782eecfb5 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:10.998525 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a1027-bcfd-447a-8e19-665782eecfb5 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:10.998525 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a1027-bcfd-447a-8e19-665782eecfb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:11.003245 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0ac0a-9657-4eb2-8208-6002fac73f42 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:11.004116 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0ac0a-9657-4eb2-8208-6002fac73f42 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:11.004811 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0ac0a-9657-4eb2-8208-6002fac73f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:11.033321 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-449a1027-bcfd-447a-8e19-665782eecfb5 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:11.034932 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-449a1027-bcfd-447a-8e19-665782eecfb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:11.050846 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-67c0ac0a-9657-4eb2-8208-6002fac73f42 None None] MFA Rules not processed for user `ffc289512e8445c0aa6d15886e1bc60d`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:11.052467 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-67c0ac0a-9657-4eb2-8208-6002fac73f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:11.083624 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:11.117143 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1019/2060] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:11.131699 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a1027-bcfd-447a-8e19-665782eecfb5 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:11.135236 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-449a1027-bcfd-447a-8e19-665782eecfb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:11.195490 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1042/2061] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:11.200878 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c0ac0a-9657-4eb2-8208-6002fac73f42 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:11.221520 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c0ac0a-9657-4eb2-8208-6002fac73f42 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:11.234645 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd6b79c-c8bc-4051-aad8-1cdc8db5e4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:11.236966 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6b79c-c8bc-4051-aad8-1cdc8db5e4c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:11.237502 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6b79c-c8bc-4051-aad8-1cdc8db5e4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:11.237938 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6b79c-c8bc-4051-aad8-1cdc8db5e4c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:11.238891 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd6b79c-c8bc-4051-aad8-1cdc8db5e4c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:11.243215 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd6b79c-c8bc-4051-aad8-1cdc8db5e4c3 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:11.287514 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a1027-bcfd-447a-8e19-665782eecfb5 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:11.298680 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475ebfb-5555-4753-8ce0-6a2efe8e1ac6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:11.299879 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475ebfb-5555-4753-8ce0-6a2efe8e1ac6 service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:11.300395 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475ebfb-5555-4753-8ce0-6a2efe8e1ac6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:11.300905 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475ebfb-5555-4753-8ce0-6a2efe8e1ac6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:11.317955 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4475ebfb-5555-4753-8ce0-6a2efe8e1ac6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:11.320095 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4475ebfb-5555-4753-8ce0-6a2efe8e1ac6 service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:11.335421 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1020/2062] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:06:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 04:06:11.475499 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1043/2063] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:06:11 2022] POST /identity/v3/projects => generated 379 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:06:11.480465 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475ebfb-5555-4753-8ce0-6a2efe8e1ac6 service neutron] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:11.500112 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475ebfb-5555-4753-8ce0-6a2efe8e1ac6 service neutron] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:11.609346 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea30dfb-9dbb-497d-bb03-65fa5777cc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:11.612498 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea30dfb-9dbb-497d-bb03-65fa5777cc7b admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:11.612498 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea30dfb-9dbb-497d-bb03-65fa5777cc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:11.612498 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea30dfb-9dbb-497d-bb03-65fa5777cc7b admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:11.612498 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea30dfb-9dbb-497d-bb03-65fa5777cc7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:11.614024 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea30dfb-9dbb-497d-bb03-65fa5777cc7b admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:11.742728 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1021/2064] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:06:11 2022] POST /identity/v3/users => generated 296 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:06:11.743791 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd6b79c-c8bc-4051-aad8-1cdc8db5e4c3 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:11.765108 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd6b79c-c8bc-4051-aad8-1cdc8db5e4c3 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:11.777446 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a69a3e6-2c63-406d-9810-bdd274f13df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:11.777446 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69a3e6-2c63-406d-9810-bdd274f13df3 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:11.777446 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69a3e6-2c63-406d-9810-bdd274f13df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:11.777446 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69a3e6-2c63-406d-9810-bdd274f13df3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:11.779522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a69a3e6-2c63-406d-9810-bdd274f13df3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:11.781418 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a69a3e6-2c63-406d-9810-bdd274f13df3 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:11.795304 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1044/2065] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 04:06:11.799350 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea30dfb-9dbb-497d-bb03-65fa5777cc7b admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:11.812142 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea30dfb-9dbb-497d-bb03-65fa5777cc7b admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:11.821432 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0db08d-5de1-4705-84ed-90030ca839f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:11.823700 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0db08d-5de1-4705-84ed-90030ca839f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:11.824514 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0db08d-5de1-4705-84ed-90030ca839f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:11.825124 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0db08d-5de1-4705-84ed-90030ca839f8 admin admin] PATH_INFO: `/v3/projects/c94ef85427e545e0819e8573c24b7afa/users/47a2276547fb4d70b3f5c8f630fdfbac/roles/681755518698445fabd9a8accec13c0f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:11.859733 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0db08d-5de1-4705-84ed-90030ca839f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c94ef85427e545e0819e8573c24b7afa, user_id=47a2276547fb4d70b3f5c8f630fdfbac, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:11.863515 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0db08d-5de1-4705-84ed-90030ca839f8 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:12.188539 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1022/2066] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:06:11 2022] PUT /identity/v3/projects/c94ef85427e545e0819e8573c24b7afa/users/47a2276547fb4d70b3f5c8f630fdfbac/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:12.196266 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a69a3e6-2c63-406d-9810-bdd274f13df3 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:12.387283 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a69a3e6-2c63-406d-9810-bdd274f13df3 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:12.462974 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabbbbb1-b00d-477d-b074-a75eb380c2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:12.464644 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabbbbb1-b00d-477d-b074-a75eb380c2e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:12.465083 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabbbbb1-b00d-477d-b074-a75eb380c2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:12.465464 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabbbbb1-b00d-477d-b074-a75eb380c2e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:12.467793 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabbbbb1-b00d-477d-b074-a75eb380c2e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:12.469172 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabbbbb1-b00d-477d-b074-a75eb380c2e7 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:12.487518 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1045/2067] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:06:12.491246 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0db08d-5de1-4705-84ed-90030ca839f8 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:12.593644 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0db08d-5de1-4705-84ed-90030ca839f8 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:12.606131 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabbbbb1-b00d-477d-b074-a75eb380c2e7 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:12.606251 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3c87f-577d-43da-9cf5-17ecc4eb3b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:12.607311 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3c87f-577d-43da-9cf5-17ecc4eb3b7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:12.608097 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-dabbbbb1-b00d-477d-b074-a75eb380c2e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:12.609075 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3c87f-577d-43da-9cf5-17ecc4eb3b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:12.610117 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3c87f-577d-43da-9cf5-17ecc4eb3b7e admin admin] PATH_INFO: `/v3/projects/c94ef85427e545e0819e8573c24b7afa/users/47a2276547fb4d70b3f5c8f630fdfbac/roles/681755518698445fabd9a8accec13c0f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:12.613690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3c87f-577d-43da-9cf5-17ecc4eb3b7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c94ef85427e545e0819e8573c24b7afa, user_id=47a2276547fb4d70b3f5c8f630fdfbac, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:12.619680 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3c87f-577d-43da-9cf5-17ecc4eb3b7e admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:12.653019 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1023/2068] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:06:12 2022] PUT /identity/v3/projects/c94ef85427e545e0819e8573c24b7afa/users/47a2276547fb4d70b3f5c8f630fdfbac/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:12.657097 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ccd84-76dd-4d6f-b0b8-30875e49fbe4 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:12.657555 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ccd84-76dd-4d6f-b0b8-30875e49fbe4 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:12.657838 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ccd84-76dd-4d6f-b0b8-30875e49fbe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:12.755994 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-c57ccd84-76dd-4d6f-b0b8-30875e49fbe4 None None] MFA Rules not processed for user `47a2276547fb4d70b3f5c8f630fdfbac`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:12.758001 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-c57ccd84-76dd-4d6f-b0b8-30875e49fbe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:12.804815 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabbbbb1-b00d-477d-b074-a75eb380c2e7 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:12.904023 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a3ca9-0d1b-4e81-b5f3-43bd88fa449f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:12.904707 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a3ca9-0d1b-4e81-b5f3-43bd88fa449f service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:12.904988 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a3ca9-0d1b-4e81-b5f3-43bd88fa449f service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:12.905262 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a3ca9-0d1b-4e81-b5f3-43bd88fa449f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:12.907283 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-414a3ca9-0d1b-4e81-b5f3-43bd88fa449f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:12.957272 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1024/2069] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:12 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:12.981710 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ccd84-76dd-4d6f-b0b8-30875e49fbe4 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:12.983401 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-c57ccd84-76dd-4d6f-b0b8-30875e49fbe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:12.997327 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ccd84-76dd-4d6f-b0b8-30875e49fbe4 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:13.002576 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851dd98-f252-4174-8ec5-a1cfbe417426 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:13.004217 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851dd98-f252-4174-8ec5-a1cfbe417426 service cinder] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:13.004514 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851dd98-f252-4174-8ec5-a1cfbe417426 service cinder] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:13.004794 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851dd98-f252-4174-8ec5-a1cfbe417426 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:13.022188 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414a3ca9-0d1b-4e81-b5f3-43bd88fa449f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:13.024332 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414a3ca9-0d1b-4e81-b5f3-43bd88fa449f service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:13.048889 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1046/2070] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:06:12 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:06:13.088186 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:13.133777 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8851dd98-f252-4174-8ec5-a1cfbe417426 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:13.135579 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8851dd98-f252-4174-8ec5-a1cfbe417426 service cinder] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:13.156959 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1025/2071] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:06:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:06:13.893172 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d4a72-9085-46ec-b888-daae647f66ec None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:13.893994 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d4a72-9085-46ec-b888-daae647f66ec None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:13.893994 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d4a72-9085-46ec-b888-daae647f66ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:13.987478 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-b78d4a72-9085-46ec-b888-daae647f66ec None None] MFA Rules not processed for user `87d63f772da6431abd35221bc9efa038`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:13.990159 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b78d4a72-9085-46ec-b888-daae647f66ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:14.139707 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1047/2072] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:14.350852 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851dd98-f252-4174-8ec5-a1cfbe417426 service cinder] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:14.374116 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851dd98-f252-4174-8ec5-a1cfbe417426 service cinder] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:14.377818 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca5e43-6dd4-4560-a895-3329733bcfc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:14.379730 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca5e43-6dd4-4560-a895-3329733bcfc9 service cinder] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:14.380673 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca5e43-6dd4-4560-a895-3329733bcfc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:14.381698 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca5e43-6dd4-4560-a895-3329733bcfc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:14.384846 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d4a72-9085-46ec-b888-daae647f66ec None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:14.406759 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca5e43-6dd4-4560-a895-3329733bcfc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:14.410919 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca5e43-6dd4-4560-a895-3329733bcfc9 service cinder] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:14.423642 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d4a72-9085-46ec-b888-daae647f66ec None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:14.434685 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd31aae8-5b34-4707-b105-b924c75105d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:14.435715 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31aae8-5b34-4707-b105-b924c75105d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:14.436198 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31aae8-5b34-4707-b105-b924c75105d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:14.436669 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31aae8-5b34-4707-b105-b924c75105d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:14.438656 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1026/2073] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:06:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:06:14.452234 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-cd31aae8-5b34-4707-b105-b924c75105d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:14.615855 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd31aae8-5b34-4707-b105-b924c75105d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:14.619933 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd31aae8-5b34-4707-b105-b924c75105d8 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:14.647712 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1048/2074] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:06:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:06:15.569172 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159cad9-6504-4947-a10a-35f7191c9c28 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:15.569748 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159cad9-6504-4947-a10a-35f7191c9c28 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:15.569855 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159cad9-6504-4947-a10a-35f7191c9c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:15.613373 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-c159cad9-6504-4947-a10a-35f7191c9c28 None None] MFA Rules not processed for user `9afe0c6c75c44f7e98d2e5d19b45912c`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:15.615557 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-c159cad9-6504-4947-a10a-35f7191c9c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:15.711098 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:15.790996 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1027/2075] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:15.808541 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd31aae8-5b34-4707-b105-b924c75105d8 service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:15.810129 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-cd31aae8-5b34-4707-b105-b924c75105d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:15.955041 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd31aae8-5b34-4707-b105-b924c75105d8 service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:15.961529 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec11b4b-d01f-45e3-8c79-faa819c32fd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:15.962508 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec11b4b-d01f-45e3-8c79-faa819c32fd0 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:15.962894 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec11b4b-d01f-45e3-8c79-faa819c32fd0 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:15.963276 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec11b4b-d01f-45e3-8c79-faa819c32fd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:15.973163 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec11b4b-d01f-45e3-8c79-faa819c32fd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:15.975792 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec11b4b-d01f-45e3-8c79-faa819c32fd0 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:15.993771 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1049/2076] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:06:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:06:16.591549 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c159cad9-6504-4947-a10a-35f7191c9c28 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:16.611381 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c159cad9-6504-4947-a10a-35f7191c9c28 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:16.617814 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068213d1-8940-487b-944e-e386eadeaa9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:16.618937 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068213d1-8940-487b-944e-e386eadeaa9a service cinder] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:16.619644 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068213d1-8940-487b-944e-e386eadeaa9a service cinder] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:16.620755 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068213d1-8940-487b-944e-e386eadeaa9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:16.634780 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068213d1-8940-487b-944e-e386eadeaa9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:16.637748 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068213d1-8940-487b-944e-e386eadeaa9a service cinder] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:16.656516 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1028/2077] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:06:16 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:06:17.045713 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dbc5c4-5f2a-45de-94cb-0d0b0c0fab43 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:17.046570 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dbc5c4-5f2a-45de-94cb-0d0b0c0fab43 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:17.047100 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dbc5c4-5f2a-45de-94cb-0d0b0c0fab43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:17.065403 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-35dbc5c4-5f2a-45de-94cb-0d0b0c0fab43 None None] MFA Rules not processed for user `87d63f772da6431abd35221bc9efa038`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:17.066796 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-35dbc5c4-5f2a-45de-94cb-0d0b0c0fab43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:17.075745 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1050/2078] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 04:06:17.314149 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:17.608598 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068213d1-8940-487b-944e-e386eadeaa9a service cinder] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:17.610936 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-068213d1-8940-487b-944e-e386eadeaa9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:17.726287 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068213d1-8940-487b-944e-e386eadeaa9a service cinder] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:17.732732 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed07892-4d23-4ede-85fe-5b26f9910089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:17.733697 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed07892-4d23-4ede-85fe-5b26f9910089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:17.734296 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed07892-4d23-4ede-85fe-5b26f9910089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:17.734296 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed07892-4d23-4ede-85fe-5b26f9910089 admin admin] PATH_INFO: `/v3/users/18aeb3e057df4d3296259904786b422b` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:17.739079 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed07892-4d23-4ede-85fe-5b26f9910089 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18aeb3e057df4d3296259904786b422b)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:17.742054 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed07892-4d23-4ede-85fe-5b26f9910089 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:18.219169 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-9ed07892-4d23-4ede-85fe-5b26f9910089 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18aeb3e057df4d3296259904786b422b'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:18.219169 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-9ed07892-4d23-4ede-85fe-5b26f9910089 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18aeb3e057df4d3296259904786b422b'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:18.326335 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-9ed07892-4d23-4ede-85fe-5b26f9910089 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18aeb3e057df4d3296259904786b422b'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:18.327913 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-9ed07892-4d23-4ede-85fe-5b26f9910089 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18aeb3e057df4d3296259904786b422b'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:18.342478 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-9ed07892-4d23-4ede-85fe-5b26f9910089 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18aeb3e057df4d3296259904786b422b'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:18.402571 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1029/2079] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:06:17 2022] DELETE /identity/v3/users/18aeb3e057df4d3296259904786b422b => generated 0 bytes in 792 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:18.406289 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f2a39-2d0e-49b3-8174-d666b8d1aeeb None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:18.406835 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f2a39-2d0e-49b3-8174-d666b8d1aeeb None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:18.406835 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f2a39-2d0e-49b3-8174-d666b8d1aeeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:18.448952 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-6e0f2a39-2d0e-49b3-8174-d666b8d1aeeb None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:18.450229 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-6e0f2a39-2d0e-49b3-8174-d666b8d1aeeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:18.665006 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1051/2080] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:18.682312 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed07892-4d23-4ede-85fe-5b26f9910089 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:18.685429 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-9ed07892-4d23-4ede-85fe-5b26f9910089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:18.864754 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed07892-4d23-4ede-85fe-5b26f9910089 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:18.869964 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65f589-1176-4687-b3ae-00f8c272f746 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:18.871657 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65f589-1176-4687-b3ae-00f8c272f746 service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:18.872161 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65f589-1176-4687-b3ae-00f8c272f746 service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:18.872590 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65f589-1176-4687-b3ae-00f8c272f746 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:18.897172 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e65f589-1176-4687-b3ae-00f8c272f746 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:18.900458 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e65f589-1176-4687-b3ae-00f8c272f746 service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:18.915765 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1030/2081] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:06:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:06:19.681618 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f2a39-2d0e-49b3-8174-d666b8d1aeeb None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:19.687361 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-6e0f2a39-2d0e-49b3-8174-d666b8d1aeeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:19.704201 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f2a39-2d0e-49b3-8174-d666b8d1aeeb None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:19.712637 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1da9c-949d-400a-92c0-52a6513abdd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:19.715014 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1da9c-949d-400a-92c0-52a6513abdd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:19.716082 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1da9c-949d-400a-92c0-52a6513abdd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:19.716585 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1da9c-949d-400a-92c0-52a6513abdd2 admin admin] PATH_INFO: `/v3/projects/1bf904f683434235aa89ee86393d124d` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:19.720110 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a1da9c-949d-400a-92c0-52a6513abdd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bf904f683434235aa89ee86393d124d)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:19.723078 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a1da9c-949d-400a-92c0-52a6513abdd2 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:20.002427 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-28a1da9c-949d-400a-92c0-52a6513abdd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bf904f683434235aa89ee86393d124d', 'request_id': 'req-28a1da9c-949d-400a-92c0-52a6513abdd2'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:20.124397 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:20.124397 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-28a1da9c-949d-400a-92c0-52a6513abdd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bf904f683434235aa89ee86393d124d', 'request_id': 'req-28a1da9c-949d-400a-92c0-52a6513abdd2'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:20.131964 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-28a1da9c-949d-400a-92c0-52a6513abdd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bf904f683434235aa89ee86393d124d', 'request_id': 'req-28a1da9c-949d-400a-92c0-52a6513abdd2'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:20.144687 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-28a1da9c-949d-400a-92c0-52a6513abdd2 admin admin] The token cache is being invalidate because project 1bf904f683434235aa89ee86393d124d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:06:20.144977 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-28a1da9c-949d-400a-92c0-52a6513abdd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:20.145721 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-28a1da9c-949d-400a-92c0-52a6513abdd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:20.147419 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1052/2082] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:06:19 2022] DELETE /identity/v3/projects/1bf904f683434235aa89ee86393d124d => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:20.151256 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65f589-1176-4687-b3ae-00f8c272f746 service neutron] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:20.162573 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65f589-1176-4687-b3ae-00f8c272f746 service neutron] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:20.242021 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c99e584-fdcb-4c5a-bacf-16b159672614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:20.243009 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99e584-fdcb-4c5a-bacf-16b159672614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:20.243346 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99e584-fdcb-4c5a-bacf-16b159672614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:20.243722 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99e584-fdcb-4c5a-bacf-16b159672614 admin admin] PATH_INFO: `/v3/users/60a711f7b96444cc89d151eaf319da97` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:20.245115 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c99e584-fdcb-4c5a-bacf-16b159672614 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60a711f7b96444cc89d151eaf319da97)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:20.247169 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c99e584-fdcb-4c5a-bacf-16b159672614 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:20.351961 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a07d6-24a2-48c7-81b3-0aba7a88a5a7 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:20.352768 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a07d6-24a2-48c7-81b3-0aba7a88a5a7 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:20.353069 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a07d6-24a2-48c7-81b3-0aba7a88a5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:20.377794 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-278a07d6-24a2-48c7-81b3-0aba7a88a5a7 None None] MFA Rules not processed for user `9afe0c6c75c44f7e98d2e5d19b45912c`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:20.379201 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-278a07d6-24a2-48c7-81b3-0aba7a88a5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:20.448380 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1053/2083] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 04:06:20.579636 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-3c99e584-fdcb-4c5a-bacf-16b159672614 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60a711f7b96444cc89d151eaf319da97'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:20.580356 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-3c99e584-fdcb-4c5a-bacf-16b159672614 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60a711f7b96444cc89d151eaf319da97'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:20.677069 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-3c99e584-fdcb-4c5a-bacf-16b159672614 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60a711f7b96444cc89d151eaf319da97'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:20.678410 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-3c99e584-fdcb-4c5a-bacf-16b159672614 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60a711f7b96444cc89d151eaf319da97'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:20.691958 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-3c99e584-fdcb-4c5a-bacf-16b159672614 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60a711f7b96444cc89d151eaf319da97'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:20.734698 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1031/2084] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:06:20 2022] DELETE /identity/v3/users/60a711f7b96444cc89d151eaf319da97 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:20.912382 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a07d6-24a2-48c7-81b3-0aba7a88a5a7 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:20.914507 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-278a07d6-24a2-48c7-81b3-0aba7a88a5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:20.941719 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a07d6-24a2-48c7-81b3-0aba7a88a5a7 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:21.067733 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0284b868-1e48-4d85-92c3-f0ee04aea28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:21.068735 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284b868-1e48-4d85-92c3-f0ee04aea28c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:21.069022 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284b868-1e48-4d85-92c3-f0ee04aea28c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:21.069300 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284b868-1e48-4d85-92c3-f0ee04aea28c admin admin] PATH_INFO: `/v3/users/d7f6cc904a504e6f8abbd880c9f044d0` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:21.070840 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0284b868-1e48-4d85-92c3-f0ee04aea28c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7f6cc904a504e6f8abbd880c9f044d0)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:21.073329 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0284b868-1e48-4d85-92c3-f0ee04aea28c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:21.330015 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0284b868-1e48-4d85-92c3-f0ee04aea28c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7f6cc904a504e6f8abbd880c9f044d0'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:21.331051 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0284b868-1e48-4d85-92c3-f0ee04aea28c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7f6cc904a504e6f8abbd880c9f044d0'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:21.348003 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0284b868-1e48-4d85-92c3-f0ee04aea28c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7f6cc904a504e6f8abbd880c9f044d0'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:21.357876 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0284b868-1e48-4d85-92c3-f0ee04aea28c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7f6cc904a504e6f8abbd880c9f044d0'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:21.359498 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0284b868-1e48-4d85-92c3-f0ee04aea28c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7f6cc904a504e6f8abbd880c9f044d0'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:21.465026 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c99e584-fdcb-4c5a-bacf-16b159672614 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:21.468525 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-3c99e584-fdcb-4c5a-bacf-16b159672614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:21.471439 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1054/2085] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:06:20 2022] DELETE /identity/v3/users/d7f6cc904a504e6f8abbd880c9f044d0 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:21.482774 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1123a8-20c9-46f5-8623-deb6b7868dac None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:21.483381 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1123a8-20c9-46f5-8623-deb6b7868dac None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:21.483892 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1123a8-20c9-46f5-8623-deb6b7868dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:21.512130 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c99e584-fdcb-4c5a-bacf-16b159672614 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:21.515934 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-5a1123a8-20c9-46f5-8623-deb6b7868dac None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:21.517383 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-5a1123a8-20c9-46f5-8623-deb6b7868dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:21.619148 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1055/2086] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:21.631479 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1123a8-20c9-46f5-8623-deb6b7868dac None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:21.632918 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-5a1123a8-20c9-46f5-8623-deb6b7868dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:21.641551 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c4a690-28a1-4087-b554-57d0fad28b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:21.642985 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4a690-28a1-4087-b554-57d0fad28b33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:21.643512 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4a690-28a1-4087-b554-57d0fad28b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:21.643883 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4a690-28a1-4087-b554-57d0fad28b33 admin admin] PATH_INFO: `/v3/projects/50b5d9e2d227453ba1f2c4cf6b8ab7d3` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:21.645635 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c4a690-28a1-4087-b554-57d0fad28b33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50b5d9e2d227453ba1f2c4cf6b8ab7d3)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:21.648840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c4a690-28a1-4087-b554-57d0fad28b33 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:21.653531 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:21.722344 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1123a8-20c9-46f5-8623-deb6b7868dac None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:21.735983 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb0827-124d-401d-8ddd-ebf587468b47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:21.737198 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb0827-124d-401d-8ddd-ebf587468b47 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:21.737709 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb0827-124d-401d-8ddd-ebf587468b47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:21.738288 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb0827-124d-401d-8ddd-ebf587468b47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:21.752368 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb0827-124d-401d-8ddd-ebf587468b47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:21.754497 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb0827-124d-401d-8ddd-ebf587468b47 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:21.768571 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1056/2087] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:06:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 04:06:21.793185 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb0827-124d-401d-8ddd-ebf587468b47 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:21.794775 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0dfb0827-124d-401d-8ddd-ebf587468b47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:21.809531 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb0827-124d-401d-8ddd-ebf587468b47 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:21.820433 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb15dd-893f-427a-98f9-9227e585a62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:21.821349 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb15dd-893f-427a-98f9-9227e585a62f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:21.821637 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb15dd-893f-427a-98f9-9227e585a62f admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:21.821987 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb15dd-893f-427a-98f9-9227e585a62f admin admin] PATH_INFO: `/v3/users/a6e10e4b7caf4251922469abac752490` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:21.824249 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb15dd-893f-427a-98f9-9227e585a62f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6e10e4b7caf4251922469abac752490)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:21.826211 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb15dd-893f-427a-98f9-9227e585a62f admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:21.921711 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-52c4a690-28a1-4087-b554-57d0fad28b33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50b5d9e2d227453ba1f2c4cf6b8ab7d3', 'request_id': 'req-52c4a690-28a1-4087-b554-57d0fad28b33'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:21.929130 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-52c4a690-28a1-4087-b554-57d0fad28b33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50b5d9e2d227453ba1f2c4cf6b8ab7d3', 'request_id': 'req-52c4a690-28a1-4087-b554-57d0fad28b33'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:21.935395 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-52c4a690-28a1-4087-b554-57d0fad28b33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50b5d9e2d227453ba1f2c4cf6b8ab7d3', 'request_id': 'req-52c4a690-28a1-4087-b554-57d0fad28b33'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:22.144667 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-52c4a690-28a1-4087-b554-57d0fad28b33 admin admin] The token cache is being invalidate because project 50b5d9e2d227453ba1f2c4cf6b8ab7d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:06:22.150653 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-52c4a690-28a1-4087-b554-57d0fad28b33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:22.150653 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-52c4a690-28a1-4087-b554-57d0fad28b33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:22.150653 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1032/2088] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:06:21 2022] DELETE /identity/v3/projects/50b5d9e2d227453ba1f2c4cf6b8ab7d3 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:06:22.154160 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871dc099-054a-49be-8d30-13d8b7c34995 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:22.154418 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871dc099-054a-49be-8d30-13d8b7c34995 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:22.154981 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871dc099-054a-49be-8d30-13d8b7c34995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:22.203288 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-871dc099-054a-49be-8d30-13d8b7c34995 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:22.204572 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-871dc099-054a-49be-8d30-13d8b7c34995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:22.287095 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1033/2089] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:22.288731 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4dbd65-298d-47c8-b5de-52df8e4d369b None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:22.289070 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4dbd65-298d-47c8-b5de-52df8e4d369b None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:22.289634 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4dbd65-298d-47c8-b5de-52df8e4d369b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:22.325047 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b4eb15dd-893f-427a-98f9-9227e585a62f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6e10e4b7caf4251922469abac752490'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:22.327012 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b4eb15dd-893f-427a-98f9-9227e585a62f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6e10e4b7caf4251922469abac752490'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:22.334427 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-ff4dbd65-298d-47c8-b5de-52df8e4d369b None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:22.336040 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-ff4dbd65-298d-47c8-b5de-52df8e4d369b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:22.347596 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1034/2090] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:22.353674 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4dbd65-298d-47c8-b5de-52df8e4d369b None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:22.356452 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b4eb15dd-893f-427a-98f9-9227e585a62f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6e10e4b7caf4251922469abac752490'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:22.361617 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4dbd65-298d-47c8-b5de-52df8e4d369b None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:22.367159 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91171980-c217-46c0-8bb6-9284f9d6c694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:22.367431 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b4eb15dd-893f-427a-98f9-9227e585a62f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6e10e4b7caf4251922469abac752490'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:22.367890 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91171980-c217-46c0-8bb6-9284f9d6c694 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:22.368183 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91171980-c217-46c0-8bb6-9284f9d6c694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:22.368356 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b4eb15dd-893f-427a-98f9-9227e585a62f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6e10e4b7caf4251922469abac752490'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:22.368499 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91171980-c217-46c0-8bb6-9284f9d6c694 admin admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:22.370295 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91171980-c217-46c0-8bb6-9284f9d6c694 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:06:22.370619 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91171980-c217-46c0-8bb6-9284f9d6c694 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:22.372332 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91171980-c217-46c0-8bb6-9284f9d6c694 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:22.398371 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1035/2091] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 04:06:22.403962 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91171980-c217-46c0-8bb6-9284f9d6c694 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:22.422421 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91171980-c217-46c0-8bb6-9284f9d6c694 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:22.427908 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65500247-ede3-4f61-85e9-ac1fb8c69ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:22.428720 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65500247-ede3-4f61-85e9-ac1fb8c69ed3 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:22.429107 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65500247-ede3-4f61-85e9-ac1fb8c69ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:22.429464 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65500247-ede3-4f61-85e9-ac1fb8c69ed3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:22.430335 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65500247-ede3-4f61-85e9-ac1fb8c69ed3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:22.434208 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65500247-ede3-4f61-85e9-ac1fb8c69ed3 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:22.465983 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1057/2092] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:06:21 2022] DELETE /identity/v3/users/a6e10e4b7caf4251922469abac752490 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:06:22.470433 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552cd07b-5132-4897-9338-3dcad1372f4a None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:22.471127 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552cd07b-5132-4897-9338-3dcad1372f4a None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:22.471641 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552cd07b-5132-4897-9338-3dcad1372f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:22.513548 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-552cd07b-5132-4897-9338-3dcad1372f4a None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:22.516249 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-552cd07b-5132-4897-9338-3dcad1372f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:22.604547 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1036/2093] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:06:22 2022] POST /identity/v3/projects => generated 365 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:06:22.605507 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65500247-ede3-4f61-85e9-ac1fb8c69ed3 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:22.608400 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-65500247-ede3-4f61-85e9-ac1fb8c69ed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:22.643221 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1058/2094] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 04:06:22.644341 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552cd07b-5132-4897-9338-3dcad1372f4a None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:22.683938 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552cd07b-5132-4897-9338-3dcad1372f4a None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:22.784546 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c25cd0-180c-4c24-804b-5ee15848f0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:22.785740 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c25cd0-180c-4c24-804b-5ee15848f0cf admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:22.786067 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c25cd0-180c-4c24-804b-5ee15848f0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:22.786494 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c25cd0-180c-4c24-804b-5ee15848f0cf admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:22.787266 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c25cd0-180c-4c24-804b-5ee15848f0cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:22.790657 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c25cd0-180c-4c24-804b-5ee15848f0cf admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:22.804683 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65500247-ede3-4f61-85e9-ac1fb8c69ed3 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:22.815361 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee752ba-696d-489e-9cc6-c4a0ec6b03d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:22.816934 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee752ba-696d-489e-9cc6-c4a0ec6b03d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:22.817598 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee752ba-696d-489e-9cc6-c4a0ec6b03d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:22.818121 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee752ba-696d-489e-9cc6-c4a0ec6b03d9 admin admin] PATH_INFO: `/v3/projects/0fa6595880a1408eaa69624e6b7dd04c` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:22.820524 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee752ba-696d-489e-9cc6-c4a0ec6b03d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fa6595880a1408eaa69624e6b7dd04c)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:22.824853 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee752ba-696d-489e-9cc6-c4a0ec6b03d9 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:23.016411 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1059/2095] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:06:22 2022] POST /identity/v3/users => generated 283 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:06:23.016411 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c25cd0-180c-4c24-804b-5ee15848f0cf admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:23.022339 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-45c25cd0-180c-4c24-804b-5ee15848f0cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:23.033883 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-aee752ba-696d-489e-9cc6-c4a0ec6b03d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fa6595880a1408eaa69624e6b7dd04c', 'request_id': 'req-aee752ba-696d-489e-9cc6-c4a0ec6b03d9'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:23.045600 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-aee752ba-696d-489e-9cc6-c4a0ec6b03d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fa6595880a1408eaa69624e6b7dd04c', 'request_id': 'req-aee752ba-696d-489e-9cc6-c4a0ec6b03d9'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:23.061021 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-aee752ba-696d-489e-9cc6-c4a0ec6b03d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fa6595880a1408eaa69624e6b7dd04c', 'request_id': 'req-aee752ba-696d-489e-9cc6-c4a0ec6b03d9'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:23.170417 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-aee752ba-696d-489e-9cc6-c4a0ec6b03d9 admin admin] The token cache is being invalidate because project 0fa6595880a1408eaa69624e6b7dd04c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:06:23.171059 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-aee752ba-696d-489e-9cc6-c4a0ec6b03d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:23.172352 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-aee752ba-696d-489e-9cc6-c4a0ec6b03d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:23.174406 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c25cd0-180c-4c24-804b-5ee15848f0cf admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:23.174923 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1037/2096] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:06:22 2022] DELETE /identity/v3/projects/0fa6595880a1408eaa69624e6b7dd04c => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:23.176748 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee752ba-696d-489e-9cc6-c4a0ec6b03d9 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:23.179018 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-aee752ba-696d-489e-9cc6-c4a0ec6b03d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:23.247996 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee42635-25f6-40ab-b272-566d379f42ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:23.249013 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee42635-25f6-40ab-b272-566d379f42ca service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:23.250163 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee42635-25f6-40ab-b272-566d379f42ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:23.250656 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee42635-25f6-40ab-b272-566d379f42ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:23.253510 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-fee42635-25f6-40ab-b272-566d379f42ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:23.312103 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee752ba-696d-489e-9cc6-c4a0ec6b03d9 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:23.320964 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc74ff-700b-49f0-87e8-f156f5a4c81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:23.322289 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc74ff-700b-49f0-87e8-f156f5a4c81d admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:23.322962 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc74ff-700b-49f0-87e8-f156f5a4c81d admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:23.323657 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc74ff-700b-49f0-87e8-f156f5a4c81d admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:23.325589 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc74ff-700b-49f0-87e8-f156f5a4c81d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:23.327627 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc74ff-700b-49f0-87e8-f156f5a4c81d admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:23.338177 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee42635-25f6-40ab-b272-566d379f42ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:23.340435 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee42635-25f6-40ab-b272-566d379f42ca service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:23.347621 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1038/2097] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:06:23.349518 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc74ff-700b-49f0-87e8-f156f5a4c81d admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:23.353411 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1060/2098] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:06:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:06:23.355496 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee42635-25f6-40ab-b272-566d379f42ca service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:23.357302 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-fbfc74ff-700b-49f0-87e8-f156f5a4c81d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:23.366914 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee42635-25f6-40ab-b272-566d379f42ca service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:23.374392 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9b2e8-a7c2-46f8-974f-a390a170786d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:23.375580 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9b2e8-a7c2-46f8-974f-a390a170786d admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:23.376023 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9b2e8-a7c2-46f8-974f-a390a170786d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:23.376306 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9b2e8-a7c2-46f8-974f-a390a170786d admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:23.377116 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c9b2e8-a7c2-46f8-974f-a390a170786d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:23.378994 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c9b2e8-a7c2-46f8-974f-a390a170786d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:23.380726 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc74ff-700b-49f0-87e8-f156f5a4c81d admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:23.390189 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae58efca-a9c6-4f77-8d92-2f2c99f8d395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:23.390189 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58efca-a9c6-4f77-8d92-2f2c99f8d395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:23.390189 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58efca-a9c6-4f77-8d92-2f2c99f8d395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:23.390189 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58efca-a9c6-4f77-8d92-2f2c99f8d395 admin admin] PATH_INFO: `/v3/users/bb2d731613424c818836fd97600d0365` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:23.393180 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae58efca-a9c6-4f77-8d92-2f2c99f8d395 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb2d731613424c818836fd97600d0365)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:23.395222 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae58efca-a9c6-4f77-8d92-2f2c99f8d395 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:23.398341 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1061/2099] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:06:23.402862 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9b2e8-a7c2-46f8-974f-a390a170786d admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:23.420052 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9b2e8-a7c2-46f8-974f-a390a170786d admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:23.426232 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9203f16-1478-4246-bead-49cd3491c346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:23.427286 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9203f16-1478-4246-bead-49cd3491c346 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:23.427701 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9203f16-1478-4246-bead-49cd3491c346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:23.428050 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9203f16-1478-4246-bead-49cd3491c346 admin admin] PATH_INFO: `/v3/projects/e068b1e58c42471391a569084933d89f/users/e794ba7f4fa04efea3008436127511b4/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:23.447894 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9203f16-1478-4246-bead-49cd3491c346 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e068b1e58c42471391a569084933d89f, user_id=e794ba7f4fa04efea3008436127511b4, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:23.452862 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9203f16-1478-4246-bead-49cd3491c346 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:23.537952 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1062/2100] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:06:23 2022] PUT /identity/v3/projects/e068b1e58c42471391a569084933d89f/users/e794ba7f4fa04efea3008436127511b4/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:23.539491 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9203f16-1478-4246-bead-49cd3491c346 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:23.543277 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c9203f16-1478-4246-bead-49cd3491c346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:23.646310 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9203f16-1478-4246-bead-49cd3491c346 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:23.651541 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad41251-6899-4d0a-8693-57ee6869b103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:23.655396 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad41251-6899-4d0a-8693-57ee6869b103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:23.655396 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad41251-6899-4d0a-8693-57ee6869b103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:23.655396 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad41251-6899-4d0a-8693-57ee6869b103 admin admin] PATH_INFO: `/v3/users/ffc289512e8445c0aa6d15886e1bc60d` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:23.655396 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad41251-6899-4d0a-8693-57ee6869b103 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffc289512e8445c0aa6d15886e1bc60d)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:23.656495 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad41251-6899-4d0a-8693-57ee6869b103 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:23.700036 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-ae58efca-a9c6-4f77-8d92-2f2c99f8d395 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb2d731613424c818836fd97600d0365'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:23.701308 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-ae58efca-a9c6-4f77-8d92-2f2c99f8d395 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb2d731613424c818836fd97600d0365'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:23.934870 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-ae58efca-a9c6-4f77-8d92-2f2c99f8d395 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb2d731613424c818836fd97600d0365'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:23.937447 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-ae58efca-a9c6-4f77-8d92-2f2c99f8d395 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb2d731613424c818836fd97600d0365'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:23.956873 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-ae58efca-a9c6-4f77-8d92-2f2c99f8d395 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb2d731613424c818836fd97600d0365'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:23.996891 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1039/2101] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:06:23 2022] DELETE /identity/v3/users/bb2d731613424c818836fd97600d0365 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:23.999081 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee7069-5a3e-46d8-bbdb-d2de6bbd8618 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:23.999381 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee7069-5a3e-46d8-bbdb-d2de6bbd8618 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:23.999526 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2ad41251-6899-4d0a-8693-57ee6869b103 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffc289512e8445c0aa6d15886e1bc60d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:23.999745 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee7069-5a3e-46d8-bbdb-d2de6bbd8618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:24.000801 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2ad41251-6899-4d0a-8693-57ee6869b103 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffc289512e8445c0aa6d15886e1bc60d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:24.019378 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2ad41251-6899-4d0a-8693-57ee6869b103 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffc289512e8445c0aa6d15886e1bc60d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:24.032728 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2ad41251-6899-4d0a-8693-57ee6869b103 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffc289512e8445c0aa6d15886e1bc60d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:24.034122 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2ad41251-6899-4d0a-8693-57ee6869b103 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffc289512e8445c0aa6d15886e1bc60d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:24.039244 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-1fee7069-5a3e-46d8-bbdb-d2de6bbd8618 None None] MFA Rules not processed for user `e794ba7f4fa04efea3008436127511b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:24.040572 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-1fee7069-5a3e-46d8-bbdb-d2de6bbd8618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:24.164079 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1063/2102] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:06:23 2022] DELETE /identity/v3/users/ffc289512e8445c0aa6d15886e1bc60d => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:24.168706 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad41251-6899-4d0a-8693-57ee6869b103 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:24.174439 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2ad41251-6899-4d0a-8693-57ee6869b103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:24.212634 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1040/2103] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:23 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:24.224160 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fee67-7b3f-48d9-b2af-31b8784635fc None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:24.224528 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fee67-7b3f-48d9-b2af-31b8784635fc None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:24.224864 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fee67-7b3f-48d9-b2af-31b8784635fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:24.244076 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:24.258748 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-9d8fee67-7b3f-48d9-b2af-31b8784635fc None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:24.260026 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-9d8fee67-7b3f-48d9-b2af-31b8784635fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:24.299868 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad41251-6899-4d0a-8693-57ee6869b103 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:24.306336 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4fe959-11fc-4d3f-a685-71bc0adfda36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:24.307656 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4fe959-11fc-4d3f-a685-71bc0adfda36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:24.308234 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4fe959-11fc-4d3f-a685-71bc0adfda36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:24.308667 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4fe959-11fc-4d3f-a685-71bc0adfda36 admin admin] PATH_INFO: `/v3/projects/fa76ae4b64de4604b08c4d0eecef9cbf` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:24.313960 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4fe959-11fc-4d3f-a685-71bc0adfda36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa76ae4b64de4604b08c4d0eecef9cbf)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:24.317031 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4fe959-11fc-4d3f-a685-71bc0adfda36 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:24.366853 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1041/2104] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:24.366853 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8fee67-7b3f-48d9-b2af-31b8784635fc None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:24.368469 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-9d8fee67-7b3f-48d9-b2af-31b8784635fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:24.384424 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8fee67-7b3f-48d9-b2af-31b8784635fc None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:24.392810 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd158a-6fbc-4563-8361-88a7913c8942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:24.393699 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd158a-6fbc-4563-8361-88a7913c8942 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:24.393985 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd158a-6fbc-4563-8361-88a7913c8942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:24.394260 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd158a-6fbc-4563-8361-88a7913c8942 admin admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:24.395199 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dd158a-6fbc-4563-8361-88a7913c8942 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:24.397483 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dd158a-6fbc-4563-8361-88a7913c8942 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:24.444268 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:24.503538 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1042/2105] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:06:24 2022] POST /identity/v3/projects => generated 365 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:06:24.504666 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd158a-6fbc-4563-8361-88a7913c8942 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:24.508486 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-f6dd158a-6fbc-4563-8361-88a7913c8942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:24.533328 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-de4fe959-11fc-4d3f-a685-71bc0adfda36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa76ae4b64de4604b08c4d0eecef9cbf', 'request_id': 'req-de4fe959-11fc-4d3f-a685-71bc0adfda36'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:24.625921 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-de4fe959-11fc-4d3f-a685-71bc0adfda36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa76ae4b64de4604b08c4d0eecef9cbf', 'request_id': 'req-de4fe959-11fc-4d3f-a685-71bc0adfda36'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:24.635436 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd158a-6fbc-4563-8361-88a7913c8942 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:24.637112 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1282c-6c79-4072-a115-c31c6d5c45b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:24.637970 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-de4fe959-11fc-4d3f-a685-71bc0adfda36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa76ae4b64de4604b08c4d0eecef9cbf', 'request_id': 'req-de4fe959-11fc-4d3f-a685-71bc0adfda36'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:24.640774 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1282c-6c79-4072-a115-c31c6d5c45b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:24.641295 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1282c-6c79-4072-a115-c31c6d5c45b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:24.641792 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1282c-6c79-4072-a115-c31c6d5c45b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:24.684159 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-de4fe959-11fc-4d3f-a685-71bc0adfda36 admin admin] The token cache is being invalidate because project fa76ae4b64de4604b08c4d0eecef9cbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:06:24.684860 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-de4fe959-11fc-4d3f-a685-71bc0adfda36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:24.685968 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-de4fe959-11fc-4d3f-a685-71bc0adfda36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:24.689943 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1064/2106] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:06:24 2022] DELETE /identity/v3/projects/fa76ae4b64de4604b08c4d0eecef9cbf => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:24.693349 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4fe959-11fc-4d3f-a685-71bc0adfda36 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:24.708772 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-de4fe959-11fc-4d3f-a685-71bc0adfda36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:24.813170 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d1282c-6c79-4072-a115-c31c6d5c45b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:24.814774 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d1282c-6c79-4072-a115-c31c6d5c45b2 service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:24.826887 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1043/2107] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:06:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:06:24.828091 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1282c-6c79-4072-a115-c31c6d5c45b2 service neutron] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:24.829551 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-f0d1282c-6c79-4072-a115-c31c6d5c45b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:24.848382 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1282c-6c79-4072-a115-c31c6d5c45b2 service neutron] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:24.852279 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4fe959-11fc-4d3f-a685-71bc0adfda36 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:24.857857 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9d747-b586-478b-a2c1-bf0caedaef13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:24.858556 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70a4a1-6ad4-4d03-8a59-8e20dde8bcef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:24.865529 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9d747-b586-478b-a2c1-bf0caedaef13 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:24.865529 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9d747-b586-478b-a2c1-bf0caedaef13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:24.865529 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9d747-b586-478b-a2c1-bf0caedaef13 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:24.865529 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c9d747-b586-478b-a2c1-bf0caedaef13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:24.866100 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70a4a1-6ad4-4d03-8a59-8e20dde8bcef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:24.866100 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70a4a1-6ad4-4d03-8a59-8e20dde8bcef admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:24.866100 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70a4a1-6ad4-4d03-8a59-8e20dde8bcef admin admin] PATH_INFO: `/v3/projects/d2e4a5d00ddc4037a5cb0c65dafa4efe` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:24.866491 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c9d747-b586-478b-a2c1-bf0caedaef13 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:24.866628 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a70a4a1-6ad4-4d03-8a59-8e20dde8bcef admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2e4a5d00ddc4037a5cb0c65dafa4efe)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:24.868321 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a70a4a1-6ad4-4d03-8a59-8e20dde8bcef admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:25.016826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1065/2108] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:06:24 2022] POST /identity/v3/users => generated 289 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:06:25.020032 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9d747-b586-478b-a2c1-bf0caedaef13 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:25.020032 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d0c9d747-b586-478b-a2c1-bf0caedaef13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:25.034400 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9d747-b586-478b-a2c1-bf0caedaef13 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:25.040496 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e0f2b2-acc6-4453-b52f-9986546a97e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:25.041625 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0f2b2-acc6-4453-b52f-9986546a97e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:25.042466 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0f2b2-acc6-4453-b52f-9986546a97e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:25.042919 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0f2b2-acc6-4453-b52f-9986546a97e7 admin admin] PATH_INFO: `/v3/users/3d1490c107ad47a0befce2db7e61c64b` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:25.045007 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e0f2b2-acc6-4453-b52f-9986546a97e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d1490c107ad47a0befce2db7e61c64b)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:25.064474 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e0f2b2-acc6-4453-b52f-9986546a97e7 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:25.139752 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-5a70a4a1-6ad4-4d03-8a59-8e20dde8bcef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2e4a5d00ddc4037a5cb0c65dafa4efe', 'request_id': 'req-5a70a4a1-6ad4-4d03-8a59-8e20dde8bcef'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:25.154669 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-5a70a4a1-6ad4-4d03-8a59-8e20dde8bcef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2e4a5d00ddc4037a5cb0c65dafa4efe', 'request_id': 'req-5a70a4a1-6ad4-4d03-8a59-8e20dde8bcef'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:25.161840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-5a70a4a1-6ad4-4d03-8a59-8e20dde8bcef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2e4a5d00ddc4037a5cb0c65dafa4efe', 'request_id': 'req-5a70a4a1-6ad4-4d03-8a59-8e20dde8bcef'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:25.288621 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-5a70a4a1-6ad4-4d03-8a59-8e20dde8bcef admin admin] The token cache is being invalidate because project d2e4a5d00ddc4037a5cb0c65dafa4efe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:06:25.288904 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-5a70a4a1-6ad4-4d03-8a59-8e20dde8bcef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:25.289616 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-5a70a4a1-6ad4-4d03-8a59-8e20dde8bcef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:25.291698 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1044/2109] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:06:24 2022] DELETE /identity/v3/projects/d2e4a5d00ddc4037a5cb0c65dafa4efe => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:25.293177 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70a4a1-6ad4-4d03-8a59-8e20dde8bcef admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:25.295141 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-5a70a4a1-6ad4-4d03-8a59-8e20dde8bcef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:25.373399 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-99e0f2b2-acc6-4453-b52f-9986546a97e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d1490c107ad47a0befce2db7e61c64b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:25.374343 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-99e0f2b2-acc6-4453-b52f-9986546a97e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d1490c107ad47a0befce2db7e61c64b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:25.437518 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70a4a1-6ad4-4d03-8a59-8e20dde8bcef admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:25.445582 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-99e0f2b2-acc6-4453-b52f-9986546a97e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d1490c107ad47a0befce2db7e61c64b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:25.454444 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1184a3f-de40-4f1e-9b1f-085ea4fe2c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:25.455869 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1184a3f-de40-4f1e-9b1f-085ea4fe2c29 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:25.456243 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1184a3f-de40-4f1e-9b1f-085ea4fe2c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:25.457696 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1184a3f-de40-4f1e-9b1f-085ea4fe2c29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:25.459386 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1184a3f-de40-4f1e-9b1f-085ea4fe2c29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:25.463288 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-99e0f2b2-acc6-4453-b52f-9986546a97e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d1490c107ad47a0befce2db7e61c64b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:25.465338 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-99e0f2b2-acc6-4453-b52f-9986546a97e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d1490c107ad47a0befce2db7e61c64b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:25.465782 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1184a3f-de40-4f1e-9b1f-085ea4fe2c29 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:25.488567 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1045/2110] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:06:25.489689 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1184a3f-de40-4f1e-9b1f-085ea4fe2c29 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:25.498096 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-c1184a3f-de40-4f1e-9b1f-085ea4fe2c29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:25.533483 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1184a3f-de40-4f1e-9b1f-085ea4fe2c29 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:25.540772 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e05b7-88f2-4930-903d-f2fc8333324e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:25.541998 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e05b7-88f2-4930-903d-f2fc8333324e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:25.542837 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e05b7-88f2-4930-903d-f2fc8333324e admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:25.543123 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e05b7-88f2-4930-903d-f2fc8333324e admin admin] PATH_INFO: `/v3/users/e56169a18f854eabad63978418088854` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:25.545393 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e05b7-88f2-4930-903d-f2fc8333324e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e56169a18f854eabad63978418088854)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:25.548179 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e05b7-88f2-4930-903d-f2fc8333324e admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:25.641657 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1066/2111] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:06:25 2022] DELETE /identity/v3/users/3d1490c107ad47a0befce2db7e61c64b => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:25.643033 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e0f2b2-acc6-4453-b52f-9986546a97e7 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:25.648496 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-99e0f2b2-acc6-4453-b52f-9986546a97e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:25.850113 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e0f2b2-acc6-4453-b52f-9986546a97e7 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:25.860398 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb7b0e9-da2a-46cd-88f8-f45515f0ba81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:25.887234 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7b0e9-da2a-46cd-88f8-f45515f0ba81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:25.887234 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7b0e9-da2a-46cd-88f8-f45515f0ba81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:25.887234 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7b0e9-da2a-46cd-88f8-f45515f0ba81 admin admin] PATH_INFO: `/v3/projects/7033571dd1714bfa9fce6da04a9298a5/users/d414cd6061ab47298319565deb9de8ae/roles/681755518698445fabd9a8accec13c0f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:25.887932 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-ac5e05b7-88f2-4930-903d-f2fc8333324e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e56169a18f854eabad63978418088854'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:25.890968 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-ac5e05b7-88f2-4930-903d-f2fc8333324e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e56169a18f854eabad63978418088854'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:25.897751 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb7b0e9-da2a-46cd-88f8-f45515f0ba81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7033571dd1714bfa9fce6da04a9298a5, user_id=d414cd6061ab47298319565deb9de8ae, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:25.900876 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb7b0e9-da2a-46cd-88f8-f45515f0ba81 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:26.363638 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-ac5e05b7-88f2-4930-903d-f2fc8333324e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e56169a18f854eabad63978418088854'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:26.366254 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-ac5e05b7-88f2-4930-903d-f2fc8333324e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e56169a18f854eabad63978418088854'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:26.381056 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1067/2112] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:06:25 2022] PUT /identity/v3/projects/7033571dd1714bfa9fce6da04a9298a5/users/d414cd6061ab47298319565deb9de8ae/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 738 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:26.383192 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb7b0e9-da2a-46cd-88f8-f45515f0ba81 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:26.395136 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9fb7b0e9-da2a-46cd-88f8-f45515f0ba81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:26.409531 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-ac5e05b7-88f2-4930-903d-f2fc8333324e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e56169a18f854eabad63978418088854'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:26.458440 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1046/2113] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:06:25 2022] DELETE /identity/v3/users/e56169a18f854eabad63978418088854 => generated 0 bytes in 969 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:26.459500 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e05b7-88f2-4930-903d-f2fc8333324e admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:26.461374 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-ac5e05b7-88f2-4930-903d-f2fc8333324e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:26.629927 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e05b7-88f2-4930-903d-f2fc8333324e admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:26.637098 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b280ae7-1762-4bf7-81d0-5bc722d385a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:26.637803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b280ae7-1762-4bf7-81d0-5bc722d385a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:26.638091 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b280ae7-1762-4bf7-81d0-5bc722d385a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:26.638577 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b280ae7-1762-4bf7-81d0-5bc722d385a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:26.639182 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b280ae7-1762-4bf7-81d0-5bc722d385a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:26.641040 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b280ae7-1762-4bf7-81d0-5bc722d385a6 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:26.678569 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1047/2114] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:06:26.681185 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb7b0e9-da2a-46cd-88f8-f45515f0ba81 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:26.681794 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b280ae7-1762-4bf7-81d0-5bc722d385a6 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:26.689750 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81f94c-d58e-42ed-a18b-94358e1a945b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:26.691166 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81f94c-d58e-42ed-a18b-94358e1a945b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:26.691561 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81f94c-d58e-42ed-a18b-94358e1a945b admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:26.691851 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81f94c-d58e-42ed-a18b-94358e1a945b admin admin] PATH_INFO: `/v3/projects/a2993989420f43c6be14e618552d872b` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:26.693529 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a81f94c-d58e-42ed-a18b-94358e1a945b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2993989420f43c6be14e618552d872b)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:26.694411 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b280ae7-1762-4bf7-81d0-5bc722d385a6 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:26.696503 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a81f94c-d58e-42ed-a18b-94358e1a945b admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:26.700648 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9dd320-f9b7-452a-b6a5-1a07b67b3a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:26.701948 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9dd320-f9b7-452a-b6a5-1a07b67b3a70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:26.702453 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9dd320-f9b7-452a-b6a5-1a07b67b3a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:26.702894 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9dd320-f9b7-452a-b6a5-1a07b67b3a70 admin admin] PATH_INFO: `/v3/projects/7033571dd1714bfa9fce6da04a9298a5/users/d414cd6061ab47298319565deb9de8ae/roles/681755518698445fabd9a8accec13c0f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:26.705771 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9dd320-f9b7-452a-b6a5-1a07b67b3a70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7033571dd1714bfa9fce6da04a9298a5, user_id=d414cd6061ab47298319565deb9de8ae, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:26.711760 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9dd320-f9b7-452a-b6a5-1a07b67b3a70 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:26.733858 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1048/2115] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:06:26 2022] PUT /identity/v3/projects/7033571dd1714bfa9fce6da04a9298a5/users/d414cd6061ab47298319565deb9de8ae/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:26.736673 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547de16-a8d6-4bc0-a93b-fc6db8967279 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:26.737303 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547de16-a8d6-4bc0-a93b-fc6db8967279 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:26.737795 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547de16-a8d6-4bc0-a93b-fc6db8967279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:26.775304 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-7547de16-a8d6-4bc0-a93b-fc6db8967279 None None] MFA Rules not processed for user `d414cd6061ab47298319565deb9de8ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:26.777120 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-7547de16-a8d6-4bc0-a93b-fc6db8967279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:26.869339 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-8a81f94c-d58e-42ed-a18b-94358e1a945b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2993989420f43c6be14e618552d872b', 'request_id': 'req-8a81f94c-d58e-42ed-a18b-94358e1a945b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:26.937588 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1049/2116] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:26 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 04:06:26.958488 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7547de16-a8d6-4bc0-a93b-fc6db8967279 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:26.962237 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-7547de16-a8d6-4bc0-a93b-fc6db8967279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:27.002244 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-8a81f94c-d58e-42ed-a18b-94358e1a945b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2993989420f43c6be14e618552d872b', 'request_id': 'req-8a81f94c-d58e-42ed-a18b-94358e1a945b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:27.011348 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-8a81f94c-d58e-42ed-a18b-94358e1a945b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2993989420f43c6be14e618552d872b', 'request_id': 'req-8a81f94c-d58e-42ed-a18b-94358e1a945b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:27.048264 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:27.054406 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-8a81f94c-d58e-42ed-a18b-94358e1a945b admin admin] The token cache is being invalidate because project a2993989420f43c6be14e618552d872b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:06:27.054711 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-8a81f94c-d58e-42ed-a18b-94358e1a945b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:27.055945 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-8a81f94c-d58e-42ed-a18b-94358e1a945b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:27.057800 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1068/2117] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:06:26 2022] DELETE /identity/v3/projects/a2993989420f43c6be14e618552d872b => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:27.064720 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81f94c-d58e-42ed-a18b-94358e1a945b admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:27.066212 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8a81f94c-d58e-42ed-a18b-94358e1a945b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:27.131762 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7547de16-a8d6-4bc0-a93b-fc6db8967279 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:27.135511 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:27.205243 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81f94c-d58e-42ed-a18b-94358e1a945b admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:27.221876 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5df85-90a7-4044-aa26-d895cd8acb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:27.223006 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5df85-90a7-4044-aa26-d895cd8acb74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:27.223551 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5df85-90a7-4044-aa26-d895cd8acb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:27.223828 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5df85-90a7-4044-aa26-d895cd8acb74 admin admin] PATH_INFO: `/v3/users/47a2276547fb4d70b3f5c8f630fdfbac` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:27.226159 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c5df85-90a7-4044-aa26-d895cd8acb74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47a2276547fb4d70b3f5c8f630fdfbac)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:27.229248 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c5df85-90a7-4044-aa26-d895cd8acb74 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:27.264141 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569f4b4-2afb-4f17-87ca-f0b361e74f17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:27.265669 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569f4b4-2afb-4f17-87ca-f0b361e74f17 service cinder] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:27.266131 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569f4b4-2afb-4f17-87ca-f0b361e74f17 service cinder] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:27.266745 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569f4b4-2afb-4f17-87ca-f0b361e74f17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:27.272487 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-2569f4b4-2afb-4f17-87ca-f0b361e74f17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:27.406620 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2569f4b4-2afb-4f17-87ca-f0b361e74f17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:27.409685 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2569f4b4-2afb-4f17-87ca-f0b361e74f17 service cinder] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:27.430624 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1050/2118] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:06:26 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:06:27.433196 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569f4b4-2afb-4f17-87ca-f0b361e74f17 service cinder] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:27.435123 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-2569f4b4-2afb-4f17-87ca-f0b361e74f17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:27.478518 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569f4b4-2afb-4f17-87ca-f0b361e74f17 service cinder] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:27.491439 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce393a-cb61-44bb-b1a9-a77eda3875a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:27.498477 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce393a-cb61-44bb-b1a9-a77eda3875a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:27.501771 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce393a-cb61-44bb-b1a9-a77eda3875a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:27.504780 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce393a-cb61-44bb-b1a9-a77eda3875a6 admin admin] PATH_INFO: `/v3/projects/1b8758048cd247ad9850217fb1463a23` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:27.508846 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bce393a-cb61-44bb-b1a9-a77eda3875a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b8758048cd247ad9850217fb1463a23)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:27.512330 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d1c5df85-90a7-4044-aa26-d895cd8acb74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47a2276547fb4d70b3f5c8f630fdfbac'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:27.514809 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d1c5df85-90a7-4044-aa26-d895cd8acb74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47a2276547fb4d70b3f5c8f630fdfbac'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:27.517272 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bce393a-cb61-44bb-b1a9-a77eda3875a6 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:27.566817 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d1c5df85-90a7-4044-aa26-d895cd8acb74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47a2276547fb4d70b3f5c8f630fdfbac'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:27.598134 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d1c5df85-90a7-4044-aa26-d895cd8acb74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47a2276547fb4d70b3f5c8f630fdfbac'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:27.603875 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d1c5df85-90a7-4044-aa26-d895cd8acb74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47a2276547fb4d70b3f5c8f630fdfbac'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:27.730868 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1069/2119] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:06:27 2022] DELETE /identity/v3/users/47a2276547fb4d70b3f5c8f630fdfbac => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:27.838505 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-2bce393a-cb61-44bb-b1a9-a77eda3875a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b8758048cd247ad9850217fb1463a23', 'request_id': 'req-2bce393a-cb61-44bb-b1a9-a77eda3875a6'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:27.860518 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-2bce393a-cb61-44bb-b1a9-a77eda3875a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b8758048cd247ad9850217fb1463a23', 'request_id': 'req-2bce393a-cb61-44bb-b1a9-a77eda3875a6'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:27.879617 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-2bce393a-cb61-44bb-b1a9-a77eda3875a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b8758048cd247ad9850217fb1463a23', 'request_id': 'req-2bce393a-cb61-44bb-b1a9-a77eda3875a6'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:27.905761 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:28.014089 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-2bce393a-cb61-44bb-b1a9-a77eda3875a6 admin admin] The token cache is being invalidate because project 1b8758048cd247ad9850217fb1463a23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:06:28.014908 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-2bce393a-cb61-44bb-b1a9-a77eda3875a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:28.020765 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-2bce393a-cb61-44bb-b1a9-a77eda3875a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:28.020765 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1051/2120] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:06:27 2022] DELETE /identity/v3/projects/1b8758048cd247ad9850217fb1463a23 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:28.022203 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5df85-90a7-4044-aa26-d895cd8acb74 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:28.024123 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d1c5df85-90a7-4044-aa26-d895cd8acb74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:28.166033 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5df85-90a7-4044-aa26-d895cd8acb74 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:28.242125 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce393a-cb61-44bb-b1a9-a77eda3875a6 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:28.244891 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-2bce393a-cb61-44bb-b1a9-a77eda3875a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:28.433727 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e784bc-b847-4574-9ff2-0ff3672b74c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:28.435252 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e784bc-b847-4574-9ff2-0ff3672b74c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:28.435776 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e784bc-b847-4574-9ff2-0ff3672b74c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:28.437898 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e784bc-b847-4574-9ff2-0ff3672b74c2 admin admin] PATH_INFO: `/v3/users/1e4ebd5d64c546c0989d859e98f9fb2b` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:28.438630 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce393a-cb61-44bb-b1a9-a77eda3875a6 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:28.440490 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e784bc-b847-4574-9ff2-0ff3672b74c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e4ebd5d64c546c0989d859e98f9fb2b)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:28.444900 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e784bc-b847-4574-9ff2-0ff3672b74c2 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:28.449939 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe81b7-18d8-4a4e-b323-cfca2026b154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:28.452066 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe81b7-18d8-4a4e-b323-cfca2026b154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:28.452723 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe81b7-18d8-4a4e-b323-cfca2026b154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:28.453396 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe81b7-18d8-4a4e-b323-cfca2026b154 admin admin] PATH_INFO: `/v3/projects/358293a86b4941039d23c3987ddea75f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:28.460970 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fe81b7-18d8-4a4e-b323-cfca2026b154 admin admin] RBAC: Authorizing `identity:delete_project(project_id=358293a86b4941039d23c3987ddea75f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:28.462532 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fe81b7-18d8-4a4e-b323-cfca2026b154 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:28.729567 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-72fe81b7-18d8-4a4e-b323-cfca2026b154 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '358293a86b4941039d23c3987ddea75f', 'request_id': 'req-72fe81b7-18d8-4a4e-b323-cfca2026b154'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:28.737705 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-72fe81b7-18d8-4a4e-b323-cfca2026b154 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '358293a86b4941039d23c3987ddea75f', 'request_id': 'req-72fe81b7-18d8-4a4e-b323-cfca2026b154'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:28.747429 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-72fe81b7-18d8-4a4e-b323-cfca2026b154 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '358293a86b4941039d23c3987ddea75f', 'request_id': 'req-72fe81b7-18d8-4a4e-b323-cfca2026b154'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:28.887354 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a6e784bc-b847-4574-9ff2-0ff3672b74c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e4ebd5d64c546c0989d859e98f9fb2b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:28.888175 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a6e784bc-b847-4574-9ff2-0ff3672b74c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e4ebd5d64c546c0989d859e98f9fb2b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:28.903710 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a6e784bc-b847-4574-9ff2-0ff3672b74c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e4ebd5d64c546c0989d859e98f9fb2b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:28.916123 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a6e784bc-b847-4574-9ff2-0ff3672b74c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e4ebd5d64c546c0989d859e98f9fb2b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:28.917769 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a6e784bc-b847-4574-9ff2-0ff3672b74c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e4ebd5d64c546c0989d859e98f9fb2b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:28.962656 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-72fe81b7-18d8-4a4e-b323-cfca2026b154 admin admin] The token cache is being invalidate because project 358293a86b4941039d23c3987ddea75f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:06:28.962656 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-72fe81b7-18d8-4a4e-b323-cfca2026b154 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:28.962656 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-72fe81b7-18d8-4a4e-b323-cfca2026b154 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:28.965210 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1052/2121] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:06:28 2022] DELETE /identity/v3/projects/358293a86b4941039d23c3987ddea75f => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:28.966762 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe81b7-18d8-4a4e-b323-cfca2026b154 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:28.969107 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-72fe81b7-18d8-4a4e-b323-cfca2026b154 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:29.069775 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1070/2122] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:06:28 2022] DELETE /identity/v3/users/1e4ebd5d64c546c0989d859e98f9fb2b => generated 0 bytes in 1049 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:29.071894 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115ffac-6185-431a-a493-a1a98ff3f3d5 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:29.077722 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115ffac-6185-431a-a493-a1a98ff3f3d5 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:29.077722 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115ffac-6185-431a-a493-a1a98ff3f3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:29.146639 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe81b7-18d8-4a4e-b323-cfca2026b154 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:29.203301 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-7115ffac-6185-431a-a493-a1a98ff3f3d5 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:29.206285 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-7115ffac-6185-431a-a493-a1a98ff3f3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:29.327650 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1071/2123] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:29.330052 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115ffac-6185-431a-a493-a1a98ff3f3d5 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:29.336610 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-7115ffac-6185-431a-a493-a1a98ff3f3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:29.336872 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b3491-2ed1-49d7-943c-ee4d5a900e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:29.337306 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b3491-2ed1-49d7-943c-ee4d5a900e2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:29.337550 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b3491-2ed1-49d7-943c-ee4d5a900e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:29.337835 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b3491-2ed1-49d7-943c-ee4d5a900e2d admin admin] PATH_INFO: `/v3/projects/c94ef85427e545e0819e8573c24b7afa` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:29.343899 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:29.345391 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b3491-2ed1-49d7-943c-ee4d5a900e2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c94ef85427e545e0819e8573c24b7afa)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:29.347718 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b3491-2ed1-49d7-943c-ee4d5a900e2d admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:29.367546 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115ffac-6185-431a-a493-a1a98ff3f3d5 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:29.380583 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49989de3-b4c2-43fc-88fa-5fab0e8ffecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:29.381918 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49989de3-b4c2-43fc-88fa-5fab0e8ffecb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:29.383876 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49989de3-b4c2-43fc-88fa-5fab0e8ffecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:29.384408 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49989de3-b4c2-43fc-88fa-5fab0e8ffecb admin admin] PATH_INFO: `/v3/users/e794ba7f4fa04efea3008436127511b4` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:29.389846 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49989de3-b4c2-43fc-88fa-5fab0e8ffecb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e794ba7f4fa04efea3008436127511b4)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:29.404714 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49989de3-b4c2-43fc-88fa-5fab0e8ffecb admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:29.537816 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-608b3491-2ed1-49d7-943c-ee4d5a900e2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c94ef85427e545e0819e8573c24b7afa', 'request_id': 'req-608b3491-2ed1-49d7-943c-ee4d5a900e2d'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:29.549052 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-608b3491-2ed1-49d7-943c-ee4d5a900e2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c94ef85427e545e0819e8573c24b7afa', 'request_id': 'req-608b3491-2ed1-49d7-943c-ee4d5a900e2d'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:29.557137 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-608b3491-2ed1-49d7-943c-ee4d5a900e2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c94ef85427e545e0819e8573c24b7afa', 'request_id': 'req-608b3491-2ed1-49d7-943c-ee4d5a900e2d'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:29.677431 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-608b3491-2ed1-49d7-943c-ee4d5a900e2d admin admin] The token cache is being invalidate because project c94ef85427e545e0819e8573c24b7afa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:06:29.678254 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-608b3491-2ed1-49d7-943c-ee4d5a900e2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:29.679839 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-608b3491-2ed1-49d7-943c-ee4d5a900e2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:29.683875 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1053/2124] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:06:28 2022] DELETE /identity/v3/projects/c94ef85427e545e0819e8573c24b7afa => generated 0 bytes in 718 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:29.693885 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c360e-405f-438b-9d1d-468e56e219aa None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:29.694783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c360e-405f-438b-9d1d-468e56e219aa None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:29.695934 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c360e-405f-438b-9d1d-468e56e219aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:29.739308 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-49989de3-b4c2-43fc-88fa-5fab0e8ffecb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e794ba7f4fa04efea3008436127511b4'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:29.740606 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-49989de3-b4c2-43fc-88fa-5fab0e8ffecb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e794ba7f4fa04efea3008436127511b4'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:29.764304 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-484c360e-405f-438b-9d1d-468e56e219aa None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:29.766532 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-484c360e-405f-438b-9d1d-468e56e219aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:29.788315 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-49989de3-b4c2-43fc-88fa-5fab0e8ffecb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e794ba7f4fa04efea3008436127511b4'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:29.800135 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-49989de3-b4c2-43fc-88fa-5fab0e8ffecb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e794ba7f4fa04efea3008436127511b4'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:29.801065 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-49989de3-b4c2-43fc-88fa-5fab0e8ffecb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e794ba7f4fa04efea3008436127511b4'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:29.900737 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1054/2125] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:29.902447 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596644e-483d-494e-9833-9a561d27e272 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:29.902770 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596644e-483d-494e-9833-9a561d27e272 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:29.903071 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596644e-483d-494e-9833-9a561d27e272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:29.924800 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-d596644e-483d-494e-9833-9a561d27e272 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:29.926227 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-d596644e-483d-494e-9833-9a561d27e272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:29.954070 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1055/2126] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:29.954977 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596644e-483d-494e-9833-9a561d27e272 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:29.972377 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596644e-483d-494e-9833-9a561d27e272 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:29.975917 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1072/2127] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:06:29 2022] DELETE /identity/v3/users/e794ba7f4fa04efea3008436127511b4 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:29.985941 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb50784-f3e0-48b2-b9b8-2a4dc7119ae6 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:29.985941 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb50784-f3e0-48b2-b9b8-2a4dc7119ae6 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:29.985941 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb50784-f3e0-48b2-b9b8-2a4dc7119ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:30.020681 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-6bb50784-f3e0-48b2-b9b8-2a4dc7119ae6 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:30.022698 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-6bb50784-f3e0-48b2-b9b8-2a4dc7119ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:30.099711 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eabef9e-eed1-4b0d-8fc7-c219fd2b2fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:30.101859 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabef9e-eed1-4b0d-8fc7-c219fd2b2fcb admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:30.102360 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabef9e-eed1-4b0d-8fc7-c219fd2b2fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:30.102851 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabef9e-eed1-4b0d-8fc7-c219fd2b2fcb admin admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:30.103979 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eabef9e-eed1-4b0d-8fc7-c219fd2b2fcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:06:30.106002 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eabef9e-eed1-4b0d-8fc7-c219fd2b2fcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:30.109817 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eabef9e-eed1-4b0d-8fc7-c219fd2b2fcb admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:30.141696 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1056/2128] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:06:30.147116 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8684e51-7d7f-4079-9cdd-43a1ec5aedba None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:30.148128 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8684e51-7d7f-4079-9cdd-43a1ec5aedba None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:30.148128 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8684e51-7d7f-4079-9cdd-43a1ec5aedba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:30.160695 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1073/2129] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:30.160695 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb50784-f3e0-48b2-b9b8-2a4dc7119ae6 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:30.172489 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-e8684e51-7d7f-4079-9cdd-43a1ec5aedba None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:30.174151 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-e8684e51-7d7f-4079-9cdd-43a1ec5aedba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:30.176946 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb50784-f3e0-48b2-b9b8-2a4dc7119ae6 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:30.184236 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1057/2130] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:30.184638 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8684e51-7d7f-4079-9cdd-43a1ec5aedba None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:30.186786 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45326a-02b7-484b-b8d4-e4a165db18b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:30.188408 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45326a-02b7-484b-b8d4-e4a165db18b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:30.189270 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45326a-02b7-484b-b8d4-e4a165db18b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:30.190499 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45326a-02b7-484b-b8d4-e4a165db18b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:30.191727 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45326a-02b7-484b-b8d4-e4a165db18b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:30.196201 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45326a-02b7-484b-b8d4-e4a165db18b1 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:30.208723 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8684e51-7d7f-4079-9cdd-43a1ec5aedba None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:30.217271 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a4a18-0a40-4cbd-bbe6-68fbf0aaf75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:30.219232 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a4a18-0a40-4cbd-bbe6-68fbf0aaf75c admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:30.219232 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a4a18-0a40-4cbd-bbe6-68fbf0aaf75c admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:30.219232 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a4a18-0a40-4cbd-bbe6-68fbf0aaf75c admin admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:30.220545 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a4a18-0a40-4cbd-bbe6-68fbf0aaf75c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:06:30.221135 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a4a18-0a40-4cbd-bbe6-68fbf0aaf75c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:30.224857 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a4a18-0a40-4cbd-bbe6-68fbf0aaf75c admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:30.239895 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1058/2131] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:06:30.240799 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a4a18-0a40-4cbd-bbe6-68fbf0aaf75c admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:30.242700 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-037a4a18-0a40-4cbd-bbe6-68fbf0aaf75c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:30.312077 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a4a18-0a40-4cbd-bbe6-68fbf0aaf75c admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:30.316005 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f845e-7283-4e8c-807c-bb8d81785708 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:30.316685 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f845e-7283-4e8c-807c-bb8d81785708 service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:30.316969 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f845e-7283-4e8c-807c-bb8d81785708 service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:30.317245 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f845e-7283-4e8c-807c-bb8d81785708 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:30.328269 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f845e-7283-4e8c-807c-bb8d81785708 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:30.329850 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f845e-7283-4e8c-807c-bb8d81785708 service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:30.344145 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1059/2132] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:06:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:06:30.350058 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1074/2133] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:06:30 2022] POST /identity/v3/projects => generated 383 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:06:30.350462 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f845e-7283-4e8c-807c-bb8d81785708 service neutron] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:30.352506 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45326a-02b7-484b-b8d4-e4a165db18b1 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:30.368047 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f845e-7283-4e8c-807c-bb8d81785708 service neutron] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:30.491895 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45326a-02b7-484b-b8d4-e4a165db18b1 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:30.501569 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b53ba-44cd-4e0c-b005-8dd516ecec45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:30.502356 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b53ba-44cd-4e0c-b005-8dd516ecec45 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:30.502648 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b53ba-44cd-4e0c-b005-8dd516ecec45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:30.502932 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b53ba-44cd-4e0c-b005-8dd516ecec45 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:30.503715 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b53ba-44cd-4e0c-b005-8dd516ecec45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:30.512579 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b53ba-44cd-4e0c-b005-8dd516ecec45 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:30.562062 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09e138-72a9-4be2-b5a9-8eecff40855b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:30.563366 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09e138-72a9-4be2-b5a9-8eecff40855b admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:30.563913 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09e138-72a9-4be2-b5a9-8eecff40855b admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:30.564383 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09e138-72a9-4be2-b5a9-8eecff40855b admin admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:30.565803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09e138-72a9-4be2-b5a9-8eecff40855b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:30.570139 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09e138-72a9-4be2-b5a9-8eecff40855b admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:30.664796 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1075/2134] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:06:30 2022] POST /identity/v3/users => generated 292 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 04:06:30.666465 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b53ba-44cd-4e0c-b005-8dd516ecec45 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:30.671967 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0e9b53ba-44cd-4e0c-b005-8dd516ecec45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:30.707035 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b53ba-44cd-4e0c-b005-8dd516ecec45 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:30.717808 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e9c48-2591-4a2b-aa5e-7951513e2a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:30.719481 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e9c48-2591-4a2b-aa5e-7951513e2a89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:30.720512 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e9c48-2591-4a2b-aa5e-7951513e2a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:30.721170 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e9c48-2591-4a2b-aa5e-7951513e2a89 admin admin] PATH_INFO: `/v3/projects/f768b8c0ce8246e7913c5d50452d97f9` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:30.723574 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e9c48-2591-4a2b-aa5e-7951513e2a89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f768b8c0ce8246e7913c5d50452d97f9)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:30.727359 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e9c48-2591-4a2b-aa5e-7951513e2a89 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:30.790063 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1060/2135] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:06:30 2022] POST /identity/v3/projects => generated 381 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:06:30.791894 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09e138-72a9-4be2-b5a9-8eecff40855b admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:30.964904 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09e138-72a9-4be2-b5a9-8eecff40855b admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:30.976739 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-018e9c48-2591-4a2b-aa5e-7951513e2a89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f768b8c0ce8246e7913c5d50452d97f9', 'request_id': 'req-018e9c48-2591-4a2b-aa5e-7951513e2a89'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:31.062413 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69805a-8312-4455-a3ed-8f2d6adeadd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:31.065246 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69805a-8312-4455-a3ed-8f2d6adeadd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:31.066138 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69805a-8312-4455-a3ed-8f2d6adeadd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:31.066947 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69805a-8312-4455-a3ed-8f2d6adeadd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:31.069109 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69805a-8312-4455-a3ed-8f2d6adeadd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:31.071858 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69805a-8312-4455-a3ed-8f2d6adeadd4 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:31.098536 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1061/2136] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:06:31.100199 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69805a-8312-4455-a3ed-8f2d6adeadd4 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:31.128400 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69805a-8312-4455-a3ed-8f2d6adeadd4 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:31.141697 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937adca-eefd-4f0a-92a7-19b21124bf05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:31.142410 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937adca-eefd-4f0a-92a7-19b21124bf05 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:31.142782 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937adca-eefd-4f0a-92a7-19b21124bf05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:31.143009 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937adca-eefd-4f0a-92a7-19b21124bf05 admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:31.143788 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1937adca-eefd-4f0a-92a7-19b21124bf05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:31.146383 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1937adca-eefd-4f0a-92a7-19b21124bf05 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:31.152900 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:31.154435 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-018e9c48-2591-4a2b-aa5e-7951513e2a89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f768b8c0ce8246e7913c5d50452d97f9', 'request_id': 'req-018e9c48-2591-4a2b-aa5e-7951513e2a89'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:31.166509 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-018e9c48-2591-4a2b-aa5e-7951513e2a89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f768b8c0ce8246e7913c5d50452d97f9', 'request_id': 'req-018e9c48-2591-4a2b-aa5e-7951513e2a89'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:31.181918 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-018e9c48-2591-4a2b-aa5e-7951513e2a89 admin admin] The token cache is being invalidate because project f768b8c0ce8246e7913c5d50452d97f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:06:31.182213 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-018e9c48-2591-4a2b-aa5e-7951513e2a89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:31.184077 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-018e9c48-2591-4a2b-aa5e-7951513e2a89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:31.185380 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1076/2137] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:06:30 2022] DELETE /identity/v3/projects/f768b8c0ce8246e7913c5d50452d97f9 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:31.186026 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e9c48-2591-4a2b-aa5e-7951513e2a89 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:31.188267 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-018e9c48-2591-4a2b-aa5e-7951513e2a89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:31.209148 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e9c48-2591-4a2b-aa5e-7951513e2a89 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:31.216823 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521d49c-ade0-4ba2-8f2d-8716c2f126ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:31.219416 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521d49c-ade0-4ba2-8f2d-8716c2f126ae admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:31.220614 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521d49c-ade0-4ba2-8f2d-8716c2f126ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:31.221091 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521d49c-ade0-4ba2-8f2d-8716c2f126ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:31.222050 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6521d49c-ade0-4ba2-8f2d-8716c2f126ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:31.224973 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6521d49c-ade0-4ba2-8f2d-8716c2f126ae admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:31.249132 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1077/2138] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:06:31.249825 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1062/2139] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:06:31 2022] POST /identity/v3/users => generated 291 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:06:31.253444 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937adca-eefd-4f0a-92a7-19b21124bf05 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:31.253983 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa0825-766e-4731-84f0-5c1bc6b0ca4f None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:31.254732 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa0825-766e-4731-84f0-5c1bc6b0ca4f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:31.255128 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa0825-766e-4731-84f0-5c1bc6b0ca4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:31.269262 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937adca-eefd-4f0a-92a7-19b21124bf05 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:31.283789 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4646f0-b95c-4035-a9b2-956b21b673db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:31.286044 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4646f0-b95c-4035-a9b2-956b21b673db admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:31.287221 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-76aa0825-766e-4731-84f0-5c1bc6b0ca4f None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:31.288030 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-76aa0825-766e-4731-84f0-5c1bc6b0ca4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:31.288228 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4646f0-b95c-4035-a9b2-956b21b673db admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:31.289106 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4646f0-b95c-4035-a9b2-956b21b673db admin admin] PATH_INFO: `/v3/projects/1f500b227381416f8e7b3a18338d3736/users/350a930116a14f89986dc60dcd046e07/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:31.310811 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1078/2140] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:31.310811 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa0825-766e-4731-84f0-5c1bc6b0ca4f None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:31.310811 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-76aa0825-766e-4731-84f0-5c1bc6b0ca4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:31.326448 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa0825-766e-4731-84f0-5c1bc6b0ca4f None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:31.338345 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09641f-639a-4f40-befc-bc95553640fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:31.338663 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4646f0-b95c-4035-a9b2-956b21b673db admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f500b227381416f8e7b3a18338d3736, user_id=350a930116a14f89986dc60dcd046e07, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:31.338832 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09641f-639a-4f40-befc-bc95553640fe admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:31.338832 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09641f-639a-4f40-befc-bc95553640fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:31.345839 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09641f-639a-4f40-befc-bc95553640fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:31.345839 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e09641f-639a-4f40-befc-bc95553640fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:31.346153 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4646f0-b95c-4035-a9b2-956b21b673db admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:31.346309 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e09641f-639a-4f40-befc-bc95553640fe admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:31.358977 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1079/2141] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:06:31.358977 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be11be-5dfe-4822-a2c2-5397ca304b80 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:31.358977 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be11be-5dfe-4822-a2c2-5397ca304b80 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:31.358977 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be11be-5dfe-4822-a2c2-5397ca304b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:31.380240 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-c9be11be-5dfe-4822-a2c2-5397ca304b80 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:31.381640 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c9be11be-5dfe-4822-a2c2-5397ca304b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:31.390489 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1080/2142] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:31.391369 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be11be-5dfe-4822-a2c2-5397ca304b80 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:31.402129 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be11be-5dfe-4822-a2c2-5397ca304b80 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:31.408324 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f750e17f-1a69-4fbd-8e74-38dbcaf9beff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:31.409254 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750e17f-1a69-4fbd-8e74-38dbcaf9beff admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:31.409544 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750e17f-1a69-4fbd-8e74-38dbcaf9beff admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:31.409863 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750e17f-1a69-4fbd-8e74-38dbcaf9beff admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:31.410627 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f750e17f-1a69-4fbd-8e74-38dbcaf9beff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:31.412391 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f750e17f-1a69-4fbd-8e74-38dbcaf9beff admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:31.424933 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1081/2143] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:06:31.426170 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f750e17f-1a69-4fbd-8e74-38dbcaf9beff admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:31.437847 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f750e17f-1a69-4fbd-8e74-38dbcaf9beff admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:31.443228 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137f7da-2950-4384-a767-27c2b09e5930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:31.443976 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137f7da-2950-4384-a767-27c2b09e5930 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:31.444259 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137f7da-2950-4384-a767-27c2b09e5930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:31.444579 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137f7da-2950-4384-a767-27c2b09e5930 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:31.445295 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a137f7da-2950-4384-a767-27c2b09e5930 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:06:31.445892 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a137f7da-2950-4384-a767-27c2b09e5930 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:31.447700 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a137f7da-2950-4384-a767-27c2b09e5930 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:31.466593 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1082/2144] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:06:31.466593 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137f7da-2950-4384-a767-27c2b09e5930 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:31.473524 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1063/2145] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:06:31 2022] PUT /identity/v3/projects/1f500b227381416f8e7b3a18338d3736/users/350a930116a14f89986dc60dcd046e07/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:31.475098 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4646f0-b95c-4035-a9b2-956b21b673db admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:31.478553 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137f7da-2950-4384-a767-27c2b09e5930 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:31.603256 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a6426-d318-4530-8ef6-170a384a1f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:31.608098 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4646f0-b95c-4035-a9b2-956b21b673db admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:31.608328 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a6426-d318-4530-8ef6-170a384a1f37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:31.608328 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a6426-d318-4530-8ef6-170a384a1f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:31.608328 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a6426-d318-4530-8ef6-170a384a1f37 admin admin] PATH_INFO: `/v3/projects/a767bc3aa4354d14a2d1288ab866538f/users/19f59a2adf614440b42165c1061857e5/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:31.612629 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e197be9-ae7a-430b-84f3-4bef59c4f95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:31.613914 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e197be9-ae7a-430b-84f3-4bef59c4f95d admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:31.614233 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e197be9-ae7a-430b-84f3-4bef59c4f95d admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:31.614593 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e197be9-ae7a-430b-84f3-4bef59c4f95d admin admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:31.615628 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e197be9-ae7a-430b-84f3-4bef59c4f95d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:31.617782 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e197be9-ae7a-430b-84f3-4bef59c4f95d admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:31.632618 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a6426-d318-4530-8ef6-170a384a1f37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a767bc3aa4354d14a2d1288ab866538f, user_id=19f59a2adf614440b42165c1061857e5, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:31.637236 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a6426-d318-4530-8ef6-170a384a1f37 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:31.743260 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1064/2146] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:06:31 2022] POST /identity/v3/projects => generated 379 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:06:31.756979 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be9a53-f1bc-4cb9-856b-c279d25c078c None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:31.756979 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be9a53-f1bc-4cb9-856b-c279d25c078c None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:31.756979 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be9a53-f1bc-4cb9-856b-c279d25c078c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:31.759141 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1083/2147] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:06:31 2022] PUT /identity/v3/projects/a767bc3aa4354d14a2d1288ab866538f/users/19f59a2adf614440b42165c1061857e5/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:31.760976 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a6426-d318-4530-8ef6-170a384a1f37 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:31.769093 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-5c8a6426-d318-4530-8ef6-170a384a1f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:31.796381 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-13be9a53-f1bc-4cb9-856b-c279d25c078c None None] MFA Rules not processed for user `350a930116a14f89986dc60dcd046e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:31.797651 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-13be9a53-f1bc-4cb9-856b-c279d25c078c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:31.857389 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a6426-d318-4530-8ef6-170a384a1f37 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:31.883666 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1065/2148] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:31.886712 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be9a53-f1bc-4cb9-856b-c279d25c078c None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:31.946485 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe043c-4fdb-4ab3-ac68-f534d1889a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:31.947563 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe043c-4fdb-4ab3-ac68-f534d1889a9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:31.947916 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe043c-4fdb-4ab3-ac68-f534d1889a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:31.948787 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe043c-4fdb-4ab3-ac68-f534d1889a9a admin admin] PATH_INFO: `/v3/projects/e068b1e58c42471391a569084933d89f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:31.950171 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe043c-4fdb-4ab3-ac68-f534d1889a9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e068b1e58c42471391a569084933d89f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:31.952289 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe043c-4fdb-4ab3-ac68-f534d1889a9a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:31.971824 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be9a53-f1bc-4cb9-856b-c279d25c078c None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:31.976952 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7036a0c4-2f59-4b17-ab0b-dd0b6af1b2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:31.977650 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036a0c4-2f59-4b17-ab0b-dd0b6af1b2a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:31.977971 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036a0c4-2f59-4b17-ab0b-dd0b6af1b2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:31.978250 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036a0c4-2f59-4b17-ab0b-dd0b6af1b2a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:31.978964 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7036a0c4-2f59-4b17-ab0b-dd0b6af1b2a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:31.981070 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7036a0c4-2f59-4b17-ab0b-dd0b6af1b2a8 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:32.077447 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-92fe043c-4fdb-4ab3-ac68-f534d1889a9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e068b1e58c42471391a569084933d89f', 'request_id': 'req-92fe043c-4fdb-4ab3-ac68-f534d1889a9a'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:32.125476 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1066/2149] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:06:31 2022] POST /identity/v3/users => generated 290 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:06:32.125476 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542a7a8-1da6-4111-acea-f5cb27acc5e1 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:32.125476 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542a7a8-1da6-4111-acea-f5cb27acc5e1 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:32.125476 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542a7a8-1da6-4111-acea-f5cb27acc5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:32.161416 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-7542a7a8-1da6-4111-acea-f5cb27acc5e1 None None] MFA Rules not processed for user `19f59a2adf614440b42165c1061857e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:32.164009 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-7542a7a8-1da6-4111-acea-f5cb27acc5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:32.183172 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-92fe043c-4fdb-4ab3-ac68-f534d1889a9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e068b1e58c42471391a569084933d89f', 'request_id': 'req-92fe043c-4fdb-4ab3-ac68-f534d1889a9a'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:32.191327 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-92fe043c-4fdb-4ab3-ac68-f534d1889a9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e068b1e58c42471391a569084933d89f', 'request_id': 'req-92fe043c-4fdb-4ab3-ac68-f534d1889a9a'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:32.206973 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-92fe043c-4fdb-4ab3-ac68-f534d1889a9a admin admin] The token cache is being invalidate because project e068b1e58c42471391a569084933d89f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:06:32.207317 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-92fe043c-4fdb-4ab3-ac68-f534d1889a9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:32.208281 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-92fe043c-4fdb-4ab3-ac68-f534d1889a9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:32.210109 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1084/2150] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:06:31 2022] DELETE /identity/v3/projects/e068b1e58c42471391a569084933d89f => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:32.215898 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe043c-4fdb-4ab3-ac68-f534d1889a9a admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:32.215898 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-92fe043c-4fdb-4ab3-ac68-f534d1889a9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:32.297209 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe043c-4fdb-4ab3-ac68-f534d1889a9a admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:32.321204 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c571f-69c3-441e-954b-a7a9fe63ff04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:32.322834 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c571f-69c3-441e-954b-a7a9fe63ff04 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:32.324110 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c571f-69c3-441e-954b-a7a9fe63ff04 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:32.325112 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c571f-69c3-441e-954b-a7a9fe63ff04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:32.325786 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1067/2151] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:32.328291 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542a7a8-1da6-4111-acea-f5cb27acc5e1 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:32.332217 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-7542a7a8-1da6-4111-acea-f5cb27acc5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:32.336009 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-257c571f-69c3-441e-954b-a7a9fe63ff04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:32.471775 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542a7a8-1da6-4111-acea-f5cb27acc5e1 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:32.478877 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad3d8a-cde9-4ddb-bb02-75f3a6b70067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:32.479703 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad3d8a-cde9-4ddb-bb02-75f3a6b70067 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:32.480043 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad3d8a-cde9-4ddb-bb02-75f3a6b70067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:32.480616 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad3d8a-cde9-4ddb-bb02-75f3a6b70067 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:32.481411 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad3d8a-cde9-4ddb-bb02-75f3a6b70067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:32.488071 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad3d8a-cde9-4ddb-bb02-75f3a6b70067 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:32.513981 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c571f-69c3-441e-954b-a7a9fe63ff04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:32.518595 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c571f-69c3-441e-954b-a7a9fe63ff04 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:32.521084 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1068/2152] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:06:32.521634 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad3d8a-cde9-4ddb-bb02-75f3a6b70067 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:32.523601 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-86ad3d8a-cde9-4ddb-bb02-75f3a6b70067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:32.536492 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1085/2153] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:06:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:06:32.538467 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c571f-69c3-441e-954b-a7a9fe63ff04 service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:32.542820 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-257c571f-69c3-441e-954b-a7a9fe63ff04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:32.552411 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad3d8a-cde9-4ddb-bb02-75f3a6b70067 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:32.557697 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb53214-7a52-409c-bf5d-a89295ba869e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:32.559296 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb53214-7a52-409c-bf5d-a89295ba869e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:32.559685 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb53214-7a52-409c-bf5d-a89295ba869e admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:32.560197 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb53214-7a52-409c-bf5d-a89295ba869e admin admin] PATH_INFO: `/v3/users/d414cd6061ab47298319565deb9de8ae` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:32.561862 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb53214-7a52-409c-bf5d-a89295ba869e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d414cd6061ab47298319565deb9de8ae)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:32.564029 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb53214-7a52-409c-bf5d-a89295ba869e admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:32.577275 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c571f-69c3-441e-954b-a7a9fe63ff04 service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:32.588094 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c4c78-b252-4cae-ae36-9916975fffe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:32.589775 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c4c78-b252-4cae-ae36-9916975fffe0 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:32.590262 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c4c78-b252-4cae-ae36-9916975fffe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:32.591001 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c4c78-b252-4cae-ae36-9916975fffe0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:32.592355 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c4c78-b252-4cae-ae36-9916975fffe0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:32.598471 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c4c78-b252-4cae-ae36-9916975fffe0 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:32.789431 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1086/2154] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:06:32 2022] POST /identity/v3/projects => generated 383 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:06:32.791623 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c4c78-b252-4cae-ae36-9916975fffe0 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:32.865805 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c4c78-b252-4cae-ae36-9916975fffe0 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:32.871294 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4a645-0e60-4397-9202-84626b884883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:32.872069 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4a645-0e60-4397-9202-84626b884883 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:32.872426 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4a645-0e60-4397-9202-84626b884883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:32.872704 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4a645-0e60-4397-9202-84626b884883 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:32.873453 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c4a645-0e60-4397-9202-84626b884883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:32.875154 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c4a645-0e60-4397-9202-84626b884883 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:32.886792 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1087/2155] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:06:32.887774 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4a645-0e60-4397-9202-84626b884883 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:32.899579 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4a645-0e60-4397-9202-84626b884883 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:32.904948 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bbb88b-b439-4c94-8e37-f26ef91659b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:32.905660 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbb88b-b439-4c94-8e37-f26ef91659b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:32.906099 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbb88b-b439-4c94-8e37-f26ef91659b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:32.906428 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbb88b-b439-4c94-8e37-f26ef91659b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:32.907205 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bbb88b-b439-4c94-8e37-f26ef91659b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:32.909253 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bbb88b-b439-4c94-8e37-f26ef91659b0 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:32.934485 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:32.962572 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-7bb53214-7a52-409c-bf5d-a89295ba869e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd414cd6061ab47298319565deb9de8ae'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:32.964599 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-7bb53214-7a52-409c-bf5d-a89295ba869e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd414cd6061ab47298319565deb9de8ae'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:33.043308 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1088/2156] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:06:32 2022] POST /identity/v3/users => generated 298 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:06:33.044349 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bbb88b-b439-4c94-8e37-f26ef91659b0 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:33.046613 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d3bbb88b-b439-4c94-8e37-f26ef91659b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:33.062251 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bbb88b-b439-4c94-8e37-f26ef91659b0 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:33.069077 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-7bb53214-7a52-409c-bf5d-a89295ba869e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd414cd6061ab47298319565deb9de8ae'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:33.069815 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-7bb53214-7a52-409c-bf5d-a89295ba869e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd414cd6061ab47298319565deb9de8ae'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:33.072774 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e856dc85-d45e-4ed0-81f1-8042e8cc7277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:33.074821 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856dc85-d45e-4ed0-81f1-8042e8cc7277 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:33.077614 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856dc85-d45e-4ed0-81f1-8042e8cc7277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:33.077614 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856dc85-d45e-4ed0-81f1-8042e8cc7277 admin admin] PATH_INFO: `/v3/projects/7f46045082174aaebaea602c708aea7d/users/8e51fd34b940456abaf071c37a2329ba/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:33.083597 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-7bb53214-7a52-409c-bf5d-a89295ba869e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd414cd6061ab47298319565deb9de8ae'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:33.100855 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e856dc85-d45e-4ed0-81f1-8042e8cc7277 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f46045082174aaebaea602c708aea7d, user_id=8e51fd34b940456abaf071c37a2329ba, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:33.104118 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e856dc85-d45e-4ed0-81f1-8042e8cc7277 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:33.117339 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1069/2157] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:06:32 2022] DELETE /identity/v3/users/d414cd6061ab47298319565deb9de8ae => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:33.118307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb53214-7a52-409c-bf5d-a89295ba869e admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:33.119937 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-7bb53214-7a52-409c-bf5d-a89295ba869e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:33.199429 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb53214-7a52-409c-bf5d-a89295ba869e admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:33.207600 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040efe9f-d5a9-429e-a47c-65dece107f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:33.208462 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040efe9f-d5a9-429e-a47c-65dece107f64 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:33.208960 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040efe9f-d5a9-429e-a47c-65dece107f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:33.209334 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040efe9f-d5a9-429e-a47c-65dece107f64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:33.211129 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040efe9f-d5a9-429e-a47c-65dece107f64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:33.214811 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040efe9f-d5a9-429e-a47c-65dece107f64 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:33.239648 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1089/2158] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:06:33 2022] PUT /identity/v3/projects/7f46045082174aaebaea602c708aea7d/users/8e51fd34b940456abaf071c37a2329ba/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:33.241523 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1070/2159] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:06:33.247566 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e856dc85-d45e-4ed0-81f1-8042e8cc7277 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:33.268318 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627f142-4966-4e69-8267-65bc3a3f5976 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:33.269075 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627f142-4966-4e69-8267-65bc3a3f5976 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:33.276210 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627f142-4966-4e69-8267-65bc3a3f5976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:33.341473 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-3627f142-4966-4e69-8267-65bc3a3f5976 None None] MFA Rules not processed for user `8e51fd34b940456abaf071c37a2329ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:33.343741 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-3627f142-4966-4e69-8267-65bc3a3f5976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:33.419555 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e856dc85-d45e-4ed0-81f1-8042e8cc7277 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:33.427647 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ca693-67ae-4413-88b7-6b2bfe9f1e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:33.428739 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ca693-67ae-4413-88b7-6b2bfe9f1e53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:33.429146 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ca693-67ae-4413-88b7-6b2bfe9f1e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:33.429660 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ca693-67ae-4413-88b7-6b2bfe9f1e53 admin admin] PATH_INFO: `/v3/projects/78ae20d96ab140bda510bab70e2a064e/users/cb788dd4c0ef4ec29b8a2d0f6aa8b3ce/roles/681755518698445fabd9a8accec13c0f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:33.460341 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319ca693-67ae-4413-88b7-6b2bfe9f1e53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78ae20d96ab140bda510bab70e2a064e, user_id=cb788dd4c0ef4ec29b8a2d0f6aa8b3ce, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:33.460341 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319ca693-67ae-4413-88b7-6b2bfe9f1e53 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:33.546143 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1071/2160] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:33.547317 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627f142-4966-4e69-8267-65bc3a3f5976 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:33.561018 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1090/2161] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:06:33 2022] PUT /identity/v3/projects/78ae20d96ab140bda510bab70e2a064e/users/cb788dd4c0ef4ec29b8a2d0f6aa8b3ce/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:06:33.566925 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ca693-67ae-4413-88b7-6b2bfe9f1e53 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:33.581604 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627f142-4966-4e69-8267-65bc3a3f5976 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:33.684189 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ca693-67ae-4413-88b7-6b2bfe9f1e53 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:33.690155 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9984e86-1590-40ed-a53f-a2a7fbe634af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:33.697361 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9984e86-1590-40ed-a53f-a2a7fbe634af admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:33.697361 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9984e86-1590-40ed-a53f-a2a7fbe634af admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:33.697361 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9984e86-1590-40ed-a53f-a2a7fbe634af admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:33.697361 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9984e86-1590-40ed-a53f-a2a7fbe634af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:33.697361 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9984e86-1590-40ed-a53f-a2a7fbe634af admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:33.707881 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1091/2162] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 04:06:33.715185 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9984e86-1590-40ed-a53f-a2a7fbe634af admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:33.749394 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9984e86-1590-40ed-a53f-a2a7fbe634af admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:33.759586 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c0b73-4a04-47c4-bb09-31f9a019e1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:33.762378 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c0b73-4a04-47c4-bb09-31f9a019e1d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:33.763932 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c0b73-4a04-47c4-bb09-31f9a019e1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:33.772111 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c0b73-4a04-47c4-bb09-31f9a019e1d7 admin admin] PATH_INFO: `/v3/projects/78ae20d96ab140bda510bab70e2a064e/users/cb788dd4c0ef4ec29b8a2d0f6aa8b3ce/roles/681755518698445fabd9a8accec13c0f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:33.772369 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb77b91-1607-426f-95c4-d094ba8a6abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:33.772369 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb77b91-1607-426f-95c4-d094ba8a6abf admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:33.772369 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb77b91-1607-426f-95c4-d094ba8a6abf admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:33.772369 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb77b91-1607-426f-95c4-d094ba8a6abf admin admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:33.772999 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb77b91-1607-426f-95c4-d094ba8a6abf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:33.773164 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c0b73-4a04-47c4-bb09-31f9a019e1d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78ae20d96ab140bda510bab70e2a064e, user_id=cb788dd4c0ef4ec29b8a2d0f6aa8b3ce, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:33.775075 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb77b91-1607-426f-95c4-d094ba8a6abf admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:33.780699 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c0b73-4a04-47c4-bb09-31f9a019e1d7 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:33.808441 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1092/2163] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:06:33 2022] PUT /identity/v3/projects/78ae20d96ab140bda510bab70e2a064e/users/cb788dd4c0ef4ec29b8a2d0f6aa8b3ce/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:33.821936 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0ffb4-22b8-4627-9efa-4540082df005 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:33.822440 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0ffb4-22b8-4627-9efa-4540082df005 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:33.822867 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0ffb4-22b8-4627-9efa-4540082df005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:33.868478 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-43f0ffb4-22b8-4627-9efa-4540082df005 None None] MFA Rules not processed for user `cb788dd4c0ef4ec29b8a2d0f6aa8b3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:33.872042 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-43f0ffb4-22b8-4627-9efa-4540082df005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:33.953851 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1072/2164] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:06:33 2022] POST /identity/v3/projects => generated 381 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:06:33.955132 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb77b91-1607-426f-95c4-d094ba8a6abf admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:34.045731 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb77b91-1607-426f-95c4-d094ba8a6abf admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:34.051249 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569296f3-178c-45b5-aa55-f74b73c43f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:34.052123 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569296f3-178c-45b5-aa55-f74b73c43f3a admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:34.052410 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569296f3-178c-45b5-aa55-f74b73c43f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:34.052692 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569296f3-178c-45b5-aa55-f74b73c43f3a admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:34.053481 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569296f3-178c-45b5-aa55-f74b73c43f3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:34.055643 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569296f3-178c-45b5-aa55-f74b73c43f3a admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:34.061163 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1093/2165] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:34.081211 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0ffb4-22b8-4627-9efa-4540082df005 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:34.083972 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-43f0ffb4-22b8-4627-9efa-4540082df005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:34.175566 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0ffb4-22b8-4627-9efa-4540082df005 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:34.225995 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1073/2166] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:06:33 2022] POST /identity/v3/users => generated 297 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:06:34.228626 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569296f3-178c-45b5-aa55-f74b73c43f3a admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:34.232525 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-569296f3-178c-45b5-aa55-f74b73c43f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:34.272104 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569296f3-178c-45b5-aa55-f74b73c43f3a admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:34.276964 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c16890-1307-4fae-89ec-67242d919fa1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:34.278137 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c16890-1307-4fae-89ec-67242d919fa1 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:34.278524 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c16890-1307-4fae-89ec-67242d919fa1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:34.279037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c16890-1307-4fae-89ec-67242d919fa1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:34.282483 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b9bf2-2020-475a-ae5f-22ab473d730a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:34.283235 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b9bf2-2020-475a-ae5f-22ab473d730a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:34.283815 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b9bf2-2020-475a-ae5f-22ab473d730a admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:34.284388 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b9bf2-2020-475a-ae5f-22ab473d730a admin admin] PATH_INFO: `/v3/projects/7033571dd1714bfa9fce6da04a9298a5` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:34.286932 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86b9bf2-2020-475a-ae5f-22ab473d730a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7033571dd1714bfa9fce6da04a9298a5)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:34.291125 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86b9bf2-2020-475a-ae5f-22ab473d730a admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:34.382289 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c16890-1307-4fae-89ec-67242d919fa1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:34.384146 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c16890-1307-4fae-89ec-67242d919fa1 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:34.396833 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1094/2167] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:06:34 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 04:06:34.397837 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c16890-1307-4fae-89ec-67242d919fa1 service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:34.410543 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c16890-1307-4fae-89ec-67242d919fa1 service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:34.416790 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bac7ae-890f-4c8a-bd82-be9abb6acc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:34.417503 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bac7ae-890f-4c8a-bd82-be9abb6acc22 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:34.418743 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bac7ae-890f-4c8a-bd82-be9abb6acc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:34.418743 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bac7ae-890f-4c8a-bd82-be9abb6acc22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:34.419307 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bac7ae-890f-4c8a-bd82-be9abb6acc22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:34.421146 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bac7ae-890f-4c8a-bd82-be9abb6acc22 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:34.437982 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1095/2168] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:06:34.439193 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bac7ae-890f-4c8a-bd82-be9abb6acc22 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:34.459933 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bac7ae-890f-4c8a-bd82-be9abb6acc22 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:34.476367 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-e86b9bf2-2020-475a-ae5f-22ab473d730a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7033571dd1714bfa9fce6da04a9298a5', 'request_id': 'req-e86b9bf2-2020-475a-ae5f-22ab473d730a'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:34.491177 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-e86b9bf2-2020-475a-ae5f-22ab473d730a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7033571dd1714bfa9fce6da04a9298a5', 'request_id': 'req-e86b9bf2-2020-475a-ae5f-22ab473d730a'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:34.511226 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-e86b9bf2-2020-475a-ae5f-22ab473d730a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7033571dd1714bfa9fce6da04a9298a5', 'request_id': 'req-e86b9bf2-2020-475a-ae5f-22ab473d730a'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:34.559356 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72ea70-1d7f-4732-b365-62fd65526717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:34.560312 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72ea70-1d7f-4732-b365-62fd65526717 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:34.560593 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72ea70-1d7f-4732-b365-62fd65526717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:34.560868 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72ea70-1d7f-4732-b365-62fd65526717 admin admin] PATH_INFO: `/v3/projects/8b97b712fd3140ed85e79c3a0275fc18/users/c261036fdea647f583a90f07375c7268/roles/681755518698445fabd9a8accec13c0f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:34.577848 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b72ea70-1d7f-4732-b365-62fd65526717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b97b712fd3140ed85e79c3a0275fc18, user_id=c261036fdea647f583a90f07375c7268, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:34.580912 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b72ea70-1d7f-4732-b365-62fd65526717 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:34.643668 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-e86b9bf2-2020-475a-ae5f-22ab473d730a admin admin] The token cache is being invalidate because project 7033571dd1714bfa9fce6da04a9298a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:06:34.644058 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-e86b9bf2-2020-475a-ae5f-22ab473d730a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:34.650857 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-e86b9bf2-2020-475a-ae5f-22ab473d730a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:34.650857 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1074/2169] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:06:34 2022] DELETE /identity/v3/projects/7033571dd1714bfa9fce6da04a9298a5 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:34.650857 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b9bf2-2020-475a-ae5f-22ab473d730a admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:34.650857 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-e86b9bf2-2020-475a-ae5f-22ab473d730a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:34.696926 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1096/2170] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:06:34 2022] PUT /identity/v3/projects/8b97b712fd3140ed85e79c3a0275fc18/users/c261036fdea647f583a90f07375c7268/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:34.696926 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f379c-3858-4f12-98cc-2b644def4092 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:34.696926 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f379c-3858-4f12-98cc-2b644def4092 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:34.696926 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f379c-3858-4f12-98cc-2b644def4092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:34.710416 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-556f379c-3858-4f12-98cc-2b644def4092 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:34.712252 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-556f379c-3858-4f12-98cc-2b644def4092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:34.803361 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1097/2171] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:34.805127 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f379c-3858-4f12-98cc-2b644def4092 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:34.806591 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-556f379c-3858-4f12-98cc-2b644def4092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:34.822589 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f379c-3858-4f12-98cc-2b644def4092 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:34.832558 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf331ba-4e82-4a50-afe5-410d2031d6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:34.834147 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf331ba-4e82-4a50-afe5-410d2031d6d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:34.835117 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf331ba-4e82-4a50-afe5-410d2031d6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:34.835117 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf331ba-4e82-4a50-afe5-410d2031d6d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:34.836423 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf331ba-4e82-4a50-afe5-410d2031d6d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:34.839680 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b9bf2-2020-475a-ae5f-22ab473d730a admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:34.839947 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf331ba-4e82-4a50-afe5-410d2031d6d4 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:34.854838 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1098/2172] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:06:34.856944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da3f98-f0c8-4a6a-bc68-8a573d6fbe15 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:34.857911 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da3f98-f0c8-4a6a-bc68-8a573d6fbe15 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:34.858410 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da3f98-f0c8-4a6a-bc68-8a573d6fbe15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:34.882882 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-a9da3f98-f0c8-4a6a-bc68-8a573d6fbe15 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:34.884506 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a9da3f98-f0c8-4a6a-bc68-8a573d6fbe15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:34.898065 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1099/2173] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:34.898065 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da3f98-f0c8-4a6a-bc68-8a573d6fbe15 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:34.912890 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da3f98-f0c8-4a6a-bc68-8a573d6fbe15 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:34.922209 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a34209-4c0b-42f5-9eab-b842914d4970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:34.922688 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a34209-4c0b-42f5-9eab-b842914d4970 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:34.923276 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a34209-4c0b-42f5-9eab-b842914d4970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:34.923439 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a34209-4c0b-42f5-9eab-b842914d4970 admin admin] PATH_INFO: `/v3/projects/8b97b712fd3140ed85e79c3a0275fc18/users/c261036fdea647f583a90f07375c7268/roles/681755518698445fabd9a8accec13c0f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:34.926557 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a34209-4c0b-42f5-9eab-b842914d4970 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b97b712fd3140ed85e79c3a0275fc18, user_id=c261036fdea647f583a90f07375c7268, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:34.930225 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a34209-4c0b-42f5-9eab-b842914d4970 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:34.955590 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1100/2174] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:06:34 2022] PUT /identity/v3/projects/8b97b712fd3140ed85e79c3a0275fc18/users/c261036fdea647f583a90f07375c7268/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:34.955590 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a34209-4c0b-42f5-9eab-b842914d4970 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:35.047124 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a34209-4c0b-42f5-9eab-b842914d4970 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:35.059696 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08163b-a8f3-4a6f-9eb8-47acf13b7692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:35.060674 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08163b-a8f3-4a6f-9eb8-47acf13b7692 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:35.061277 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08163b-a8f3-4a6f-9eb8-47acf13b7692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:35.061776 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08163b-a8f3-4a6f-9eb8-47acf13b7692 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:35.062690 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08163b-a8f3-4a6f-9eb8-47acf13b7692 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:06:35.063482 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08163b-a8f3-4a6f-9eb8-47acf13b7692 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:35.065725 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08163b-a8f3-4a6f-9eb8-47acf13b7692 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:35.080787 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6b72b-0505-4d0b-b0fc-8e3d0a577b28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:35.083680 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6b72b-0505-4d0b-b0fc-8e3d0a577b28 service cinder] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:35.083680 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6b72b-0505-4d0b-b0fc-8e3d0a577b28 service cinder] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:35.083680 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6b72b-0505-4d0b-b0fc-8e3d0a577b28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:35.086363 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-5ee6b72b-0505-4d0b-b0fc-8e3d0a577b28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:35.116076 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1101/2175] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:06:35.116076 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2ba59-361c-415f-833e-445b5af5beae None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:35.116076 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2ba59-361c-415f-833e-445b5af5beae None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:35.116076 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2ba59-361c-415f-833e-445b5af5beae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:35.196555 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-8dc2ba59-361c-415f-833e-445b5af5beae None None] MFA Rules not processed for user `c261036fdea647f583a90f07375c7268`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:35.197809 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8dc2ba59-361c-415f-833e-445b5af5beae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:35.319207 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee6b72b-0505-4d0b-b0fc-8e3d0a577b28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:35.322115 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee6b72b-0505-4d0b-b0fc-8e3d0a577b28 service cinder] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:35.334390 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1102/2176] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:35 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:35.336077 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2ba59-361c-415f-833e-445b5af5beae None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:35.361823 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2ba59-361c-415f-833e-445b5af5beae None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:35.363743 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1075/2177] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:06:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 717 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:06:35.377025 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070fd598-7c9c-4783-b647-034170632b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:35.378280 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070fd598-7c9c-4783-b647-034170632b66 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:35.379685 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070fd598-7c9c-4783-b647-034170632b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:35.380232 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070fd598-7c9c-4783-b647-034170632b66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:35.381680 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070fd598-7c9c-4783-b647-034170632b66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:35.388136 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070fd598-7c9c-4783-b647-034170632b66 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:35.400975 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:35.447875 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6b72b-0505-4d0b-b0fc-8e3d0a577b28 service cinder] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:35.450462 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-5ee6b72b-0505-4d0b-b0fc-8e3d0a577b28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:35.477765 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6b72b-0505-4d0b-b0fc-8e3d0a577b28 service cinder] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:35.614072 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1103/2178] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:06:35 2022] POST /identity/v3/projects => generated 365 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:06:35.623990 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070fd598-7c9c-4783-b647-034170632b66 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:35.672392 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb91f3b5-cb0d-4d3b-8fb6-8e577d191066 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:35.676071 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91f3b5-cb0d-4d3b-8fb6-8e577d191066 service cinder] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:35.676564 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91f3b5-cb0d-4d3b-8fb6-8e577d191066 service cinder] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:35.677045 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91f3b5-cb0d-4d3b-8fb6-8e577d191066 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:35.704610 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb91f3b5-cb0d-4d3b-8fb6-8e577d191066 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:35.707803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb91f3b5-cb0d-4d3b-8fb6-8e577d191066 service cinder] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:35.744231 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1076/2179] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:06:35 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 04:06:35.762945 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070fd598-7c9c-4783-b647-034170632b66 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:35.768887 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b109d97-c07c-4f65-ad7f-73bfe12bbc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:35.769592 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b109d97-c07c-4f65-ad7f-73bfe12bbc25 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:35.771620 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b109d97-c07c-4f65-ad7f-73bfe12bbc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:35.771620 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b109d97-c07c-4f65-ad7f-73bfe12bbc25 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:35.771620 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b109d97-c07c-4f65-ad7f-73bfe12bbc25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:35.772932 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b109d97-c07c-4f65-ad7f-73bfe12bbc25 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:36.015358 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1104/2180] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:06:35 2022] POST /identity/v3/users => generated 283 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:06:36.021325 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb91f3b5-cb0d-4d3b-8fb6-8e577d191066 service cinder] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:36.035520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb91f3b5-cb0d-4d3b-8fb6-8e577d191066 service cinder] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:36.040875 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487d37e-6f52-4faf-8cce-941728b4dfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:36.041664 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487d37e-6f52-4faf-8cce-941728b4dfbf admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:36.042803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487d37e-6f52-4faf-8cce-941728b4dfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:36.043080 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487d37e-6f52-4faf-8cce-941728b4dfbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:36.043879 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6487d37e-6f52-4faf-8cce-941728b4dfbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:36.045607 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6487d37e-6f52-4faf-8cce-941728b4dfbf admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:36.053662 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b109d97-c07c-4f65-ad7f-73bfe12bbc25 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:36.057436 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2b109d97-c07c-4f65-ad7f-73bfe12bbc25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:36.058838 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1077/2181] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:06:36.064106 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487d37e-6f52-4faf-8cce-941728b4dfbf admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:36.075993 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487d37e-6f52-4faf-8cce-941728b4dfbf admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:36.081413 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b109d97-c07c-4f65-ad7f-73bfe12bbc25 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:36.083009 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83af1f-b5ca-47ac-bc02-717b535850da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:36.084122 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83af1f-b5ca-47ac-bc02-717b535850da admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:36.084401 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83af1f-b5ca-47ac-bc02-717b535850da admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:36.084725 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83af1f-b5ca-47ac-bc02-717b535850da admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:36.085460 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f83af1f-b5ca-47ac-bc02-717b535850da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:36.087313 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f83af1f-b5ca-47ac-bc02-717b535850da admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:36.093329 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d0140-fa49-4d31-88ce-144096e86bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:36.094025 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d0140-fa49-4d31-88ce-144096e86bc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:36.094437 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d0140-fa49-4d31-88ce-144096e86bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:36.094843 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d0140-fa49-4d31-88ce-144096e86bc8 admin admin] PATH_INFO: `/v3/users/350a930116a14f89986dc60dcd046e07` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:36.106912 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3d0140-fa49-4d31-88ce-144096e86bc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=350a930116a14f89986dc60dcd046e07)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:36.110371 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1078/2182] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:06:36.111722 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3d0140-fa49-4d31-88ce-144096e86bc8 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:36.114234 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d24aef-e850-49b4-bdbf-62d41e896126 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:36.114539 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d24aef-e850-49b4-bdbf-62d41e896126 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:36.114816 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d24aef-e850-49b4-bdbf-62d41e896126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:36.135750 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-f0d24aef-e850-49b4-bdbf-62d41e896126 None None] MFA Rules not processed for user `71b72d9b9e3a4eb2ba1aae5d8a924afd`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:36.137289 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-f0d24aef-e850-49b4-bdbf-62d41e896126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:36.235133 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1079/2183] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:36.236574 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d24aef-e850-49b4-bdbf-62d41e896126 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:36.259644 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d24aef-e850-49b4-bdbf-62d41e896126 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:36.268480 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f216c7e-d3cf-4f89-a69a-89196350a5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:36.275135 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f216c7e-d3cf-4f89-a69a-89196350a5e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:36.275691 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f216c7e-d3cf-4f89-a69a-89196350a5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:36.276151 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f216c7e-d3cf-4f89-a69a-89196350a5e4 admin admin] PATH_INFO: `/v3/projects/7ff51c8abad04cb5b0769861ad71f100/users/0adb85510b5a4b61924ef06d409e92f6/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:36.315275 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f216c7e-d3cf-4f89-a69a-89196350a5e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ff51c8abad04cb5b0769861ad71f100, user_id=0adb85510b5a4b61924ef06d409e92f6, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:36.325363 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f216c7e-d3cf-4f89-a69a-89196350a5e4 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:36.389756 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-de3d0140-fa49-4d31-88ce-144096e86bc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '350a930116a14f89986dc60dcd046e07'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:36.391148 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-de3d0140-fa49-4d31-88ce-144096e86bc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '350a930116a14f89986dc60dcd046e07'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:36.439941 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-de3d0140-fa49-4d31-88ce-144096e86bc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '350a930116a14f89986dc60dcd046e07'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:36.450516 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-de3d0140-fa49-4d31-88ce-144096e86bc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '350a930116a14f89986dc60dcd046e07'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:36.451440 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-de3d0140-fa49-4d31-88ce-144096e86bc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '350a930116a14f89986dc60dcd046e07'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:36.454820 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1080/2184] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:06:36 2022] PUT /identity/v3/projects/7ff51c8abad04cb5b0769861ad71f100/users/0adb85510b5a4b61924ef06d409e92f6/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:36.479354 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423a1f0-7811-4d2f-a62d-e32b05a45abb None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:36.481167 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423a1f0-7811-4d2f-a62d-e32b05a45abb None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:36.481167 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423a1f0-7811-4d2f-a62d-e32b05a45abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:36.522096 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-4423a1f0-7811-4d2f-a62d-e32b05a45abb None None] MFA Rules not processed for user `0adb85510b5a4b61924ef06d409e92f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:36.523595 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-4423a1f0-7811-4d2f-a62d-e32b05a45abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:36.581010 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1105/2185] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:06:36 2022] DELETE /identity/v3/users/350a930116a14f89986dc60dcd046e07 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:36.587018 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2e023-c755-443e-8a49-f94978a30804 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:36.587317 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2e023-c755-443e-8a49-f94978a30804 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:36.587608 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2e023-c755-443e-8a49-f94978a30804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:36.638955 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-69a2e023-c755-443e-8a49-f94978a30804 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:36.641939 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-69a2e023-c755-443e-8a49-f94978a30804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:36.645969 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1081/2186] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:36 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:36.652645 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423a1f0-7811-4d2f-a62d-e32b05a45abb None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:36.656689 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-4423a1f0-7811-4d2f-a62d-e32b05a45abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:36.747347 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423a1f0-7811-4d2f-a62d-e32b05a45abb None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:36.792954 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1106/2187] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:36.814803 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2e023-c755-443e-8a49-f94978a30804 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:36.820980 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-69a2e023-c755-443e-8a49-f94978a30804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:36.855886 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ced9d1-6050-4e4e-a2b7-e991af7afc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:36.856913 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ced9d1-6050-4e4e-a2b7-e991af7afc78 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:36.857297 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ced9d1-6050-4e4e-a2b7-e991af7afc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:36.857773 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ced9d1-6050-4e4e-a2b7-e991af7afc78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:36.859362 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ced9d1-6050-4e4e-a2b7-e991af7afc78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:36.860983 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ced9d1-6050-4e4e-a2b7-e991af7afc78 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:36.919153 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2e023-c755-443e-8a49-f94978a30804 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:36.925017 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f68489-f9d6-4f64-89a5-dc89f136103b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:36.927844 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f68489-f9d6-4f64-89a5-dc89f136103b service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:36.928208 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f68489-f9d6-4f64-89a5-dc89f136103b service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:36.928508 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f68489-f9d6-4f64-89a5-dc89f136103b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:36.945145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f68489-f9d6-4f64-89a5-dc89f136103b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:36.961483 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f68489-f9d6-4f64-89a5-dc89f136103b service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:36.975270 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1082/2188] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:06:36 2022] POST /identity/v3/projects => generated 369 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:06:36.976343 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ced9d1-6050-4e4e-a2b7-e991af7afc78 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:36.978421 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-12ced9d1-6050-4e4e-a2b7-e991af7afc78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:36.980283 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1107/2189] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:06:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:06:36.981284 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f68489-f9d6-4f64-89a5-dc89f136103b service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:36.993698 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f68489-f9d6-4f64-89a5-dc89f136103b service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:37.080681 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ced9d1-6050-4e4e-a2b7-e991af7afc78 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:37.114979 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af253d6a-45d8-455a-9744-067f98a077b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:37.122706 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af253d6a-45d8-455a-9744-067f98a077b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:37.123129 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af253d6a-45d8-455a-9744-067f98a077b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:37.123290 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af253d6a-45d8-455a-9744-067f98a077b5 admin admin] PATH_INFO: `/v3/users/8e51fd34b940456abaf071c37a2329ba` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:37.125362 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af253d6a-45d8-455a-9744-067f98a077b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e51fd34b940456abaf071c37a2329ba)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:37.131213 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af253d6a-45d8-455a-9744-067f98a077b5 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:37.196094 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd47e1-12c9-4da1-a69e-74ee7f2b82d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:37.201226 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd47e1-12c9-4da1-a69e-74ee7f2b82d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:37.201828 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd47e1-12c9-4da1-a69e-74ee7f2b82d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:37.203955 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd47e1-12c9-4da1-a69e-74ee7f2b82d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:37.209817 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd47e1-12c9-4da1-a69e-74ee7f2b82d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:37.213767 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd47e1-12c9-4da1-a69e-74ee7f2b82d1 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:37.402819 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1108/2190] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:06:36 2022] POST /identity/v3/users => generated 291 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:06:37.411891 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd47e1-12c9-4da1-a69e-74ee7f2b82d1 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:37.420172 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd47e1-12c9-4da1-a69e-74ee7f2b82d1 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:37.427204 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1fe2c-d5b3-4025-8ec8-fc4d67d81cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:37.427956 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1fe2c-d5b3-4025-8ec8-fc4d67d81cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:37.428247 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1fe2c-d5b3-4025-8ec8-fc4d67d81cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:37.428556 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1fe2c-d5b3-4025-8ec8-fc4d67d81cb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:37.429285 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a1fe2c-d5b3-4025-8ec8-fc4d67d81cb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:37.431056 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a1fe2c-d5b3-4025-8ec8-fc4d67d81cb7 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:37.447789 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1109/2191] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:06:37.448874 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1fe2c-d5b3-4025-8ec8-fc4d67d81cb7 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:37.461284 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1fe2c-d5b3-4025-8ec8-fc4d67d81cb7 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:37.468867 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3888efe-82cb-4e5c-8087-460910024e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:37.469779 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3888efe-82cb-4e5c-8087-460910024e6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:37.470066 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3888efe-82cb-4e5c-8087-460910024e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:37.470352 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3888efe-82cb-4e5c-8087-460910024e6a admin admin] PATH_INFO: `/v3/projects/84c90e59da3c43008811801245410b42/users/775f7bbd3ce246dcb65cb10cec94ed30/roles/681755518698445fabd9a8accec13c0f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:37.495927 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3888efe-82cb-4e5c-8087-460910024e6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=84c90e59da3c43008811801245410b42, user_id=775f7bbd3ce246dcb65cb10cec94ed30, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:37.498780 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3888efe-82cb-4e5c-8087-460910024e6a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:37.530768 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:37.535938 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-af253d6a-45d8-455a-9744-067f98a077b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e51fd34b940456abaf071c37a2329ba'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:37.538789 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-af253d6a-45d8-455a-9744-067f98a077b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e51fd34b940456abaf071c37a2329ba'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:37.632061 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1110/2192] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:06:37 2022] PUT /identity/v3/projects/84c90e59da3c43008811801245410b42/users/775f7bbd3ce246dcb65cb10cec94ed30/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:37.632842 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3888efe-82cb-4e5c-8087-460910024e6a admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:37.635230 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e3888efe-82cb-4e5c-8087-460910024e6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:37.656550 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-af253d6a-45d8-455a-9744-067f98a077b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e51fd34b940456abaf071c37a2329ba'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:37.657278 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-af253d6a-45d8-455a-9744-067f98a077b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e51fd34b940456abaf071c37a2329ba'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:37.669100 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-af253d6a-45d8-455a-9744-067f98a077b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e51fd34b940456abaf071c37a2329ba'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:37.723472 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1083/2193] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:06:36 2022] DELETE /identity/v3/users/8e51fd34b940456abaf071c37a2329ba => generated 0 bytes in 747 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:37.737695 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4a985-1a4c-4b2a-a626-3654c7fde9ce None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:37.738085 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4a985-1a4c-4b2a-a626-3654c7fde9ce None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:37.738368 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4a985-1a4c-4b2a-a626-3654c7fde9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:37.758335 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3888efe-82cb-4e5c-8087-460910024e6a admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:37.759689 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-3ea4a985-1a4c-4b2a-a626-3654c7fde9ce None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:37.760991 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-3ea4a985-1a4c-4b2a-a626-3654c7fde9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:37.871793 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1084/2194] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:37.874827 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d29f173-4c0d-4fc3-b809-d101c0597c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:37.876046 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29f173-4c0d-4fc3-b809-d101c0597c88 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:37.876794 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29f173-4c0d-4fc3-b809-d101c0597c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:37.877292 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29f173-4c0d-4fc3-b809-d101c0597c88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:37.878880 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d29f173-4c0d-4fc3-b809-d101c0597c88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:37.882719 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d29f173-4c0d-4fc3-b809-d101c0597c88 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:37.888590 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4a985-1a4c-4b2a-a626-3654c7fde9ce None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:37.890910 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-3ea4a985-1a4c-4b2a-a626-3654c7fde9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:37.928004 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4a985-1a4c-4b2a-a626-3654c7fde9ce None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:37.942499 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59fc26d-69e2-4197-876a-4203364ddad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:37.943508 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59fc26d-69e2-4197-876a-4203364ddad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:37.943852 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59fc26d-69e2-4197-876a-4203364ddad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:37.944414 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59fc26d-69e2-4197-876a-4203364ddad3 admin admin] PATH_INFO: `/v3/projects/1f500b227381416f8e7b3a18338d3736` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:37.948820 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59fc26d-69e2-4197-876a-4203364ddad3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f500b227381416f8e7b3a18338d3736)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:37.951106 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59fc26d-69e2-4197-876a-4203364ddad3 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:37.957828 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1111/2195] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 04:06:37.960006 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d29f173-4c0d-4fc3-b809-d101c0597c88 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:37.970303 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0d29f173-4c0d-4fc3-b809-d101c0597c88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:38.165838 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-e59fc26d-69e2-4197-876a-4203364ddad3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f500b227381416f8e7b3a18338d3736', 'request_id': 'req-e59fc26d-69e2-4197-876a-4203364ddad3'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:38.187937 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-e59fc26d-69e2-4197-876a-4203364ddad3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f500b227381416f8e7b3a18338d3736', 'request_id': 'req-e59fc26d-69e2-4197-876a-4203364ddad3'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:38.215469 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-e59fc26d-69e2-4197-876a-4203364ddad3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f500b227381416f8e7b3a18338d3736', 'request_id': 'req-e59fc26d-69e2-4197-876a-4203364ddad3'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:38.217506 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d29f173-4c0d-4fc3-b809-d101c0597c88 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:38.340422 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-e59fc26d-69e2-4197-876a-4203364ddad3 admin admin] The token cache is being invalidate because project 1f500b227381416f8e7b3a18338d3736 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:06:38.340901 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-e59fc26d-69e2-4197-876a-4203364ddad3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:38.344867 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-e59fc26d-69e2-4197-876a-4203364ddad3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:38.354073 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1085/2196] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:06:37 2022] DELETE /identity/v3/projects/1f500b227381416f8e7b3a18338d3736 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:38.355222 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59fc26d-69e2-4197-876a-4203364ddad3 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:38.359355 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-e59fc26d-69e2-4197-876a-4203364ddad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:38.399931 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf2ae1-3a89-4bb9-b5dd-c73c383db254 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:38.402085 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf2ae1-3a89-4bb9-b5dd-c73c383db254 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:38.402488 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf2ae1-3a89-4bb9-b5dd-c73c383db254 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:38.402932 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf2ae1-3a89-4bb9-b5dd-c73c383db254 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:38.409124 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-7ddf2ae1-3a89-4bb9-b5dd-c73c383db254 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:38.533504 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf2ae1-3a89-4bb9-b5dd-c73c383db254 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:38.535004 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf2ae1-3a89-4bb9-b5dd-c73c383db254 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:38.547700 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1112/2197] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:06:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:06:38.548642 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59fc26d-69e2-4197-876a-4203364ddad3 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:38.554656 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74042e-fcc6-45b7-9b92-1630e2c61f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:38.555800 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74042e-fcc6-45b7-9b92-1630e2c61f2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:38.556711 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74042e-fcc6-45b7-9b92-1630e2c61f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:38.557124 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045d8b7-d440-4d4a-ba21-e6d5c2049c24 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:38.557292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74042e-fcc6-45b7-9b92-1630e2c61f2f admin admin] PATH_INFO: `/v3/projects/84c90e59da3c43008811801245410b42/users/775f7bbd3ce246dcb65cb10cec94ed30/roles/681755518698445fabd9a8accec13c0f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:38.557436 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045d8b7-d440-4d4a-ba21-e6d5c2049c24 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:38.557737 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045d8b7-d440-4d4a-ba21-e6d5c2049c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:38.561165 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74042e-fcc6-45b7-9b92-1630e2c61f2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=84c90e59da3c43008811801245410b42, user_id=775f7bbd3ce246dcb65cb10cec94ed30, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:38.565314 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74042e-fcc6-45b7-9b92-1630e2c61f2f admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:38.622064 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1086/2198] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:06:38 2022] PUT /identity/v3/projects/84c90e59da3c43008811801245410b42/users/775f7bbd3ce246dcb65cb10cec94ed30/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:38.622215 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-a045d8b7-d440-4d4a-ba21-e6d5c2049c24 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:38.622215 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a045d8b7-d440-4d4a-ba21-e6d5c2049c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:38.631101 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c9fc3-1aaf-4d2c-929e-baa943d8a236 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:38.631101 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c9fc3-1aaf-4d2c-929e-baa943d8a236 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:38.631101 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c9fc3-1aaf-4d2c-929e-baa943d8a236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:38.685107 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-907c9fc3-1aaf-4d2c-929e-baa943d8a236 None None] MFA Rules not processed for user `775f7bbd3ce246dcb65cb10cec94ed30`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:38.687200 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-907c9fc3-1aaf-4d2c-929e-baa943d8a236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:38.752844 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1113/2199] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:38.760314 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4adc6-fe5a-4374-86dc-25cff8bf1732 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:38.760712 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4adc6-fe5a-4374-86dc-25cff8bf1732 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:38.761032 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4adc6-fe5a-4374-86dc-25cff8bf1732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:38.786130 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-dfa4adc6-fe5a-4374-86dc-25cff8bf1732 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:38.787580 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-dfa4adc6-fe5a-4374-86dc-25cff8bf1732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:38.815187 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1114/2200] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:38.816383 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4adc6-fe5a-4374-86dc-25cff8bf1732 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:38.826922 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4adc6-fe5a-4374-86dc-25cff8bf1732 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:38.835077 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc3efe-bb0b-4926-81c0-fc6551c805ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:38.835245 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1087/2201] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:38 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:38.835343 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc3efe-bb0b-4926-81c0-fc6551c805ac admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:38.835343 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc3efe-bb0b-4926-81c0-fc6551c805ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:38.835343 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc3efe-bb0b-4926-81c0-fc6551c805ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:38.835343 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc3efe-bb0b-4926-81c0-fc6551c805ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:06:38.835343 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc3efe-bb0b-4926-81c0-fc6551c805ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:38.836895 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc3efe-bb0b-4926-81c0-fc6551c805ac admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:38.855174 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1115/2202] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 04:06:38.855383 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c9fc3-1aaf-4d2c-929e-baa943d8a236 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:38.856434 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc3efe-bb0b-4926-81c0-fc6551c805ac admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:38.856863 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-907c9fc3-1aaf-4d2c-929e-baa943d8a236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:38.868099 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc3efe-bb0b-4926-81c0-fc6551c805ac admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:38.874668 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbea0ee-f08b-4b1e-905b-ad64b18d8382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:38.880972 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbea0ee-f08b-4b1e-905b-ad64b18d8382 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:38.882091 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbea0ee-f08b-4b1e-905b-ad64b18d8382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:38.884156 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbea0ee-f08b-4b1e-905b-ad64b18d8382 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:38.886352 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbea0ee-f08b-4b1e-905b-ad64b18d8382 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:38.890579 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbea0ee-f08b-4b1e-905b-ad64b18d8382 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:38.942243 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c9fc3-1aaf-4d2c-929e-baa943d8a236 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:38.946263 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8036f99-afb0-47fd-b5a5-2bfa28f72835 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:38.946936 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8036f99-afb0-47fd-b5a5-2bfa28f72835 service cinder] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:38.947251 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8036f99-afb0-47fd-b5a5-2bfa28f72835 service cinder] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:38.947576 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8036f99-afb0-47fd-b5a5-2bfa28f72835 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:38.959893 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8036f99-afb0-47fd-b5a5-2bfa28f72835 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:38.961623 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8036f99-afb0-47fd-b5a5-2bfa28f72835 service cinder] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:38.973478 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1088/2203] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:06:38 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:06:39.148192 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1116/2204] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:06:38 2022] POST /identity/v3/projects => generated 363 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 04:06:39.154076 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8036f99-afb0-47fd-b5a5-2bfa28f72835 service cinder] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:39.179404 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8036f99-afb0-47fd-b5a5-2bfa28f72835 service cinder] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:39.262879 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbea0ee-f08b-4b1e-905b-ad64b18d8382 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:39.372802 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446554fd-cd55-4999-be1f-48f81fa0182b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:39.374752 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446554fd-cd55-4999-be1f-48f81fa0182b admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:39.375795 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446554fd-cd55-4999-be1f-48f81fa0182b admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:39.376487 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446554fd-cd55-4999-be1f-48f81fa0182b admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:39.378106 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446554fd-cd55-4999-be1f-48f81fa0182b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:39.382300 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446554fd-cd55-4999-be1f-48f81fa0182b admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:39.405033 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbea0ee-f08b-4b1e-905b-ad64b18d8382 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:39.410010 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85de2f-c4cb-476d-837a-5fd14da12934 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:39.419589 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85de2f-c4cb-476d-837a-5fd14da12934 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:39.419589 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85de2f-c4cb-476d-837a-5fd14da12934 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:39.419589 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85de2f-c4cb-476d-837a-5fd14da12934 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:39.419589 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-eb85de2f-c4cb-476d-837a-5fd14da12934 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:39.538384 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85de2f-c4cb-476d-837a-5fd14da12934 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:39.542825 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85de2f-c4cb-476d-837a-5fd14da12934 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:39.563829 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1117/2205] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:06:39 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:06:39.565819 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85de2f-c4cb-476d-837a-5fd14da12934 service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:39.568098 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-eb85de2f-c4cb-476d-837a-5fd14da12934 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:39.573579 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1089/2206] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:06:39 2022] POST /identity/v3/users => generated 282 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:06:39.584553 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85de2f-c4cb-476d-837a-5fd14da12934 service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:39.589634 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446554fd-cd55-4999-be1f-48f81fa0182b admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:39.593665 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57298ed4-f103-4055-9064-865d637b76c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:39.594560 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57298ed4-f103-4055-9064-865d637b76c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:39.594856 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57298ed4-f103-4055-9064-865d637b76c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:39.596166 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57298ed4-f103-4055-9064-865d637b76c2 admin admin] PATH_INFO: `/v3/projects/7f46045082174aaebaea602c708aea7d` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:39.597451 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57298ed4-f103-4055-9064-865d637b76c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f46045082174aaebaea602c708aea7d)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:39.599739 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57298ed4-f103-4055-9064-865d637b76c2 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:39.655508 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446554fd-cd55-4999-be1f-48f81fa0182b admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:39.660848 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f9ad2-0adc-422f-92f0-3ba0680969d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:39.661589 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f9ad2-0adc-422f-92f0-3ba0680969d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:39.661881 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f9ad2-0adc-422f-92f0-3ba0680969d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:39.662157 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f9ad2-0adc-422f-92f0-3ba0680969d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:39.662898 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f9ad2-0adc-422f-92f0-3ba0680969d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:39.665317 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f9ad2-0adc-422f-92f0-3ba0680969d0 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:39.678834 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1090/2207] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:06:39.684829 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f9ad2-0adc-422f-92f0-3ba0680969d0 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:39.697365 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f9ad2-0adc-422f-92f0-3ba0680969d0 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:39.702404 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805dcc7-d478-482f-8069-1cf755cf7709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:39.703088 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805dcc7-d478-482f-8069-1cf755cf7709 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:39.703393 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805dcc7-d478-482f-8069-1cf755cf7709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:39.703718 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805dcc7-d478-482f-8069-1cf755cf7709 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:39.704514 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3805dcc7-d478-482f-8069-1cf755cf7709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:39.706627 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3805dcc7-d478-482f-8069-1cf755cf7709 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:39.720504 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1091/2208] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:06:39.725346 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805dcc7-d478-482f-8069-1cf755cf7709 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:39.739408 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805dcc7-d478-482f-8069-1cf755cf7709 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:39.746216 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999029d0-e0af-498e-95a4-6bd58c7de9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:39.747791 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999029d0-e0af-498e-95a4-6bd58c7de9e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:39.748083 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999029d0-e0af-498e-95a4-6bd58c7de9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:39.748594 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999029d0-e0af-498e-95a4-6bd58c7de9e2 admin admin] PATH_INFO: `/v3/projects/45b2500a5cc64a7b90148ff222e52c98/users/6febaf51c577417bb5b584ab23207f13/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:39.772460 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999029d0-e0af-498e-95a4-6bd58c7de9e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45b2500a5cc64a7b90148ff222e52c98, user_id=6febaf51c577417bb5b584ab23207f13, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:39.775699 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999029d0-e0af-498e-95a4-6bd58c7de9e2 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:39.902605 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1092/2209] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:06:39 2022] PUT /identity/v3/projects/45b2500a5cc64a7b90148ff222e52c98/users/6febaf51c577417bb5b584ab23207f13/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:06:39.925332 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97168aa1-725c-4f3b-a130-61b27c17c40b None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:39.926377 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97168aa1-725c-4f3b-a130-61b27c17c40b None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:39.927088 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97168aa1-725c-4f3b-a130-61b27c17c40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:39.943616 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-57298ed4-f103-4055-9064-865d637b76c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f46045082174aaebaea602c708aea7d', 'request_id': 'req-57298ed4-f103-4055-9064-865d637b76c2'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:39.992933 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-97168aa1-725c-4f3b-a130-61b27c17c40b None None] MFA Rules not processed for user `6febaf51c577417bb5b584ab23207f13`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:39.994170 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-97168aa1-725c-4f3b-a130-61b27c17c40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:40.082528 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-57298ed4-f103-4055-9064-865d637b76c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f46045082174aaebaea602c708aea7d', 'request_id': 'req-57298ed4-f103-4055-9064-865d637b76c2'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:40.093856 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-57298ed4-f103-4055-9064-865d637b76c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f46045082174aaebaea602c708aea7d', 'request_id': 'req-57298ed4-f103-4055-9064-865d637b76c2'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:40.115854 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1093/2210] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:39 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:40.116811 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-57298ed4-f103-4055-9064-865d637b76c2 admin admin] The token cache is being invalidate because project 7f46045082174aaebaea602c708aea7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:06:40.117242 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97168aa1-725c-4f3b-a130-61b27c17c40b None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:40.117477 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-57298ed4-f103-4055-9064-865d637b76c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:40.118610 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-57298ed4-f103-4055-9064-865d637b76c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:40.122025 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1118/2211] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:06:39 2022] DELETE /identity/v3/projects/7f46045082174aaebaea602c708aea7d => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:40.128064 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57298ed4-f103-4055-9064-865d637b76c2 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:40.128625 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-97168aa1-725c-4f3b-a130-61b27c17c40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:40.132939 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-57298ed4-f103-4055-9064-865d637b76c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:40.300027 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57298ed4-f103-4055-9064-865d637b76c2 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:40.305381 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97168aa1-725c-4f3b-a130-61b27c17c40b None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:40.309396 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb15a9-8035-40d3-ae19-d53f840aed0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:40.310941 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb15a9-8035-40d3-ae19-d53f840aed0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:40.311652 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb15a9-8035-40d3-ae19-d53f840aed0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:40.312375 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb15a9-8035-40d3-ae19-d53f840aed0b admin admin] PATH_INFO: `/v3/users/c261036fdea647f583a90f07375c7268` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:40.314615 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eb15a9-8035-40d3-ae19-d53f840aed0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c261036fdea647f583a90f07375c7268)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:40.315110 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc3fe7d-c7e4-499d-98db-30b2a9213bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:40.316462 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3fe7d-c7e4-499d-98db-30b2a9213bf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:40.316985 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3fe7d-c7e4-499d-98db-30b2a9213bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:40.317492 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3fe7d-c7e4-499d-98db-30b2a9213bf1 admin admin] PATH_INFO: `/v3/users/19f59a2adf614440b42165c1061857e5` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:40.318992 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eb15a9-8035-40d3-ae19-d53f840aed0b admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:40.319511 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc3fe7d-c7e4-499d-98db-30b2a9213bf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19f59a2adf614440b42165c1061857e5)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:40.324724 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc3fe7d-c7e4-499d-98db-30b2a9213bf1 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:40.564354 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-6dc3fe7d-c7e4-499d-98db-30b2a9213bf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19f59a2adf614440b42165c1061857e5'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:40.567005 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-6dc3fe7d-c7e4-499d-98db-30b2a9213bf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19f59a2adf614440b42165c1061857e5'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:40.616548 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:40.660855 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b0eb15a9-8035-40d3-ae19-d53f840aed0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c261036fdea647f583a90f07375c7268'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:40.668926 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b0eb15a9-8035-40d3-ae19-d53f840aed0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c261036fdea647f583a90f07375c7268'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:40.710403 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-6dc3fe7d-c7e4-499d-98db-30b2a9213bf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19f59a2adf614440b42165c1061857e5'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:40.711398 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-6dc3fe7d-c7e4-499d-98db-30b2a9213bf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19f59a2adf614440b42165c1061857e5'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:40.734252 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-6dc3fe7d-c7e4-499d-98db-30b2a9213bf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19f59a2adf614440b42165c1061857e5'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:40.758308 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b0eb15a9-8035-40d3-ae19-d53f840aed0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c261036fdea647f583a90f07375c7268'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:40.814226 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b0eb15a9-8035-40d3-ae19-d53f840aed0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c261036fdea647f583a90f07375c7268'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:40.817647 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b0eb15a9-8035-40d3-ae19-d53f840aed0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c261036fdea647f583a90f07375c7268'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:40.849299 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1094/2212] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:06:40 2022] DELETE /identity/v3/users/19f59a2adf614440b42165c1061857e5 => generated 0 bytes in 714 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:40.849299 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc3fe7d-c7e4-499d-98db-30b2a9213bf1 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:40.849299 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-6dc3fe7d-c7e4-499d-98db-30b2a9213bf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:41.030474 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc3fe7d-c7e4-499d-98db-30b2a9213bf1 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:41.041418 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c378fd2-64a9-4172-ab4e-435b00553c8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:41.041866 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c378fd2-64a9-4172-ab4e-435b00553c8f service cinder] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:41.054555 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c378fd2-64a9-4172-ab4e-435b00553c8f service cinder] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:41.055077 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c378fd2-64a9-4172-ab4e-435b00553c8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:41.064910 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-0c378fd2-64a9-4172-ab4e-435b00553c8f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:41.074187 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1119/2213] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:06:40 2022] DELETE /identity/v3/users/c261036fdea647f583a90f07375c7268 => generated 0 bytes in 942 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:41.076902 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6258254-2692-4337-ad2f-1e1819a1e5be None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:41.077381 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6258254-2692-4337-ad2f-1e1819a1e5be None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:41.077873 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6258254-2692-4337-ad2f-1e1819a1e5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:41.146395 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-b6258254-2692-4337-ad2f-1e1819a1e5be None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:41.148786 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b6258254-2692-4337-ad2f-1e1819a1e5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:41.275734 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c378fd2-64a9-4172-ab4e-435b00553c8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:41.281024 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c378fd2-64a9-4172-ab4e-435b00553c8f service cinder] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:41.284746 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1120/2214] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:41.297926 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6258254-2692-4337-ad2f-1e1819a1e5be None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:41.299424 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b6258254-2692-4337-ad2f-1e1819a1e5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:41.302771 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1095/2215] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:06:40 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:06:41.423578 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6258254-2692-4337-ad2f-1e1819a1e5be None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:41.433137 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:41.439936 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b6e28-d16c-43ee-a201-0a2c855d6675 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:41.440938 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b6e28-d16c-43ee-a201-0a2c855d6675 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:41.441347 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b6e28-d16c-43ee-a201-0a2c855d6675 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:41.441809 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b6e28-d16c-43ee-a201-0a2c855d6675 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:41.464342 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b6e28-d16c-43ee-a201-0a2c855d6675 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:41.467397 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b6e28-d16c-43ee-a201-0a2c855d6675 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:41.485421 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1121/2216] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:06:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:06:41.854378 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c378fd2-64a9-4172-ab4e-435b00553c8f service cinder] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:41.856690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-0c378fd2-64a9-4172-ab4e-435b00553c8f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:42.029293 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c378fd2-64a9-4172-ab4e-435b00553c8f service cinder] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:42.052471 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f76be3a-3554-4df2-b818-cd4a3bfb6803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:42.053969 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76be3a-3554-4df2-b818-cd4a3bfb6803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:42.054444 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76be3a-3554-4df2-b818-cd4a3bfb6803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:42.055119 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76be3a-3554-4df2-b818-cd4a3bfb6803 admin admin] PATH_INFO: `/v3/projects/8b97b712fd3140ed85e79c3a0275fc18` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:42.057149 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f76be3a-3554-4df2-b818-cd4a3bfb6803 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b97b712fd3140ed85e79c3a0275fc18)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:42.068625 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f76be3a-3554-4df2-b818-cd4a3bfb6803 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:42.273840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-8f76be3a-3554-4df2-b818-cd4a3bfb6803 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b97b712fd3140ed85e79c3a0275fc18', 'request_id': 'req-8f76be3a-3554-4df2-b818-cd4a3bfb6803'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:42.282030 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:42.295549 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-8f76be3a-3554-4df2-b818-cd4a3bfb6803 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b97b712fd3140ed85e79c3a0275fc18', 'request_id': 'req-8f76be3a-3554-4df2-b818-cd4a3bfb6803'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:42.314413 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-8f76be3a-3554-4df2-b818-cd4a3bfb6803 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b97b712fd3140ed85e79c3a0275fc18', 'request_id': 'req-8f76be3a-3554-4df2-b818-cd4a3bfb6803'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:42.435945 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-8f76be3a-3554-4df2-b818-cd4a3bfb6803 admin admin] The token cache is being invalidate because project 8b97b712fd3140ed85e79c3a0275fc18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:06:42.436628 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-8f76be3a-3554-4df2-b818-cd4a3bfb6803 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:42.437914 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-8f76be3a-3554-4df2-b818-cd4a3bfb6803 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:42.443294 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1096/2217] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:06:41 2022] DELETE /identity/v3/projects/8b97b712fd3140ed85e79c3a0275fc18 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:42.451808 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12356057-3aa6-46af-ae27-97363104410e None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:42.452335 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12356057-3aa6-46af-ae27-97363104410e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:42.452819 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12356057-3aa6-46af-ae27-97363104410e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:42.488154 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-12356057-3aa6-46af-ae27-97363104410e None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:42.488798 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-12356057-3aa6-46af-ae27-97363104410e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:42.616032 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1122/2218] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:42.632748 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9879ff6-dec8-4cb0-8837-8114a9ae52ce None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:42.633180 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9879ff6-dec8-4cb0-8837-8114a9ae52ce None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:42.633559 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9879ff6-dec8-4cb0-8837-8114a9ae52ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:42.672424 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-d9879ff6-dec8-4cb0-8837-8114a9ae52ce None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:42.672424 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-d9879ff6-dec8-4cb0-8837-8114a9ae52ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:42.696450 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1097/2219] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:42.702929 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12356057-3aa6-46af-ae27-97363104410e None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:42.715113 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12356057-3aa6-46af-ae27-97363104410e None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:42.724245 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9346e222-e207-49ea-b6e1-e7838307f1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:42.725544 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346e222-e207-49ea-b6e1-e7838307f1fa admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:42.726140 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346e222-e207-49ea-b6e1-e7838307f1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:42.726718 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346e222-e207-49ea-b6e1-e7838307f1fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:42.728284 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346e222-e207-49ea-b6e1-e7838307f1fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:06:42.728944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346e222-e207-49ea-b6e1-e7838307f1fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:42.733089 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346e222-e207-49ea-b6e1-e7838307f1fa admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:42.757753 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1123/2220] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:06:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 04:06:42.764985 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9879ff6-dec8-4cb0-8837-8114a9ae52ce None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:42.778722 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9346e222-e207-49ea-b6e1-e7838307f1fa admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:42.781458 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9346e222-e207-49ea-b6e1-e7838307f1fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:42.839482 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9346e222-e207-49ea-b6e1-e7838307f1fa admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:42.841305 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9879ff6-dec8-4cb0-8837-8114a9ae52ce None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:42.866312 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564892b-37f5-4a0e-86b4-4eba6932e3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:42.869848 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564892b-37f5-4a0e-86b4-4eba6932e3f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:42.870776 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd63a63-bf83-47f8-bcd8-72eb8b36a99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:42.871519 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564892b-37f5-4a0e-86b4-4eba6932e3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:42.871519 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564892b-37f5-4a0e-86b4-4eba6932e3f8 admin admin] PATH_INFO: `/v3/projects/a767bc3aa4354d14a2d1288ab866538f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:42.873840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd63a63-bf83-47f8-bcd8-72eb8b36a99e admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:42.874651 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1564892b-37f5-4a0e-86b4-4eba6932e3f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a767bc3aa4354d14a2d1288ab866538f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:42.876249 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd63a63-bf83-47f8-bcd8-72eb8b36a99e admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:42.877218 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd63a63-bf83-47f8-bcd8-72eb8b36a99e admin admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:42.879083 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd63a63-bf83-47f8-bcd8-72eb8b36a99e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:42.883010 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1564892b-37f5-4a0e-86b4-4eba6932e3f8 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:42.887006 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd63a63-bf83-47f8-bcd8-72eb8b36a99e admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:43.075149 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1098/2221] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:06:42 2022] POST /identity/v3/projects => generated 373 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:06:43.076721 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd63a63-bf83-47f8-bcd8-72eb8b36a99e admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:43.228054 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd63a63-bf83-47f8-bcd8-72eb8b36a99e admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:43.242676 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-1564892b-37f5-4a0e-86b4-4eba6932e3f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a767bc3aa4354d14a2d1288ab866538f', 'request_id': 'req-1564892b-37f5-4a0e-86b4-4eba6932e3f8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:43.338362 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-1564892b-37f5-4a0e-86b4-4eba6932e3f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a767bc3aa4354d14a2d1288ab866538f', 'request_id': 'req-1564892b-37f5-4a0e-86b4-4eba6932e3f8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:43.342843 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad6803b-e67f-4251-8ae9-52e2f25d010b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:43.344558 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6803b-e67f-4251-8ae9-52e2f25d010b admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:43.345249 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6803b-e67f-4251-8ae9-52e2f25d010b admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:43.346794 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6803b-e67f-4251-8ae9-52e2f25d010b admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:43.347834 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad6803b-e67f-4251-8ae9-52e2f25d010b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:43.354218 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad6803b-e67f-4251-8ae9-52e2f25d010b admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:43.358371 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-1564892b-37f5-4a0e-86b4-4eba6932e3f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a767bc3aa4354d14a2d1288ab866538f', 'request_id': 'req-1564892b-37f5-4a0e-86b4-4eba6932e3f8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:43.383548 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-1564892b-37f5-4a0e-86b4-4eba6932e3f8 admin admin] The token cache is being invalidate because project a767bc3aa4354d14a2d1288ab866538f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:06:43.383991 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-1564892b-37f5-4a0e-86b4-4eba6932e3f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:43.384941 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-1564892b-37f5-4a0e-86b4-4eba6932e3f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:43.387519 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1124/2222] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:06:42 2022] DELETE /identity/v3/projects/a767bc3aa4354d14a2d1288ab866538f => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:06:43.393241 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564892b-37f5-4a0e-86b4-4eba6932e3f8 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:43.395356 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1564892b-37f5-4a0e-86b4-4eba6932e3f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:43.412965 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564892b-37f5-4a0e-86b4-4eba6932e3f8 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:43.419086 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ad95a-7509-4280-b4fa-175bf218f975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:43.420300 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ad95a-7509-4280-b4fa-175bf218f975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:43.420710 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ad95a-7509-4280-b4fa-175bf218f975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:43.421190 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ad95a-7509-4280-b4fa-175bf218f975 admin admin] PATH_INFO: `/v3/users/cb788dd4c0ef4ec29b8a2d0f6aa8b3ce` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:43.422797 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97ad95a-7509-4280-b4fa-175bf218f975 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb788dd4c0ef4ec29b8a2d0f6aa8b3ce)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:43.426615 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97ad95a-7509-4280-b4fa-175bf218f975 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:43.484316 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1099/2223] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:06:43 2022] POST /identity/v3/users => generated 287 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:06:43.496787 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad6803b-e67f-4251-8ae9-52e2f25d010b admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:43.503417 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-3ad6803b-e67f-4251-8ae9-52e2f25d010b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:43.546153 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad6803b-e67f-4251-8ae9-52e2f25d010b admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:43.556957 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c710e444-f51e-4911-94ee-e6f3ea97147f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:43.557308 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710e444-f51e-4911-94ee-e6f3ea97147f admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:43.558355 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710e444-f51e-4911-94ee-e6f3ea97147f admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:43.558919 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710e444-f51e-4911-94ee-e6f3ea97147f admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:43.561515 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c710e444-f51e-4911-94ee-e6f3ea97147f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:43.563891 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c710e444-f51e-4911-94ee-e6f3ea97147f admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:43.586292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1100/2224] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:06:43.588937 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c710e444-f51e-4911-94ee-e6f3ea97147f admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:43.604551 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c710e444-f51e-4911-94ee-e6f3ea97147f admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:43.622513 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f73a7-a57c-48fe-947f-a4b65e2778c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:43.624081 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f73a7-a57c-48fe-947f-a4b65e2778c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:43.624684 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f73a7-a57c-48fe-947f-a4b65e2778c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:43.625522 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f73a7-a57c-48fe-947f-a4b65e2778c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:43.626864 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f73a7-a57c-48fe-947f-a4b65e2778c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:43.632349 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f73a7-a57c-48fe-947f-a4b65e2778c6 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:43.666462 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1101/2225] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 04:06:43.673656 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f73a7-a57c-48fe-947f-a4b65e2778c6 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:43.701311 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f73a7-a57c-48fe-947f-a4b65e2778c6 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:43.710590 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8acb2-7207-4c4d-8090-4a05be23ad98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:43.711788 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8acb2-7207-4c4d-8090-4a05be23ad98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:43.712405 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8acb2-7207-4c4d-8090-4a05be23ad98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:43.726271 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8acb2-7207-4c4d-8090-4a05be23ad98 admin admin] PATH_INFO: `/v3/projects/81d89cef45a1421f88fb9d8757043070/users/05862744ad144ebcb851a9e98bac6c54/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:43.766565 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b8acb2-7207-4c4d-8090-4a05be23ad98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81d89cef45a1421f88fb9d8757043070, user_id=05862744ad144ebcb851a9e98bac6c54, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:43.770322 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b8acb2-7207-4c4d-8090-4a05be23ad98 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:43.904962 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1102/2226] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:06:43 2022] PUT /identity/v3/projects/81d89cef45a1421f88fb9d8757043070/users/05862744ad144ebcb851a9e98bac6c54/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:43.907822 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e97ad95a-7509-4280-b4fa-175bf218f975 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb788dd4c0ef4ec29b8a2d0f6aa8b3ce'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:43.912351 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a6406-a991-426a-a674-73881dff48ba None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:43.913153 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e97ad95a-7509-4280-b4fa-175bf218f975 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb788dd4c0ef4ec29b8a2d0f6aa8b3ce'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:43.914429 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a6406-a991-426a-a674-73881dff48ba None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:43.917658 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a6406-a991-426a-a674-73881dff48ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:43.951379 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e97ad95a-7509-4280-b4fa-175bf218f975 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb788dd4c0ef4ec29b8a2d0f6aa8b3ce'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:43.962379 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-209a6406-a991-426a-a674-73881dff48ba None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:43.964084 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-209a6406-a991-426a-a674-73881dff48ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:43.969040 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e97ad95a-7509-4280-b4fa-175bf218f975 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb788dd4c0ef4ec29b8a2d0f6aa8b3ce'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:43.970479 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e97ad95a-7509-4280-b4fa-175bf218f975 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb788dd4c0ef4ec29b8a2d0f6aa8b3ce'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:44.084951 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1125/2227] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:06:43 2022] DELETE /identity/v3/users/cb788dd4c0ef4ec29b8a2d0f6aa8b3ce => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:06:44.104445 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1103/2228] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:44.141227 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ad95a-7509-4280-b4fa-175bf218f975 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:44.143181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e97ad95a-7509-4280-b4fa-175bf218f975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:44.345168 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ad95a-7509-4280-b4fa-175bf218f975 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:44.355307 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63cd55b-90c7-499c-b1ce-661e870bb3c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:44.356599 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63cd55b-90c7-499c-b1ce-661e870bb3c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:44.357083 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63cd55b-90c7-499c-b1ce-661e870bb3c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:44.357533 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63cd55b-90c7-499c-b1ce-661e870bb3c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:44.572665 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63cd55b-90c7-499c-b1ce-661e870bb3c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:44.574400 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63cd55b-90c7-499c-b1ce-661e870bb3c0 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:44.606318 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1126/2229] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:06:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 04:06:45.107650 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:45.656981 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a6406-a991-426a-a674-73881dff48ba None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:45.659671 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-209a6406-a991-426a-a674-73881dff48ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:45.724784 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a6406-a991-426a-a674-73881dff48ba None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:45.754625 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b051e5e-6f85-42fe-abb7-1e43bc6c6f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:45.758439 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b051e5e-6f85-42fe-abb7-1e43bc6c6f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:45.758920 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b051e5e-6f85-42fe-abb7-1e43bc6c6f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:45.759421 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b051e5e-6f85-42fe-abb7-1e43bc6c6f94 admin admin] PATH_INFO: `/v3/projects/78ae20d96ab140bda510bab70e2a064e` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:45.766059 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b051e5e-6f85-42fe-abb7-1e43bc6c6f94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78ae20d96ab140bda510bab70e2a064e)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:45.777375 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b051e5e-6f85-42fe-abb7-1e43bc6c6f94 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:46.117495 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-9b051e5e-6f85-42fe-abb7-1e43bc6c6f94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78ae20d96ab140bda510bab70e2a064e', 'request_id': 'req-9b051e5e-6f85-42fe-abb7-1e43bc6c6f94'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:46.241963 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-9b051e5e-6f85-42fe-abb7-1e43bc6c6f94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78ae20d96ab140bda510bab70e2a064e', 'request_id': 'req-9b051e5e-6f85-42fe-abb7-1e43bc6c6f94'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:46.241963 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-9b051e5e-6f85-42fe-abb7-1e43bc6c6f94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78ae20d96ab140bda510bab70e2a064e', 'request_id': 'req-9b051e5e-6f85-42fe-abb7-1e43bc6c6f94'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:46.457574 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-9b051e5e-6f85-42fe-abb7-1e43bc6c6f94 admin admin] The token cache is being invalidate because project 78ae20d96ab140bda510bab70e2a064e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:06:46.458261 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-9b051e5e-6f85-42fe-abb7-1e43bc6c6f94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:46.459926 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-9b051e5e-6f85-42fe-abb7-1e43bc6c6f94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:46.463792 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1104/2230] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:06:45 2022] DELETE /identity/v3/projects/78ae20d96ab140bda510bab70e2a064e => generated 0 bytes in 808 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:46.474759 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693989b-6282-432c-9e2e-fb4803934536 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:46.475374 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693989b-6282-432c-9e2e-fb4803934536 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:46.475847 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693989b-6282-432c-9e2e-fb4803934536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:46.533393 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-5693989b-6282-432c-9e2e-fb4803934536 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:46.535793 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-5693989b-6282-432c-9e2e-fb4803934536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:46.605488 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:46.715421 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1127/2231] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 04:06:46.725288 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387fa80-f285-409b-8c31-460186eab03a None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:46.726026 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387fa80-f285-409b-8c31-460186eab03a None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:46.726562 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387fa80-f285-409b-8c31-460186eab03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:46.749780 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-e387fa80-f285-409b-8c31-460186eab03a None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:46.750369 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-e387fa80-f285-409b-8c31-460186eab03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:46.764524 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1105/2232] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:46.766326 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5693989b-6282-432c-9e2e-fb4803934536 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:46.802420 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5693989b-6282-432c-9e2e-fb4803934536 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:46.815257 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0bf91-ab16-4924-aab7-4aa999e97d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:46.817690 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0bf91-ab16-4924-aab7-4aa999e97d99 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:46.817690 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0bf91-ab16-4924-aab7-4aa999e97d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:46.818839 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0bf91-ab16-4924-aab7-4aa999e97d99 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:46.820656 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf0bf91-ab16-4924-aab7-4aa999e97d99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:06:46.821403 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf0bf91-ab16-4924-aab7-4aa999e97d99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:46.823549 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf0bf91-ab16-4924-aab7-4aa999e97d99 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:46.838566 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1128/2233] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:06:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:06:46.843967 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387fa80-f285-409b-8c31-460186eab03a None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:46.855202 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387fa80-f285-409b-8c31-460186eab03a None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:46.861505 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bddb3f-ea3a-4447-adc7-d1e6ad5b9a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:46.862226 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bddb3f-ea3a-4447-adc7-d1e6ad5b9a8b admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:46.862506 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bddb3f-ea3a-4447-adc7-d1e6ad5b9a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:46.862785 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bddb3f-ea3a-4447-adc7-d1e6ad5b9a8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:46.863793 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bddb3f-ea3a-4447-adc7-d1e6ad5b9a8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:46.865668 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bddb3f-ea3a-4447-adc7-d1e6ad5b9a8b admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:47.068225 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1106/2234] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:06:46 2022] POST /identity/v3/projects => generated 371 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:06:47.075161 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0bf91-ab16-4924-aab7-4aa999e97d99 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:47.098038 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0bf91-ab16-4924-aab7-4aa999e97d99 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:47.244334 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bddb3f-ea3a-4447-adc7-d1e6ad5b9a8b admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:47.249752 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-11bddb3f-ea3a-4447-adc7-d1e6ad5b9a8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:47.311719 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30e28d-38e4-448d-91f2-5bae2d244111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:47.317364 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30e28d-38e4-448d-91f2-5bae2d244111 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:47.317364 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30e28d-38e4-448d-91f2-5bae2d244111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:47.317364 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30e28d-38e4-448d-91f2-5bae2d244111 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:47.317364 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e30e28d-38e4-448d-91f2-5bae2d244111 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:47.319866 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e30e28d-38e4-448d-91f2-5bae2d244111 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:47.429425 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1129/2235] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:06:47 2022] POST /identity/v3/users => generated 286 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:06:47.434845 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30e28d-38e4-448d-91f2-5bae2d244111 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:47.454916 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30e28d-38e4-448d-91f2-5bae2d244111 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:47.472854 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00619fe5-66ac-4a3c-8570-e8c36052900c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:47.473979 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00619fe5-66ac-4a3c-8570-e8c36052900c admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:47.474272 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00619fe5-66ac-4a3c-8570-e8c36052900c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:47.474544 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00619fe5-66ac-4a3c-8570-e8c36052900c admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:47.475530 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00619fe5-66ac-4a3c-8570-e8c36052900c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:47.480424 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00619fe5-66ac-4a3c-8570-e8c36052900c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:47.495864 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bddb3f-ea3a-4447-adc7-d1e6ad5b9a8b admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:47.502831 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1130/2236] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 04:06:47.507889 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00619fe5-66ac-4a3c-8570-e8c36052900c admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:47.518049 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f74b0-b367-4178-8a31-9308e3c22908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:47.518049 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f74b0-b367-4178-8a31-9308e3c22908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:47.518520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f74b0-b367-4178-8a31-9308e3c22908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:47.518711 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f74b0-b367-4178-8a31-9308e3c22908 admin admin] PATH_INFO: `/v3/users/0adb85510b5a4b61924ef06d409e92f6` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:47.520605 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f74b0-b367-4178-8a31-9308e3c22908 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0adb85510b5a4b61924ef06d409e92f6)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:47.523032 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f74b0-b367-4178-8a31-9308e3c22908 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:47.535343 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00619fe5-66ac-4a3c-8570-e8c36052900c admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:47.552012 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9f979-cef9-42fb-8295-7143d98afe2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:47.558353 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9f979-cef9-42fb-8295-7143d98afe2e admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:47.558353 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9f979-cef9-42fb-8295-7143d98afe2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:47.558353 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9f979-cef9-42fb-8295-7143d98afe2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:47.558353 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9f979-cef9-42fb-8295-7143d98afe2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:47.561460 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9f979-cef9-42fb-8295-7143d98afe2e admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:47.592416 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1131/2237] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:06:47.600363 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9f979-cef9-42fb-8295-7143d98afe2e admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:47.625524 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9f979-cef9-42fb-8295-7143d98afe2e admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:47.636057 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da04a2-137c-462b-9c2f-9b7c412a91df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:47.644503 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da04a2-137c-462b-9c2f-9b7c412a91df admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:47.644503 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da04a2-137c-462b-9c2f-9b7c412a91df admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:47.644503 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da04a2-137c-462b-9c2f-9b7c412a91df admin admin] PATH_INFO: `/v3/projects/fe3e4a4778534182afc7c220ca0f86a9/users/ea3be916625844d1b54f8550aef3317d/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:47.671023 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da04a2-137c-462b-9c2f-9b7c412a91df admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe3e4a4778534182afc7c220ca0f86a9, user_id=ea3be916625844d1b54f8550aef3317d, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:47.674508 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da04a2-137c-462b-9c2f-9b7c412a91df admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:47.867888 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1132/2238] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:06:47 2022] PUT /identity/v3/projects/fe3e4a4778534182afc7c220ca0f86a9/users/ea3be916625844d1b54f8550aef3317d/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:47.876778 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb258fe-941c-4493-a846-9e1233d09f64 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:47.877273 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb258fe-941c-4493-a846-9e1233d09f64 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:47.878123 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb258fe-941c-4493-a846-9e1233d09f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:47.919657 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-8eb258fe-941c-4493-a846-9e1233d09f64 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:47.922107 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8eb258fe-941c-4493-a846-9e1233d09f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:47.964997 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-503f74b0-b367-4178-8a31-9308e3c22908 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0adb85510b5a4b61924ef06d409e92f6'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:47.974510 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-503f74b0-b367-4178-8a31-9308e3c22908 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0adb85510b5a4b61924ef06d409e92f6'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:48.060022 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1133/2239] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:48.075547 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb258fe-941c-4493-a846-9e1233d09f64 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:48.077508 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8eb258fe-941c-4493-a846-9e1233d09f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:48.115144 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-503f74b0-b367-4178-8a31-9308e3c22908 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0adb85510b5a4b61924ef06d409e92f6'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:48.116136 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-503f74b0-b367-4178-8a31-9308e3c22908 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0adb85510b5a4b61924ef06d409e92f6'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:48.127201 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-503f74b0-b367-4178-8a31-9308e3c22908 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0adb85510b5a4b61924ef06d409e92f6'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:48.160001 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1107/2240] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:06:47 2022] DELETE /identity/v3/users/0adb85510b5a4b61924ef06d409e92f6 => generated 0 bytes in 918 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:06:48.167991 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425fe9a-7a5e-49ee-bfde-c64466df146c None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:48.168582 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425fe9a-7a5e-49ee-bfde-c64466df146c None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:48.169369 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425fe9a-7a5e-49ee-bfde-c64466df146c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:48.192530 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-a425fe9a-7a5e-49ee-bfde-c64466df146c None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:48.196231 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb258fe-941c-4493-a846-9e1233d09f64 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:48.196429 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-a425fe9a-7a5e-49ee-bfde-c64466df146c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:48.320945 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b32c7-9df3-471a-afb3-e0d6aa04e556 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:48.321501 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b32c7-9df3-471a-afb3-e0d6aa04e556 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:48.321780 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b32c7-9df3-471a-afb3-e0d6aa04e556 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:48.322070 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b32c7-9df3-471a-afb3-e0d6aa04e556 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:48.327772 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1108/2241] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 04:06:48.327772 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47335d6-92b6-47c1-be11-72488f422956 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:48.327772 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47335d6-92b6-47c1-be11-72488f422956 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:48.327772 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47335d6-92b6-47c1-be11-72488f422956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:48.351750 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b32c7-9df3-471a-afb3-e0d6aa04e556 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:48.354848 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b32c7-9df3-471a-afb3-e0d6aa04e556 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:48.358935 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-e47335d6-92b6-47c1-be11-72488f422956 None None] MFA Rules not processed for user `87d63f772da6431abd35221bc9efa038`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:48.361199 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-e47335d6-92b6-47c1-be11-72488f422956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:48.375844 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1134/2242] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:06:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 04:06:48.377890 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b32c7-9df3-471a-afb3-e0d6aa04e556 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:48.397343 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b32c7-9df3-471a-afb3-e0d6aa04e556 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:48.410723 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ff386-c23e-4ea7-aabc-27474afab317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:48.411627 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ff386-c23e-4ea7-aabc-27474afab317 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:48.412228 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ff386-c23e-4ea7-aabc-27474afab317 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:48.412832 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ff386-c23e-4ea7-aabc-27474afab317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:48.438893 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ff386-c23e-4ea7-aabc-27474afab317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:48.442502 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ff386-c23e-4ea7-aabc-27474afab317 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:48.479556 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1109/2243] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:48.483794 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1135/2244] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:06:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:06:49.333137 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:49.344980 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb9d0e-76f8-429e-b8cf-97c8737c47e6 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:49.345522 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb9d0e-76f8-429e-b8cf-97c8737c47e6 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:49.345964 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb9d0e-76f8-429e-b8cf-97c8737c47e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:49.439350 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ff386-c23e-4ea7-aabc-27474afab317 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:49.439866 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:49.442996 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ae9ff386-c23e-4ea7-aabc-27474afab317 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:49.466621 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-9dcb9d0e-76f8-429e-b8cf-97c8737c47e6 None None] MFA Rules not processed for user `05862744ad144ebcb851a9e98bac6c54`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:49.468367 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-9dcb9d0e-76f8-429e-b8cf-97c8737c47e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:49.559625 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ff386-c23e-4ea7-aabc-27474afab317 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:49.580258 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d224e4-b896-4c7f-bf8b-a6eaeee6ebf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:49.582037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d224e4-b896-4c7f-bf8b-a6eaeee6ebf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:49.582703 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d224e4-b896-4c7f-bf8b-a6eaeee6ebf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:49.587991 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d224e4-b896-4c7f-bf8b-a6eaeee6ebf2 admin admin] PATH_INFO: `/v3/projects/7ff51c8abad04cb5b0769861ad71f100` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:49.587991 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d224e4-b896-4c7f-bf8b-a6eaeee6ebf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ff51c8abad04cb5b0769861ad71f100)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:49.592094 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d224e4-b896-4c7f-bf8b-a6eaeee6ebf2 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:49.675047 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1110/2245] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:49.689172 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb9d0e-76f8-429e-b8cf-97c8737c47e6 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:49.692974 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-9dcb9d0e-76f8-429e-b8cf-97c8737c47e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:49.726783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb9d0e-76f8-429e-b8cf-97c8737c47e6 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:49.737554 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d441bd-a7e2-4b4d-a2df-8d0a1d7431b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:49.738793 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d441bd-a7e2-4b4d-a2df-8d0a1d7431b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:49.739320 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d441bd-a7e2-4b4d-a2df-8d0a1d7431b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:49.739810 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d441bd-a7e2-4b4d-a2df-8d0a1d7431b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:49.742571 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d441bd-a7e2-4b4d-a2df-8d0a1d7431b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:49.749048 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d441bd-a7e2-4b4d-a2df-8d0a1d7431b9 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:49.884383 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-40d224e4-b896-4c7f-bf8b-a6eaeee6ebf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ff51c8abad04cb5b0769861ad71f100', 'request_id': 'req-40d224e4-b896-4c7f-bf8b-a6eaeee6ebf2'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:49.915952 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1111/2246] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:06:49 2022] POST /identity/v3/projects => generated 371 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 04:06:49.920629 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d441bd-a7e2-4b4d-a2df-8d0a1d7431b9 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:49.986724 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-40d224e4-b896-4c7f-bf8b-a6eaeee6ebf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ff51c8abad04cb5b0769861ad71f100', 'request_id': 'req-40d224e4-b896-4c7f-bf8b-a6eaeee6ebf2'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:50.000011 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-40d224e4-b896-4c7f-bf8b-a6eaeee6ebf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ff51c8abad04cb5b0769861ad71f100', 'request_id': 'req-40d224e4-b896-4c7f-bf8b-a6eaeee6ebf2'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:50.020412 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-40d224e4-b896-4c7f-bf8b-a6eaeee6ebf2 admin admin] The token cache is being invalidate because project 7ff51c8abad04cb5b0769861ad71f100 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:06:50.021282 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-40d224e4-b896-4c7f-bf8b-a6eaeee6ebf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:50.022757 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-40d224e4-b896-4c7f-bf8b-a6eaeee6ebf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:50.026213 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d441bd-a7e2-4b4d-a2df-8d0a1d7431b9 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:50.026847 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1136/2247] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:06:49 2022] DELETE /identity/v3/projects/7ff51c8abad04cb5b0769861ad71f100 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:50.032074 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d224e4-b896-4c7f-bf8b-a6eaeee6ebf2 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:50.034609 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728146d0-a490-4db1-a251-f33dccc5cc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:50.034609 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728146d0-a490-4db1-a251-f33dccc5cc0c admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:50.034609 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728146d0-a490-4db1-a251-f33dccc5cc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:50.034609 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728146d0-a490-4db1-a251-f33dccc5cc0c admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:50.034964 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-40d224e4-b896-4c7f-bf8b-a6eaeee6ebf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:50.035332 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728146d0-a490-4db1-a251-f33dccc5cc0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:50.037451 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728146d0-a490-4db1-a251-f33dccc5cc0c admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:50.192311 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1112/2248] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:06:49 2022] POST /identity/v3/users => generated 292 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:06:50.196782 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728146d0-a490-4db1-a251-f33dccc5cc0c admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:50.202309 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-728146d0-a490-4db1-a251-f33dccc5cc0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:50.236968 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728146d0-a490-4db1-a251-f33dccc5cc0c admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:50.244816 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75c302-cd74-49f7-8551-822b170aa537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:50.245935 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75c302-cd74-49f7-8551-822b170aa537 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:50.246421 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75c302-cd74-49f7-8551-822b170aa537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:50.247049 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75c302-cd74-49f7-8551-822b170aa537 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:50.248092 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c75c302-cd74-49f7-8551-822b170aa537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:50.250028 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c75c302-cd74-49f7-8551-822b170aa537 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:50.268829 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1113/2249] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:06:50.275235 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75c302-cd74-49f7-8551-822b170aa537 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:50.307074 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d224e4-b896-4c7f-bf8b-a6eaeee6ebf2 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:50.319922 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75c302-cd74-49f7-8551-822b170aa537 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:50.324411 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02af5ff-489b-4c25-8007-6f006122fef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:50.326545 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02af5ff-489b-4c25-8007-6f006122fef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:50.327177 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02af5ff-489b-4c25-8007-6f006122fef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:50.327757 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02af5ff-489b-4c25-8007-6f006122fef7 admin admin] PATH_INFO: `/v3/users/775f7bbd3ce246dcb65cb10cec94ed30` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:50.332181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02af5ff-489b-4c25-8007-6f006122fef7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=775f7bbd3ce246dcb65cb10cec94ed30)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:50.334969 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe9f80e-5534-425a-ae42-9c0c2f61f4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:50.340097 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9f80e-5534-425a-ae42-9c0c2f61f4e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:50.340381 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9f80e-5534-425a-ae42-9c0c2f61f4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:50.340656 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9f80e-5534-425a-ae42-9c0c2f61f4e1 admin admin] PATH_INFO: `/v3/projects/58e89e986c1e4d3992fbc7d934a039a4/users/71450a1dd85d4d00b5969685353d8faf/roles/681755518698445fabd9a8accec13c0f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:50.346878 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02af5ff-489b-4c25-8007-6f006122fef7 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:50.368819 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe9f80e-5534-425a-ae42-9c0c2f61f4e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58e89e986c1e4d3992fbc7d934a039a4, user_id=71450a1dd85d4d00b5969685353d8faf, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:50.371286 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe9f80e-5534-425a-ae42-9c0c2f61f4e1 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:50.534667 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1114/2250] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:06:50 2022] PUT /identity/v3/projects/58e89e986c1e4d3992fbc7d934a039a4/users/71450a1dd85d4d00b5969685353d8faf/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:06:50.541094 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe9f80e-5534-425a-ae42-9c0c2f61f4e1 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:50.660919 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:50.699000 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe9f80e-5534-425a-ae42-9c0c2f61f4e1 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:50.705858 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b66a90-55fd-4395-9452-d810122e6f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:50.707092 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b66a90-55fd-4395-9452-d810122e6f65 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:50.707680 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b66a90-55fd-4395-9452-d810122e6f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:50.708115 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b66a90-55fd-4395-9452-d810122e6f65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:50.709255 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b66a90-55fd-4395-9452-d810122e6f65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:50.711287 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b66a90-55fd-4395-9452-d810122e6f65 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:50.730559 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1115/2251] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:06:50.736842 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b66a90-55fd-4395-9452-d810122e6f65 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:50.759632 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b66a90-55fd-4395-9452-d810122e6f65 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:50.769237 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8fd70-784d-469a-950d-ac088df72f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:50.770179 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8fd70-784d-469a-950d-ac088df72f69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:50.770462 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8fd70-784d-469a-950d-ac088df72f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:50.770781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8fd70-784d-469a-950d-ac088df72f69 admin admin] PATH_INFO: `/v3/projects/58e89e986c1e4d3992fbc7d934a039a4/users/71450a1dd85d4d00b5969685353d8faf/roles/681755518698445fabd9a8accec13c0f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:50.773195 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e8fd70-784d-469a-950d-ac088df72f69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58e89e986c1e4d3992fbc7d934a039a4, user_id=71450a1dd85d4d00b5969685353d8faf, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:50.776727 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e8fd70-784d-469a-950d-ac088df72f69 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:50.796656 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1116/2252] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:06:50 2022] PUT /identity/v3/projects/58e89e986c1e4d3992fbc7d934a039a4/users/71450a1dd85d4d00b5969685353d8faf/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:50.828920 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c02af5ff-489b-4c25-8007-6f006122fef7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '775f7bbd3ce246dcb65cb10cec94ed30'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:50.829897 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c02af5ff-489b-4c25-8007-6f006122fef7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '775f7bbd3ce246dcb65cb10cec94ed30'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:50.847032 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c02af5ff-489b-4c25-8007-6f006122fef7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '775f7bbd3ce246dcb65cb10cec94ed30'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:50.867239 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c02af5ff-489b-4c25-8007-6f006122fef7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '775f7bbd3ce246dcb65cb10cec94ed30'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:50.868357 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c02af5ff-489b-4c25-8007-6f006122fef7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '775f7bbd3ce246dcb65cb10cec94ed30'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:51.140145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1137/2253] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:06:50 2022] DELETE /identity/v3/users/775f7bbd3ce246dcb65cb10cec94ed30 => generated 0 bytes in 1109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:51.215098 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=82,keystone:INSERT=3,keystone:DELETE=15 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:52.828852 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8fd70-784d-469a-950d-ac088df72f69 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:52.835561 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-29e8fd70-784d-469a-950d-ac088df72f69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:52.968184 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8fd70-784d-469a-950d-ac088df72f69 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:53.142590 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea971d6a-cf60-429d-8142-fc3d488ec58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:53.143949 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea971d6a-cf60-429d-8142-fc3d488ec58e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:53.144445 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea971d6a-cf60-429d-8142-fc3d488ec58e admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:53.145017 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea971d6a-cf60-429d-8142-fc3d488ec58e admin admin] PATH_INFO: `/v3/projects/84c90e59da3c43008811801245410b42` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:53.146596 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea971d6a-cf60-429d-8142-fc3d488ec58e admin admin] RBAC: Authorizing `identity:delete_project(project_id=84c90e59da3c43008811801245410b42)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:53.149252 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea971d6a-cf60-429d-8142-fc3d488ec58e admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:53.406532 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-ea971d6a-cf60-429d-8142-fc3d488ec58e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84c90e59da3c43008811801245410b42', 'request_id': 'req-ea971d6a-cf60-429d-8142-fc3d488ec58e'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:53.415078 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-ea971d6a-cf60-429d-8142-fc3d488ec58e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84c90e59da3c43008811801245410b42', 'request_id': 'req-ea971d6a-cf60-429d-8142-fc3d488ec58e'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:53.423637 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-ea971d6a-cf60-429d-8142-fc3d488ec58e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84c90e59da3c43008811801245410b42', 'request_id': 'req-ea971d6a-cf60-429d-8142-fc3d488ec58e'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:53.575042 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-ea971d6a-cf60-429d-8142-fc3d488ec58e admin admin] The token cache is being invalidate because project 84c90e59da3c43008811801245410b42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:06:53.575891 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-ea971d6a-cf60-429d-8142-fc3d488ec58e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:53.576946 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-ea971d6a-cf60-429d-8142-fc3d488ec58e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:06:53.583128 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1117/2254] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:06:52 2022] DELETE /identity/v3/projects/84c90e59da3c43008811801245410b42 => generated 0 bytes in 752 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:53.585704 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb04ea8-2fca-4066-9209-e98d41e3c121 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:53.586574 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb04ea8-2fca-4066-9209-e98d41e3c121 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:53.586574 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb04ea8-2fca-4066-9209-e98d41e3c121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:53.655673 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-efb04ea8-2fca-4066-9209-e98d41e3c121 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:53.658332 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-efb04ea8-2fca-4066-9209-e98d41e3c121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:53.794683 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1138/2255] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:53.804131 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18289e5c-814f-44e3-9117-ccaeb5c2bb06 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:53.804613 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18289e5c-814f-44e3-9117-ccaeb5c2bb06 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:53.805080 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18289e5c-814f-44e3-9117-ccaeb5c2bb06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:53.862910 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-18289e5c-814f-44e3-9117-ccaeb5c2bb06 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:53.870662 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-18289e5c-814f-44e3-9117-ccaeb5c2bb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:53.888732 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1118/2256] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:53.893321 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb04ea8-2fca-4066-9209-e98d41e3c121 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:53.908395 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb04ea8-2fca-4066-9209-e98d41e3c121 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:53.922423 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cff649-5c12-4c45-a3b1-2ceb8ad69853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:53.923403 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cff649-5c12-4c45-a3b1-2ceb8ad69853 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:53.923720 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cff649-5c12-4c45-a3b1-2ceb8ad69853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:53.923994 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cff649-5c12-4c45-a3b1-2ceb8ad69853 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:53.924757 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cff649-5c12-4c45-a3b1-2ceb8ad69853 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:06:53.926729 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cff649-5c12-4c45-a3b1-2ceb8ad69853 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:53.930243 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cff649-5c12-4c45-a3b1-2ceb8ad69853 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:53.951377 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1139/2257] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:06:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:06:53.955971 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18289e5c-814f-44e3-9117-ccaeb5c2bb06 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:53.971760 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18289e5c-814f-44e3-9117-ccaeb5c2bb06 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:53.978525 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0767a3-d097-47df-8c42-dd24b2970b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:53.980159 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0767a3-d097-47df-8c42-dd24b2970b9b admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:53.981146 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0767a3-d097-47df-8c42-dd24b2970b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:53.981587 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0767a3-d097-47df-8c42-dd24b2970b9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:53.984637 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0767a3-d097-47df-8c42-dd24b2970b9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:53.985177 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0767a3-d097-47df-8c42-dd24b2970b9b admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:54.151148 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1119/2258] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:06:53 2022] POST /identity/v3/projects => generated 407 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:06:54.158694 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cff649-5c12-4c45-a3b1-2ceb8ad69853 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:54.193148 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafb828-f2e0-4445-aa02-40d8bcfaa05c None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:54.193595 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafb828-f2e0-4445-aa02-40d8bcfaa05c None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:54.193880 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafb828-f2e0-4445-aa02-40d8bcfaa05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:54.197591 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cff649-5c12-4c45-a3b1-2ceb8ad69853 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:54.292528 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-ccafb828-f2e0-4445-aa02-40d8bcfaa05c None None] MFA Rules not processed for user `71450a1dd85d4d00b5969685353d8faf`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:54.296947 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-ccafb828-f2e0-4445-aa02-40d8bcfaa05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:54.373423 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01234c90-96ef-4525-a216-7a26f67b51ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:54.374800 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01234c90-96ef-4525-a216-7a26f67b51ff admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:54.374800 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01234c90-96ef-4525-a216-7a26f67b51ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:54.375125 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01234c90-96ef-4525-a216-7a26f67b51ff admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:54.376074 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01234c90-96ef-4525-a216-7a26f67b51ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:54.380192 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01234c90-96ef-4525-a216-7a26f67b51ff admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:54.490203 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1120/2259] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:54 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:54.503340 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe8c6b-671b-45af-b3b6-1f4e4c4cd096 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:54.521829 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe8c6b-671b-45af-b3b6-1f4e4c4cd096 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:54.521829 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe8c6b-671b-45af-b3b6-1f4e4c4cd096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:54.529198 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-81fe8c6b-671b-45af-b3b6-1f4e4c4cd096 None None] MFA Rules not processed for user `05862744ad144ebcb851a9e98bac6c54`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:54.531242 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-81fe8c6b-671b-45af-b3b6-1f4e4c4cd096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:54.619627 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1140/2260] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:06:54 2022] POST /identity/v3/users => generated 304 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:06:54.630180 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01234c90-96ef-4525-a216-7a26f67b51ff admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:54.641190 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1121/2261] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 04:06:54.642366 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe8c6b-671b-45af-b3b6-1f4e4c4cd096 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:54.644495 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-81fe8c6b-671b-45af-b3b6-1f4e4c4cd096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:54.671817 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01234c90-96ef-4525-a216-7a26f67b51ff admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:54.686463 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ebf86-4d2c-45d5-9bbd-7ea9d9fe9918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:54.687372 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ebf86-4d2c-45d5-9bbd-7ea9d9fe9918 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:54.687864 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ebf86-4d2c-45d5-9bbd-7ea9d9fe9918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:54.688323 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ebf86-4d2c-45d5-9bbd-7ea9d9fe9918 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:54.689081 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ebf86-4d2c-45d5-9bbd-7ea9d9fe9918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:54.691038 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ebf86-4d2c-45d5-9bbd-7ea9d9fe9918 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:54.708737 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1141/2262] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:06:54.710142 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ebf86-4d2c-45d5-9bbd-7ea9d9fe9918 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:54.728612 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ebf86-4d2c-45d5-9bbd-7ea9d9fe9918 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:54.770459 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e59be-8462-4265-82ae-15f3b5e99648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:54.771173 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e59be-8462-4265-82ae-15f3b5e99648 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:54.771490 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e59be-8462-4265-82ae-15f3b5e99648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:54.771768 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e59be-8462-4265-82ae-15f3b5e99648 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:54.772532 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e59be-8462-4265-82ae-15f3b5e99648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:54.774278 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e59be-8462-4265-82ae-15f3b5e99648 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:54.803989 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1142/2263] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 04:06:54.809816 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e59be-8462-4265-82ae-15f3b5e99648 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:54.822675 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e59be-8462-4265-82ae-15f3b5e99648 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:54.828941 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c02b04a-8b8d-443e-ba37-5c5083b9bba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:54.835539 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe8c6b-671b-45af-b3b6-1f4e4c4cd096 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:54.835902 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c02b04a-8b8d-443e-ba37-5c5083b9bba6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:54.835902 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c02b04a-8b8d-443e-ba37-5c5083b9bba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:54.835902 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c02b04a-8b8d-443e-ba37-5c5083b9bba6 admin admin] PATH_INFO: `/v3/projects/9cb20bdad8ae4d548fa792ec07c4784c/users/40ab9f8da4314bad82ec595829459f37/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:54.841350 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8eac5-5c4e-4cfb-841e-8e2f9042147c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:54.842119 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8eac5-5c4e-4cfb-841e-8e2f9042147c service nova] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:54.842475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8eac5-5c4e-4cfb-841e-8e2f9042147c service nova] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:54.842840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8eac5-5c4e-4cfb-841e-8e2f9042147c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:54.846865 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-12c8eac5-5c4e-4cfb-841e-8e2f9042147c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:54.856161 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c02b04a-8b8d-443e-ba37-5c5083b9bba6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cb20bdad8ae4d548fa792ec07c4784c, user_id=40ab9f8da4314bad82ec595829459f37, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:54.859637 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c02b04a-8b8d-443e-ba37-5c5083b9bba6 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:54.862580 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c8eac5-5c4e-4cfb-841e-8e2f9042147c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:54.866284 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c8eac5-5c4e-4cfb-841e-8e2f9042147c service nova] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:54.881472 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1122/2264] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:06:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:06:55.039695 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1143/2265] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:06:54 2022] PUT /identity/v3/projects/9cb20bdad8ae4d548fa792ec07c4784c/users/40ab9f8da4314bad82ec595829459f37/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:55.057083 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb677d-63b6-4e28-88fc-2061cf8416c7 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:55.057359 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb677d-63b6-4e28-88fc-2061cf8416c7 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:55.057673 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb677d-63b6-4e28-88fc-2061cf8416c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:55.131025 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-82bb677d-63b6-4e28-88fc-2061cf8416c7 None None] MFA Rules not processed for user `40ab9f8da4314bad82ec595829459f37`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:55.133482 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-82bb677d-63b6-4e28-88fc-2061cf8416c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:55.266048 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1123/2266] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:55 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:55.271699 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c02b04a-8b8d-443e-ba37-5c5083b9bba6 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:55.374744 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c02b04a-8b8d-443e-ba37-5c5083b9bba6 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:55.380085 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b2b39-2e16-4072-85c5-a1aab9431815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:55.380871 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b2b39-2e16-4072-85c5-a1aab9431815 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:55.381159 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b2b39-2e16-4072-85c5-a1aab9431815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:55.381460 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b2b39-2e16-4072-85c5-a1aab9431815 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:55.382146 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6b2b39-2e16-4072-85c5-a1aab9431815 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:55.384258 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6b2b39-2e16-4072-85c5-a1aab9431815 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:55.558306 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1144/2267] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:06:55 2022] POST /identity/v3/projects => generated 407 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:06:55.564432 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb677d-63b6-4e28-88fc-2061cf8416c7 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:55.598489 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb677d-63b6-4e28-88fc-2061cf8416c7 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:55.704390 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8b050-9a67-4474-894c-809f717a2f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:55.705083 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8b050-9a67-4474-894c-809f717a2f9f admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:55.705396 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8b050-9a67-4474-894c-809f717a2f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:55.705662 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8b050-9a67-4474-894c-809f717a2f9f admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:55.706392 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8b050-9a67-4474-894c-809f717a2f9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:55.708501 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8b050-9a67-4474-894c-809f717a2f9f admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:56.085826 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1124/2268] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:06:55 2022] POST /identity/v3/users => generated 310 bytes in 522 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 04:06:56.086859 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b2b39-2e16-4072-85c5-a1aab9431815 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:56.103049 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b2b39-2e16-4072-85c5-a1aab9431815 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:56.113957 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:56.128026 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f956650-7a88-45a4-9c8a-c0dbe286ed7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:56.128897 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f956650-7a88-45a4-9c8a-c0dbe286ed7a admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:56.129182 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f956650-7a88-45a4-9c8a-c0dbe286ed7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:56.129565 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f956650-7a88-45a4-9c8a-c0dbe286ed7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:56.152526 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f956650-7a88-45a4-9c8a-c0dbe286ed7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:56.154400 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f956650-7a88-45a4-9c8a-c0dbe286ed7a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:56.199398 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8b050-9a67-4474-894c-809f717a2f9f admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:56.200873 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1145/2269] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:06:56.230643 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8b050-9a67-4474-894c-809f717a2f9f admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:56.250546 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124b500-f5c6-416a-8a25-ef8047fdaed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:56.252499 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124b500-f5c6-416a-8a25-ef8047fdaed2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:56.254268 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124b500-f5c6-416a-8a25-ef8047fdaed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:56.255061 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124b500-f5c6-416a-8a25-ef8047fdaed2 admin admin] PATH_INFO: `/v3/projects/b679c060dfdc44f68da53256575277f1/users/a865156b736a449490afc5afec40cc53/roles/681755518698445fabd9a8accec13c0f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:56.305287 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f124b500-f5c6-416a-8a25-ef8047fdaed2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b679c060dfdc44f68da53256575277f1, user_id=a865156b736a449490afc5afec40cc53, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:56.311240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f124b500-f5c6-416a-8a25-ef8047fdaed2 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:56.476286 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1125/2270] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:06:56 2022] PUT /identity/v3/projects/b679c060dfdc44f68da53256575277f1/users/a865156b736a449490afc5afec40cc53/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:06:56.481878 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f956650-7a88-45a4-9c8a-c0dbe286ed7a admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:56.525764 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f956650-7a88-45a4-9c8a-c0dbe286ed7a admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:56.562023 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:06:56.645738 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cfecef-e66f-47b4-b343-b0faf84b4bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:56.648261 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cfecef-e66f-47b4-b343-b0faf84b4bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:56.649093 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cfecef-e66f-47b4-b343-b0faf84b4bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:56.650037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cfecef-e66f-47b4-b343-b0faf84b4bb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:56.652253 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cfecef-e66f-47b4-b343-b0faf84b4bb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:56.656621 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cfecef-e66f-47b4-b343-b0faf84b4bb5 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:56.683132 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1146/2271] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:06:56.687389 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124b500-f5c6-416a-8a25-ef8047fdaed2 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:56.713343 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124b500-f5c6-416a-8a25-ef8047fdaed2 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:56.728510 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232dc085-2fec-4cf9-a342-3d96f170026d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:56.730011 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232dc085-2fec-4cf9-a342-3d96f170026d admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:56.730333 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232dc085-2fec-4cf9-a342-3d96f170026d admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:56.731434 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232dc085-2fec-4cf9-a342-3d96f170026d admin admin] PATH_INFO: `/v3/projects/b679c060dfdc44f68da53256575277f1/users/a865156b736a449490afc5afec40cc53/roles/681755518698445fabd9a8accec13c0f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:56.733391 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232dc085-2fec-4cf9-a342-3d96f170026d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b679c060dfdc44f68da53256575277f1, user_id=a865156b736a449490afc5afec40cc53, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:56.737424 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232dc085-2fec-4cf9-a342-3d96f170026d admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:56.760043 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1126/2272] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:06:56 2022] PUT /identity/v3/projects/b679c060dfdc44f68da53256575277f1/users/a865156b736a449490afc5afec40cc53/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:06:56.768051 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbb15c-45a8-40e6-88e3-d936ec99f752 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:56.768567 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbb15c-45a8-40e6-88e3-d936ec99f752 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:56.769051 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbb15c-45a8-40e6-88e3-d936ec99f752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:56.880469 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-73bbb15c-45a8-40e6-88e3-d936ec99f752 None None] MFA Rules not processed for user `a865156b736a449490afc5afec40cc53`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:56.881888 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-73bbb15c-45a8-40e6-88e3-d936ec99f752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:57.098191 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1147/2273] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:56 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:06:57.122777 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232dc085-2fec-4cf9-a342-3d96f170026d admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:57.132065 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-232dc085-2fec-4cf9-a342-3d96f170026d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:06:57.368784 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232dc085-2fec-4cf9-a342-3d96f170026d admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:57.396216 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f2684b-49da-4e77-9938-d28992fd4686 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:57.396990 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2684b-49da-4e77-9938-d28992fd4686 service cinder] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:57.397268 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2684b-49da-4e77-9938-d28992fd4686 service cinder] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:57.397532 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2684b-49da-4e77-9938-d28992fd4686 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:57.432427 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f2684b-49da-4e77-9938-d28992fd4686 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:57.437901 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f2684b-49da-4e77-9938-d28992fd4686 service cinder] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:57.479730 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1127/2274] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:06:57 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:06:58.283145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbb15c-45a8-40e6-88e3-d936ec99f752 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:06:58.321964 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbb15c-45a8-40e6-88e3-d936ec99f752 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:06:58.321964 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aed76a-3a86-4120-be54-f29225694fcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:06:58.321964 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aed76a-3a86-4120-be54-f29225694fcc service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:58.321964 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aed76a-3a86-4120-be54-f29225694fcc service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:58.322491 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aed76a-3a86-4120-be54-f29225694fcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:58.403291 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aed76a-3a86-4120-be54-f29225694fcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:06:58.406425 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aed76a-3a86-4120-be54-f29225694fcc service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:06:58.422202 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1148/2275] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:06:58 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:06:59.891999 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd0b51-b2e6-4f40-8b88-c4fcf46c0b69 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:06:59.892899 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd0b51-b2e6-4f40-8b88-c4fcf46c0b69 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:06:59.893337 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd0b51-b2e6-4f40-8b88-c4fcf46c0b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:06:59.939059 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-f7bd0b51-b2e6-4f40-8b88-c4fcf46c0b69 None None] MFA Rules not processed for user `ea3be916625844d1b54f8550aef3317d`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:06:59.940639 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-f7bd0b51-b2e6-4f40-8b88-c4fcf46c0b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:07:00.170812 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aed76a-3a86-4120-be54-f29225694fcc service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:07:00.177567 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-08aed76a-3a86-4120-be54-f29225694fcc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:07:00.177947 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1128/2276] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:06:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:07:00.305649 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aed76a-3a86-4120-be54-f29225694fcc service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:07:00.314200 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677d38e-cbad-4a67-9bac-ef1f1dd34058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:07:00.315487 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677d38e-cbad-4a67-9bac-ef1f1dd34058 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:00.321836 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677d38e-cbad-4a67-9bac-ef1f1dd34058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:00.321836 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677d38e-cbad-4a67-9bac-ef1f1dd34058 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:00.321836 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2677d38e-cbad-4a67-9bac-ef1f1dd34058 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:07:00.321836 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2677d38e-cbad-4a67-9bac-ef1f1dd34058 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:07:00.376213 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:00.518671 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1149/2277] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:07:00 2022] POST /identity/v3/projects => generated 373 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 04:07:00.521086 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd0b51-b2e6-4f40-8b88-c4fcf46c0b69 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:07:00.558807 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd0b51-b2e6-4f40-8b88-c4fcf46c0b69 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:07:00.744232 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbc435-a421-41b7-ab7a-0245137dc074 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:00.744522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbc435-a421-41b7-ab7a-0245137dc074 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:00.750386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbc435-a421-41b7-ab7a-0245137dc074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:00.826078 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c3def-f257-477a-9cb3-46fe336ed934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:07:00.827394 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c3def-f257-477a-9cb3-46fe336ed934 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:00.827814 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-e7dbc435-a421-41b7-ab7a-0245137dc074 None None] MFA Rules not processed for user `a61e50919a13413c9f641f23f6b30217`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:07:00.827995 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c3def-f257-477a-9cb3-46fe336ed934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:00.828373 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c3def-f257-477a-9cb3-46fe336ed934 admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:00.829095 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e7dbc435-a421-41b7-ab7a-0245137dc074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:07:00.840068 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c3def-f257-477a-9cb3-46fe336ed934 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:07:00.844608 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c3def-f257-477a-9cb3-46fe336ed934 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:07:01.014445 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1129/2278] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:07:00 2022] POST /identity/v3/users => generated 293 bytes in 496 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:07:01.019534 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c3def-f257-477a-9cb3-46fe336ed934 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:07:01.029206 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1150/2279] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:07:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:07:01.060829 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c3def-f257-477a-9cb3-46fe336ed934 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:07:01.082666 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4612e07c-9d50-497b-8a70-f7981dd03f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:07:01.083707 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612e07c-9d50-497b-8a70-f7981dd03f37 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:01.084174 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612e07c-9d50-497b-8a70-f7981dd03f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:01.087223 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612e07c-9d50-497b-8a70-f7981dd03f37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:01.092316 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4612e07c-9d50-497b-8a70-f7981dd03f37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:07:01.094399 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4612e07c-9d50-497b-8a70-f7981dd03f37 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:07:01.110674 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:01.134221 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1130/2280] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:07:01 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:07:01.137668 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dbc435-a421-41b7-ab7a-0245137dc074 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:07:01.176800 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dbc435-a421-41b7-ab7a-0245137dc074 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:07:01.185777 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d0dc0-9299-4cf4-9d64-ffc419dbde0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:07:01.195697 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d0dc0-9299-4cf4-9d64-ffc419dbde0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:01.202143 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d0dc0-9299-4cf4-9d64-ffc419dbde0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:01.202143 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d0dc0-9299-4cf4-9d64-ffc419dbde0d admin admin] PATH_INFO: `/v3/projects/21fd5470a29f4a8a86b1928510b621e0/users/4478d02971764fd8b9d9d98bec144245/roles/681755518698445fabd9a8accec13c0f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:01.268851 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8d0dc0-9299-4cf4-9d64-ffc419dbde0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=21fd5470a29f4a8a86b1928510b621e0, user_id=4478d02971764fd8b9d9d98bec144245, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:07:01.280778 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8d0dc0-9299-4cf4-9d64-ffc419dbde0d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:07:01.429019 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1151/2281] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:07:01 2022] PUT /identity/v3/projects/21fd5470a29f4a8a86b1928510b621e0/users/4478d02971764fd8b9d9d98bec144245/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:07:01.451697 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4612e07c-9d50-497b-8a70-f7981dd03f37 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:07:01.451697 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4612e07c-9d50-497b-8a70-f7981dd03f37 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:07:01.711550 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1f2bf-32d9-4528-bf82-8b54d034ae1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:07:01.712933 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1f2bf-32d9-4528-bf82-8b54d034ae1b admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:01.714977 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1f2bf-32d9-4528-bf82-8b54d034ae1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:01.716198 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1f2bf-32d9-4528-bf82-8b54d034ae1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:01.720347 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb1f2bf-32d9-4528-bf82-8b54d034ae1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:07:01.728615 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb1f2bf-32d9-4528-bf82-8b54d034ae1b admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:07:01.773074 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1131/2282] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:07:01 2022] GET /identity/v3/roles => generated 1420 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:07:01.786338 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d0dc0-9299-4cf4-9d64-ffc419dbde0d admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:07:01.814611 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d0dc0-9299-4cf4-9d64-ffc419dbde0d admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:07:01.821577 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b23b5-89b3-43b1-bc6b-85b6b5b2b3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:07:01.822627 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b23b5-89b3-43b1-bc6b-85b6b5b2b3f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:01.822911 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b23b5-89b3-43b1-bc6b-85b6b5b2b3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:01.823291 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b23b5-89b3-43b1-bc6b-85b6b5b2b3f4 admin admin] PATH_INFO: `/v3/projects/21fd5470a29f4a8a86b1928510b621e0/users/4478d02971764fd8b9d9d98bec144245/roles/681755518698445fabd9a8accec13c0f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:01.825919 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b23b5-89b3-43b1-bc6b-85b6b5b2b3f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21fd5470a29f4a8a86b1928510b621e0, user_id=4478d02971764fd8b9d9d98bec144245, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:07:01.829166 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b23b5-89b3-43b1-bc6b-85b6b5b2b3f4 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:07:01.860038 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1152/2283] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:07:01 2022] PUT /identity/v3/projects/21fd5470a29f4a8a86b1928510b621e0/users/4478d02971764fd8b9d9d98bec144245/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:07:05.549779 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:06.368916 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:08.868712 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1f2bf-32d9-4528-bf82-8b54d034ae1b admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:07:08.888118 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1f2bf-32d9-4528-bf82-8b54d034ae1b admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:07:09.061230 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4ddf8-6df5-4e16-b6d2-acd761fa1072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:07:09.062905 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4ddf8-6df5-4e16-b6d2-acd761fa1072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:09.064343 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4ddf8-6df5-4e16-b6d2-acd761fa1072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:09.064912 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4ddf8-6df5-4e16-b6d2-acd761fa1072 admin admin] PATH_INFO: `/v3/users/40ab9f8da4314bad82ec595829459f37` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:09.066656 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4ddf8-6df5-4e16-b6d2-acd761fa1072 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40ab9f8da4314bad82ec595829459f37)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:07:09.077526 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4ddf8-6df5-4e16-b6d2-acd761fa1072 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:07:09.400154 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-33a4ddf8-6df5-4e16-b6d2-acd761fa1072 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40ab9f8da4314bad82ec595829459f37'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:09.402883 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-33a4ddf8-6df5-4e16-b6d2-acd761fa1072 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40ab9f8da4314bad82ec595829459f37'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:09.505377 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-33a4ddf8-6df5-4e16-b6d2-acd761fa1072 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40ab9f8da4314bad82ec595829459f37'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:09.506059 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-33a4ddf8-6df5-4e16-b6d2-acd761fa1072 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40ab9f8da4314bad82ec595829459f37'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:09.517142 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-33a4ddf8-6df5-4e16-b6d2-acd761fa1072 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40ab9f8da4314bad82ec595829459f37'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:09.559777 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1132/2284] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:07:08 2022] DELETE /identity/v3/users/40ab9f8da4314bad82ec595829459f37 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:07:09.565543 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b126b-c63f-43b4-afc6-893f92f4c50d None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:09.566514 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b126b-c63f-43b4-afc6-893f92f4c50d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:09.566797 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b126b-c63f-43b4-afc6-893f92f4c50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:09.590376 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-7a0b126b-c63f-43b4-afc6-893f92f4c50d None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:07:09.591991 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-7a0b126b-c63f-43b4-afc6-893f92f4c50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:07:09.699987 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1153/2285] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:07:09.757818 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4ddf8-6df5-4e16-b6d2-acd761fa1072 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:07:09.759586 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-33a4ddf8-6df5-4e16-b6d2-acd761fa1072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:07:09.881686 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:09.897112 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4ddf8-6df5-4e16-b6d2-acd761fa1072 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:07:09.902505 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb487cf6-b1c3-41c0-b716-3ccf81b30463 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:07:09.904061 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb487cf6-b1c3-41c0-b716-3ccf81b30463 service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:09.904538 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb487cf6-b1c3-41c0-b716-3ccf81b30463 service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:09.905064 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb487cf6-b1c3-41c0-b716-3ccf81b30463 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:09.918718 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb487cf6-b1c3-41c0-b716-3ccf81b30463 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:07:09.921766 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb487cf6-b1c3-41c0-b716-3ccf81b30463 service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:07:09.938712 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1133/2286] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:07:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:07:10.729556 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:11.042157 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b126b-c63f-43b4-afc6-893f92f4c50d None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:07:11.043369 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-7a0b126b-c63f-43b4-afc6-893f92f4c50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:07:11.083104 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b126b-c63f-43b4-afc6-893f92f4c50d None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:07:11.107649 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62c536-fcac-46c1-b400-1277529f7bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:07:11.109218 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62c536-fcac-46c1-b400-1277529f7bc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:11.109800 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62c536-fcac-46c1-b400-1277529f7bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:11.110279 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62c536-fcac-46c1-b400-1277529f7bc7 admin admin] PATH_INFO: `/v3/projects/9cb20bdad8ae4d548fa792ec07c4784c` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:11.113111 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e62c536-fcac-46c1-b400-1277529f7bc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cb20bdad8ae4d548fa792ec07c4784c)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:07:11.116094 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e62c536-fcac-46c1-b400-1277529f7bc7 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:07:11.478413 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-7e62c536-fcac-46c1-b400-1277529f7bc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cb20bdad8ae4d548fa792ec07c4784c', 'request_id': 'req-7e62c536-fcac-46c1-b400-1277529f7bc7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:11.582622 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-7e62c536-fcac-46c1-b400-1277529f7bc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cb20bdad8ae4d548fa792ec07c4784c', 'request_id': 'req-7e62c536-fcac-46c1-b400-1277529f7bc7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:11.598369 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-7e62c536-fcac-46c1-b400-1277529f7bc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cb20bdad8ae4d548fa792ec07c4784c', 'request_id': 'req-7e62c536-fcac-46c1-b400-1277529f7bc7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:11.629115 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-7e62c536-fcac-46c1-b400-1277529f7bc7 admin admin] The token cache is being invalidate because project 9cb20bdad8ae4d548fa792ec07c4784c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:07:11.629705 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-7e62c536-fcac-46c1-b400-1277529f7bc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:11.631367 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-7e62c536-fcac-46c1-b400-1277529f7bc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:11.639760 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1154/2287] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:07:11 2022] DELETE /identity/v3/projects/9cb20bdad8ae4d548fa792ec07c4784c => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:07:11.643101 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb487cf6-b1c3-41c0-b716-3ccf81b30463 service neutron] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:07:11.656650 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb487cf6-b1c3-41c0-b716-3ccf81b30463 service neutron] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:07:11.849515 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85d377-8074-4ae5-b79e-b67bed3e2f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:07:11.851604 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85d377-8074-4ae5-b79e-b67bed3e2f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:11.852346 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85d377-8074-4ae5-b79e-b67bed3e2f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:11.853034 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85d377-8074-4ae5-b79e-b67bed3e2f0e admin admin] PATH_INFO: `/v3/users/a865156b736a449490afc5afec40cc53` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:11.856325 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f85d377-8074-4ae5-b79e-b67bed3e2f0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a865156b736a449490afc5afec40cc53)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:07:11.859328 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f85d377-8074-4ae5-b79e-b67bed3e2f0e admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:07:12.150562 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-7f85d377-8074-4ae5-b79e-b67bed3e2f0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a865156b736a449490afc5afec40cc53'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:12.152890 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-7f85d377-8074-4ae5-b79e-b67bed3e2f0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a865156b736a449490afc5afec40cc53'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:12.271835 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-7f85d377-8074-4ae5-b79e-b67bed3e2f0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a865156b736a449490afc5afec40cc53'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:12.272607 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-7f85d377-8074-4ae5-b79e-b67bed3e2f0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a865156b736a449490afc5afec40cc53'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:12.297115 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-7f85d377-8074-4ae5-b79e-b67bed3e2f0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a865156b736a449490afc5afec40cc53'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:12.333498 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1134/2288] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:07:11 2022] DELETE /identity/v3/users/a865156b736a449490afc5afec40cc53 => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:07:13.396831 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62c536-fcac-46c1-b400-1277529f7bc7 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:07:13.399122 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-7e62c536-fcac-46c1-b400-1277529f7bc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:07:13.425492 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62c536-fcac-46c1-b400-1277529f7bc7 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:07:13.559318 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:13.622248 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d4e1c-5589-4ece-9d51-8aee484388ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:07:13.627775 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d4e1c-5589-4ece-9d51-8aee484388ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:13.627775 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d4e1c-5589-4ece-9d51-8aee484388ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:13.627775 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d4e1c-5589-4ece-9d51-8aee484388ff admin admin] PATH_INFO: `/v3/projects/b679c060dfdc44f68da53256575277f1` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:13.627775 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d4e1c-5589-4ece-9d51-8aee484388ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=b679c060dfdc44f68da53256575277f1)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:07:13.627775 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d4e1c-5589-4ece-9d51-8aee484388ff admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:07:13.840478 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-667d4e1c-5589-4ece-9d51-8aee484388ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b679c060dfdc44f68da53256575277f1', 'request_id': 'req-667d4e1c-5589-4ece-9d51-8aee484388ff'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:13.979845 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-667d4e1c-5589-4ece-9d51-8aee484388ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b679c060dfdc44f68da53256575277f1', 'request_id': 'req-667d4e1c-5589-4ece-9d51-8aee484388ff'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:13.986881 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-667d4e1c-5589-4ece-9d51-8aee484388ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b679c060dfdc44f68da53256575277f1', 'request_id': 'req-667d4e1c-5589-4ece-9d51-8aee484388ff'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:14.046216 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-667d4e1c-5589-4ece-9d51-8aee484388ff admin admin] The token cache is being invalidate because project b679c060dfdc44f68da53256575277f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:07:14.046522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-667d4e1c-5589-4ece-9d51-8aee484388ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:14.047262 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-667d4e1c-5589-4ece-9d51-8aee484388ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:14.051145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1155/2289] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:07:13 2022] DELETE /identity/v3/projects/b679c060dfdc44f68da53256575277f1 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:07:14.062915 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f518c0-40ab-4a5c-88c6-9d42b61e0b3e None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:14.068162 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f518c0-40ab-4a5c-88c6-9d42b61e0b3e None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:14.068162 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f518c0-40ab-4a5c-88c6-9d42b61e0b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:14.100629 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-a6f518c0-40ab-4a5c-88c6-9d42b61e0b3e None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:07:14.106157 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-a6f518c0-40ab-4a5c-88c6-9d42b61e0b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:07:14.304653 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1135/2290] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:07:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 04:07:14.317071 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbeebd-6226-45e5-9275-1d79c3587693 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:14.317358 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbeebd-6226-45e5-9275-1d79c3587693 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:14.317628 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbeebd-6226-45e5-9275-1d79c3587693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:14.348759 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-f7bbeebd-6226-45e5-9275-1d79c3587693 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:07:14.350064 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f7bbeebd-6226-45e5-9275-1d79c3587693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:07:14.372135 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1156/2291] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:07:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 04:07:14.379032 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f518c0-40ab-4a5c-88c6-9d42b61e0b3e None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:07:14.395150 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f518c0-40ab-4a5c-88c6-9d42b61e0b3e None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:07:14.400422 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83930d8-dc36-4607-9409-c2c209fb30e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:07:14.401329 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83930d8-dc36-4607-9409-c2c209fb30e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:14.401929 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83930d8-dc36-4607-9409-c2c209fb30e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:14.401929 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83930d8-dc36-4607-9409-c2c209fb30e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:14.402607 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83930d8-dc36-4607-9409-c2c209fb30e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:07:14.403089 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83930d8-dc36-4607-9409-c2c209fb30e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:07:14.405200 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83930d8-dc36-4607-9409-c2c209fb30e7 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:07:14.421975 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1136/2292] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:07:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:07:14.426498 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bbeebd-6226-45e5-9275-1d79c3587693 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:07:14.437626 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:14.440469 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bbeebd-6226-45e5-9275-1d79c3587693 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:07:14.452201 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590a8af-c57f-4782-a0f8-5b153c2d0b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:07:14.452885 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590a8af-c57f-4782-a0f8-5b153c2d0b8c admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:14.453165 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590a8af-c57f-4782-a0f8-5b153c2d0b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:14.453437 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590a8af-c57f-4782-a0f8-5b153c2d0b8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:14.456932 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5590a8af-c57f-4782-a0f8-5b153c2d0b8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:07:14.461666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5590a8af-c57f-4782-a0f8-5b153c2d0b8c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:07:14.630854 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1157/2293] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:07:14 2022] POST /identity/v3/projects => generated 377 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 04:07:14.635304 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83930d8-dc36-4607-9409-c2c209fb30e7 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:07:14.655531 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83930d8-dc36-4607-9409-c2c209fb30e7 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:07:14.832206 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a10b91-5f55-4ba8-863b-6c27ca207b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:07:14.832206 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a10b91-5f55-4ba8-863b-6c27ca207b44 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:14.832206 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a10b91-5f55-4ba8-863b-6c27ca207b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:14.832206 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a10b91-5f55-4ba8-863b-6c27ca207b44 admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:14.833081 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a10b91-5f55-4ba8-863b-6c27ca207b44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:07:14.839364 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a10b91-5f55-4ba8-863b-6c27ca207b44 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:07:14.989606 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1137/2294] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:07:14 2022] POST /identity/v3/users => generated 289 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 04:07:14.996086 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590a8af-c57f-4782-a0f8-5b153c2d0b8c admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:07:15.043559 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590a8af-c57f-4782-a0f8-5b153c2d0b8c admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:07:15.064458 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03a9f6-206a-4054-9a2e-0a7586be6025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:07:15.065065 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03a9f6-206a-4054-9a2e-0a7586be6025 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:15.065501 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03a9f6-206a-4054-9a2e-0a7586be6025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:15.065783 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03a9f6-206a-4054-9a2e-0a7586be6025 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:15.069311 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc03a9f6-206a-4054-9a2e-0a7586be6025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:07:15.075011 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b80a8-de70-42bc-8345-b3a012ca0a0b None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:15.075819 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b80a8-de70-42bc-8345-b3a012ca0a0b None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:15.075819 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b80a8-de70-42bc-8345-b3a012ca0a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:15.077828 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc03a9f6-206a-4054-9a2e-0a7586be6025 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:07:15.105706 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1158/2295] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:07:15.111876 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03a9f6-206a-4054-9a2e-0a7586be6025 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:07:15.125109 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03a9f6-206a-4054-9a2e-0a7586be6025 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:07:15.147870 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0632d2-db78-445d-b9b1-ecb85bde2594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:07:15.148579 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0632d2-db78-445d-b9b1-ecb85bde2594 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:15.148862 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0632d2-db78-445d-b9b1-ecb85bde2594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:15.149139 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0632d2-db78-445d-b9b1-ecb85bde2594 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:15.150142 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0632d2-db78-445d-b9b1-ecb85bde2594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:07:15.153251 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0632d2-db78-445d-b9b1-ecb85bde2594 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:07:15.158275 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-d12b80a8-de70-42bc-8345-b3a012ca0a0b None None] MFA Rules not processed for user `4478d02971764fd8b9d9d98bec144245`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:07:15.161190 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-d12b80a8-de70-42bc-8345-b3a012ca0a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:07:15.169452 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1159/2296] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:07:15.174044 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0632d2-db78-445d-b9b1-ecb85bde2594 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:07:15.188640 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0632d2-db78-445d-b9b1-ecb85bde2594 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:07:15.196265 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce62d6b-b6cd-4778-aa82-16931cf13bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:07:15.198542 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce62d6b-b6cd-4778-aa82-16931cf13bd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:15.199071 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce62d6b-b6cd-4778-aa82-16931cf13bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:15.199546 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce62d6b-b6cd-4778-aa82-16931cf13bd6 admin admin] PATH_INFO: `/v3/projects/26843cfc4a364f0883b317dd10bec41f/users/27c608d080e44857bdef6dc08830561b/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:15.232923 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce62d6b-b6cd-4778-aa82-16931cf13bd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26843cfc4a364f0883b317dd10bec41f, user_id=27c608d080e44857bdef6dc08830561b, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:07:15.236307 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce62d6b-b6cd-4778-aa82-16931cf13bd6 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:07:15.318588 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1138/2297] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:07:15 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 04:07:15.383762 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1160/2298] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:07:15 2022] PUT /identity/v3/projects/26843cfc4a364f0883b317dd10bec41f/users/27c608d080e44857bdef6dc08830561b/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:07:15.390380 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff39b6d-b7bf-42a9-ab10-972bbae3e9c2 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:15.390380 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff39b6d-b7bf-42a9-ab10-972bbae3e9c2 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:15.390380 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff39b6d-b7bf-42a9-ab10-972bbae3e9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:15.452597 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-3ff39b6d-b7bf-42a9-ab10-972bbae3e9c2 None None] MFA Rules not processed for user `27c608d080e44857bdef6dc08830561b`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:07:15.455071 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-3ff39b6d-b7bf-42a9-ab10-972bbae3e9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:07:15.573671 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce62d6b-b6cd-4778-aa82-16931cf13bd6 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:07:15.576649 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-6ce62d6b-b6cd-4778-aa82-16931cf13bd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:07:15.609400 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1139/2299] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:07:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 04:07:15.636986 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff39b6d-b7bf-42a9-ab10-972bbae3e9c2 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:07:15.636986 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-3ff39b6d-b7bf-42a9-ab10-972bbae3e9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:07:15.739653 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce62d6b-b6cd-4778-aa82-16931cf13bd6 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:07:15.750593 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd5a9a-26f2-4fd7-82ae-0e30b7cab3a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:07:15.752098 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd5a9a-26f2-4fd7-82ae-0e30b7cab3a2 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:15.753225 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd5a9a-26f2-4fd7-82ae-0e30b7cab3a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:15.754043 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd5a9a-26f2-4fd7-82ae-0e30b7cab3a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:15.757666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c0bd5a9a-26f2-4fd7-82ae-0e30b7cab3a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:07:15.762674 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff39b6d-b7bf-42a9-ab10-972bbae3e9c2 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:07:15.767229 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cae0fd-f8e6-43fb-9da1-a3a22a2e41a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:07:15.768089 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cae0fd-f8e6-43fb-9da1-a3a22a2e41a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:15.768583 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cae0fd-f8e6-43fb-9da1-a3a22a2e41a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:15.768751 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cae0fd-f8e6-43fb-9da1-a3a22a2e41a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:15.788363 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cae0fd-f8e6-43fb-9da1-a3a22a2e41a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:07:15.790697 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cae0fd-f8e6-43fb-9da1-a3a22a2e41a8 service cinder] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:07:15.826932 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1140/2300] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:07:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 04:07:15.979334 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd5a9a-26f2-4fd7-82ae-0e30b7cab3a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:07:15.986843 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd5a9a-26f2-4fd7-82ae-0e30b7cab3a2 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:07:16.005178 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:16.015519 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1161/2301] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:07:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 04:07:17.411715 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:19.902672 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:21.160612 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f7d37-3970-4909-a6e4-e1ee9089203c None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:21.161188 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f7d37-3970-4909-a6e4-e1ee9089203c None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:21.161315 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f7d37-3970-4909-a6e4-e1ee9089203c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:21.180454 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-658f7d37-3970-4909-a6e4-e1ee9089203c None None] MFA Rules not processed for user `ea3be916625844d1b54f8550aef3317d`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:07:21.183313 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-658f7d37-3970-4909-a6e4-e1ee9089203c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:07:21.205948 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1141/2302] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:07:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:07:21.205948 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:22.972868 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd5a9a-26f2-4fd7-82ae-0e30b7cab3a2 service nova] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:07:22.974817 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c0bd5a9a-26f2-4fd7-82ae-0e30b7cab3a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:07:22.995835 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd5a9a-26f2-4fd7-82ae-0e30b7cab3a2 service nova] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:07:23.002041 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d68ecd-ea86-4950-9325-128ac5db79f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:07:23.004668 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d68ecd-ea86-4950-9325-128ac5db79f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:23.004949 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d68ecd-ea86-4950-9325-128ac5db79f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:23.005412 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d68ecd-ea86-4950-9325-128ac5db79f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:23.010354 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c6d68ecd-ea86-4950-9325-128ac5db79f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:07:23.071720 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:23.100844 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d68ecd-ea86-4950-9325-128ac5db79f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:07:23.102361 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d68ecd-ea86-4950-9325-128ac5db79f6 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:07:23.113910 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1162/2303] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:07:22 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 04:07:23.864628 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:25.536467 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:26.559691 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9a54d-994d-43aa-a9b9-b2793edc69d9 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:26.560377 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9a54d-994d-43aa-a9b9-b2793edc69d9 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:26.560597 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9a54d-994d-43aa-a9b9-b2793edc69d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:26.658608 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-09d9a54d-994d-43aa-a9b9-b2793edc69d9 None None] MFA Rules not processed for user `dd41221abea04808bed5ef4ac4528c62`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:07:26.660414 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-09d9a54d-994d-43aa-a9b9-b2793edc69d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:07:26.712890 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:26.755205 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1142/2304] 10.222.0.46 () {58 vars in 1009 bytes} [Fri Jul 1 04:07:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:07:26.827564 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d68ecd-ea86-4950-9325-128ac5db79f6 service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:07:26.831029 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c6d68ecd-ea86-4950-9325-128ac5db79f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:07:27.052833 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d68ecd-ea86-4950-9325-128ac5db79f6 service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:07:27.060327 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18715236-2c54-4e47-90ba-a88425215952 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83787880173b459c8975b834bd47a51a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:07:27.061287 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18715236-2c54-4e47-90ba-a88425215952 service swift] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:27.061743 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18715236-2c54-4e47-90ba-a88425215952 service swift] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:27.062279 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18715236-2c54-4e47-90ba-a88425215952 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:27.081645 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18715236-2c54-4e47-90ba-a88425215952 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:07:27.084746 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18715236-2c54-4e47-90ba-a88425215952 service swift] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:07:27.099049 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1163/2305] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Jul 1 04:07:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 04:07:29.647846 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:30.104928 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:30.335202 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9a54d-994d-43aa-a9b9-b2793edc69d9 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:07:30.338653 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-09d9a54d-994d-43aa-a9b9-b2793edc69d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:07:30.480149 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9a54d-994d-43aa-a9b9-b2793edc69d9 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:07:30.501443 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ac0f8-2609-414a-8416-9ad08fecc050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:07:30.502540 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ac0f8-2609-414a-8416-9ad08fecc050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:30.503825 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ac0f8-2609-414a-8416-9ad08fecc050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:30.504213 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ac0f8-2609-414a-8416-9ad08fecc050 admin admin] PATH_INFO: `/v3/users/6febaf51c577417bb5b584ab23207f13` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:30.506106 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ac0f8-2609-414a-8416-9ad08fecc050 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6febaf51c577417bb5b584ab23207f13)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:07:30.508591 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ac0f8-2609-414a-8416-9ad08fecc050 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:07:30.890703 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-b56ac0f8-2609-414a-8416-9ad08fecc050 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6febaf51c577417bb5b584ab23207f13'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:30.891771 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-b56ac0f8-2609-414a-8416-9ad08fecc050 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6febaf51c577417bb5b584ab23207f13'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:30.999332 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-b56ac0f8-2609-414a-8416-9ad08fecc050 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6febaf51c577417bb5b584ab23207f13'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:31.001051 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-b56ac0f8-2609-414a-8416-9ad08fecc050 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6febaf51c577417bb5b584ab23207f13'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:31.022538 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-b56ac0f8-2609-414a-8416-9ad08fecc050 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6febaf51c577417bb5b584ab23207f13'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:31.047498 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1143/2306] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:07:30 2022] DELETE /identity/v3/users/6febaf51c577417bb5b584ab23207f13 => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:07:31.061512 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e3d80-4167-46b0-8801-536fc52efdef None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:31.062735 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e3d80-4167-46b0-8801-536fc52efdef None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:31.063077 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e3d80-4167-46b0-8801-536fc52efdef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:31.093243 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-151e3d80-4167-46b0-8801-536fc52efdef None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:07:31.097783 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-151e3d80-4167-46b0-8801-536fc52efdef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:07:31.278366 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1164/2307] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:07:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:07:31.288461 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ac0f8-2609-414a-8416-9ad08fecc050 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:07:31.290642 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-b56ac0f8-2609-414a-8416-9ad08fecc050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:07:31.468329 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ac0f8-2609-414a-8416-9ad08fecc050 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:07:31.486177 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b45c88-0909-42aa-ae50-8b9fd75d3e61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:07:31.487092 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b45c88-0909-42aa-ae50-8b9fd75d3e61 service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:31.487694 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b45c88-0909-42aa-ae50-8b9fd75d3e61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:31.488048 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b45c88-0909-42aa-ae50-8b9fd75d3e61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:31.522994 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:31.532532 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b45c88-0909-42aa-ae50-8b9fd75d3e61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:07:31.534506 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b45c88-0909-42aa-ae50-8b9fd75d3e61 service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:07:31.613413 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1144/2308] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:07:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:07:32.452461 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e3d80-4167-46b0-8801-536fc52efdef None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:07:32.454958 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-151e3d80-4167-46b0-8801-536fc52efdef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:07:32.482914 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e3d80-4167-46b0-8801-536fc52efdef None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:07:32.498623 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e2131-dafe-40f9-993c-a73f8a2a78af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:07:32.500177 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e2131-dafe-40f9-993c-a73f8a2a78af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:32.501281 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e2131-dafe-40f9-993c-a73f8a2a78af admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:32.501768 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e2131-dafe-40f9-993c-a73f8a2a78af admin admin] PATH_INFO: `/v3/projects/45b2500a5cc64a7b90148ff222e52c98` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:32.504523 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e2131-dafe-40f9-993c-a73f8a2a78af admin admin] RBAC: Authorizing `identity:delete_project(project_id=45b2500a5cc64a7b90148ff222e52c98)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:07:32.507141 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e2131-dafe-40f9-993c-a73f8a2a78af admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:07:32.767081 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a17e2131-dafe-40f9-993c-a73f8a2a78af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45b2500a5cc64a7b90148ff222e52c98', 'request_id': 'req-a17e2131-dafe-40f9-993c-a73f8a2a78af'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:32.821482 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:32.988263 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a17e2131-dafe-40f9-993c-a73f8a2a78af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45b2500a5cc64a7b90148ff222e52c98', 'request_id': 'req-a17e2131-dafe-40f9-993c-a73f8a2a78af'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:33.007303 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a17e2131-dafe-40f9-993c-a73f8a2a78af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45b2500a5cc64a7b90148ff222e52c98', 'request_id': 'req-a17e2131-dafe-40f9-993c-a73f8a2a78af'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:33.063509 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a17e2131-dafe-40f9-993c-a73f8a2a78af admin admin] The token cache is being invalidate because project 45b2500a5cc64a7b90148ff222e52c98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:07:33.064134 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a17e2131-dafe-40f9-993c-a73f8a2a78af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:33.076552 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a17e2131-dafe-40f9-993c-a73f8a2a78af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:33.076552 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1165/2309] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:07:32 2022] DELETE /identity/v3/projects/45b2500a5cc64a7b90148ff222e52c98 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:07:33.603584 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:35.083514 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:35.369163 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:36.498534 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:37.453090 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:37.851409 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:39.437859 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:40.555884 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b45c88-0909-42aa-ae50-8b9fd75d3e61 service neutron] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:07:40.558351 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-d0b45c88-0909-42aa-ae50-8b9fd75d3e61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:07:40.584626 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b45c88-0909-42aa-ae50-8b9fd75d3e61 service neutron] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:07:40.686319 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6246c0-f144-4fa5-8d98-794382781a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:07:40.687410 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6246c0-f144-4fa5-8d98-794382781a0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:40.687771 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6246c0-f144-4fa5-8d98-794382781a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:40.687996 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6246c0-f144-4fa5-8d98-794382781a0a admin admin] PATH_INFO: `/v3/users/27c608d080e44857bdef6dc08830561b` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:40.689486 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6246c0-f144-4fa5-8d98-794382781a0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=27c608d080e44857bdef6dc08830561b)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:07:40.691693 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6246c0-f144-4fa5-8d98-794382781a0a admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:07:41.050366 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-aa6246c0-f144-4fa5-8d98-794382781a0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27c608d080e44857bdef6dc08830561b'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:41.075765 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-aa6246c0-f144-4fa5-8d98-794382781a0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27c608d080e44857bdef6dc08830561b'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:41.192395 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-aa6246c0-f144-4fa5-8d98-794382781a0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27c608d080e44857bdef6dc08830561b'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:41.193092 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-aa6246c0-f144-4fa5-8d98-794382781a0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27c608d080e44857bdef6dc08830561b'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:41.204340 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-aa6246c0-f144-4fa5-8d98-794382781a0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27c608d080e44857bdef6dc08830561b'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:41.253229 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1145/2310] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:07:40 2022] DELETE /identity/v3/users/27c608d080e44857bdef6dc08830561b => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:07:41.259049 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350affd5-cc54-4045-a4d2-960a28788eca None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:41.259716 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350affd5-cc54-4045-a4d2-960a28788eca None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:41.259847 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350affd5-cc54-4045-a4d2-960a28788eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:41.301012 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-350affd5-cc54-4045-a4d2-960a28788eca None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:07:41.303083 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-350affd5-cc54-4045-a4d2-960a28788eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:07:41.318396 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:41.443531 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:41.482596 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1166/2311] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:07:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:07:41.502975 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6246c0-f144-4fa5-8d98-794382781a0a admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:07:41.502975 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-aa6246c0-f144-4fa5-8d98-794382781a0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:07:41.639817 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6246c0-f144-4fa5-8d98-794382781a0a admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:07:41.647204 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a3f7d-a9cb-46e2-bea3-26121f218f6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:07:41.648896 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a3f7d-a9cb-46e2-bea3-26121f218f6e service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:41.649635 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a3f7d-a9cb-46e2-bea3-26121f218f6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:41.650321 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a3f7d-a9cb-46e2-bea3-26121f218f6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:41.673200 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a3f7d-a9cb-46e2-bea3-26121f218f6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:07:41.677556 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a3f7d-a9cb-46e2-bea3-26121f218f6e service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:07:41.704189 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1146/2312] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:07:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:07:42.328155 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350affd5-cc54-4045-a4d2-960a28788eca None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:07:42.330047 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-350affd5-cc54-4045-a4d2-960a28788eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:07:42.518391 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350affd5-cc54-4045-a4d2-960a28788eca None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:07:42.531726 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64e422-c5aa-4257-a941-bd1ec1581970 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efe4a6dd11047688892641a936e2914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:07:42.531726 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64e422-c5aa-4257-a941-bd1ec1581970 service placement] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:42.531726 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64e422-c5aa-4257-a941-bd1ec1581970 service placement] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:42.531726 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64e422-c5aa-4257-a941-bd1ec1581970 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:42.536446 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a3f7d-a9cb-46e2-bea3-26121f218f6e service neutron] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:07:42.536667 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ee64e422-c5aa-4257-a941-bd1ec1581970 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:07:42.537962 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-053a3f7d-a9cb-46e2-bea3-26121f218f6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:07:42.554357 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee64e422-c5aa-4257-a941-bd1ec1581970 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:07:42.558007 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee64e422-c5aa-4257-a941-bd1ec1581970 service placement] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:07:42.560791 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a3f7d-a9cb-46e2-bea3-26121f218f6e service neutron] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:07:42.570104 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3af2c-a34e-43e2-9de1-6bfc8b1d7f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:07:42.572450 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3af2c-a34e-43e2-9de1-6bfc8b1d7f3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:42.573867 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3af2c-a34e-43e2-9de1-6bfc8b1d7f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:42.574538 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3af2c-a34e-43e2-9de1-6bfc8b1d7f3f admin admin] PATH_INFO: `/v3/projects/26843cfc4a364f0883b317dd10bec41f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:42.576236 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3af2c-a34e-43e2-9de1-6bfc8b1d7f3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=26843cfc4a364f0883b317dd10bec41f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:07:42.582469 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1167/2313] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:07:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:07:42.582638 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3af2c-a34e-43e2-9de1-6bfc8b1d7f3f admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:07:42.752618 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-eeb3af2c-a34e-43e2-9de1-6bfc8b1d7f3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26843cfc4a364f0883b317dd10bec41f', 'request_id': 'req-eeb3af2c-a34e-43e2-9de1-6bfc8b1d7f3f'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:42.761142 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-eeb3af2c-a34e-43e2-9de1-6bfc8b1d7f3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26843cfc4a364f0883b317dd10bec41f', 'request_id': 'req-eeb3af2c-a34e-43e2-9de1-6bfc8b1d7f3f'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:42.769459 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-eeb3af2c-a34e-43e2-9de1-6bfc8b1d7f3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26843cfc4a364f0883b317dd10bec41f', 'request_id': 'req-eeb3af2c-a34e-43e2-9de1-6bfc8b1d7f3f'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:42.863400 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-eeb3af2c-a34e-43e2-9de1-6bfc8b1d7f3f admin admin] The token cache is being invalidate because project 26843cfc4a364f0883b317dd10bec41f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:07:42.864457 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-eeb3af2c-a34e-43e2-9de1-6bfc8b1d7f3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:42.865911 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-eeb3af2c-a34e-43e2-9de1-6bfc8b1d7f3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:42.872071 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1147/2314] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:07:42 2022] DELETE /identity/v3/projects/26843cfc4a364f0883b317dd10bec41f => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:07:42.879040 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689fce1-330c-4019-9664-6c303009fb12 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:42.879557 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689fce1-330c-4019-9664-6c303009fb12 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:42.880021 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689fce1-330c-4019-9664-6c303009fb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:42.932067 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-8689fce1-330c-4019-9664-6c303009fb12 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:07:42.934216 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8689fce1-330c-4019-9664-6c303009fb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:07:43.079433 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1168/2315] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:07:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:07:43.087600 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babacdad-6ad0-4d0b-a57f-89fc9e854b38 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:43.088151 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babacdad-6ad0-4d0b-a57f-89fc9e854b38 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:43.089128 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babacdad-6ad0-4d0b-a57f-89fc9e854b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:43.118410 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-babacdad-6ad0-4d0b-a57f-89fc9e854b38 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:07:43.119888 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-babacdad-6ad0-4d0b-a57f-89fc9e854b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:07:43.141845 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1148/2316] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:07:43.147382 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689fce1-330c-4019-9664-6c303009fb12 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:07:43.166367 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689fce1-330c-4019-9664-6c303009fb12 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:07:43.174516 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f712cb-a17c-4862-8f63-4ac5c2a3bc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:07:43.175663 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f712cb-a17c-4862-8f63-4ac5c2a3bc99 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:43.176125 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f712cb-a17c-4862-8f63-4ac5c2a3bc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:43.176579 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f712cb-a17c-4862-8f63-4ac5c2a3bc99 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:43.177867 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f712cb-a17c-4862-8f63-4ac5c2a3bc99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:07:43.178430 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f712cb-a17c-4862-8f63-4ac5c2a3bc99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:07:43.181619 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f712cb-a17c-4862-8f63-4ac5c2a3bc99 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:07:43.207552 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1169/2317] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:07:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:07:43.211957 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babacdad-6ad0-4d0b-a57f-89fc9e854b38 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:07:43.224676 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babacdad-6ad0-4d0b-a57f-89fc9e854b38 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:07:43.233438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41fc4eb-6f8c-410d-a64f-e55817028662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:07:43.233438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41fc4eb-6f8c-410d-a64f-e55817028662 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:43.233438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41fc4eb-6f8c-410d-a64f-e55817028662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:43.233438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41fc4eb-6f8c-410d-a64f-e55817028662 admin admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:43.234109 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41fc4eb-6f8c-410d-a64f-e55817028662 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:07:43.235567 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41fc4eb-6f8c-410d-a64f-e55817028662 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:07:43.446505 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1149/2318] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:07:43 2022] POST /identity/v3/projects => generated 371 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:07:43.452041 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f712cb-a17c-4862-8f63-4ac5c2a3bc99 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:07:43.480061 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f712cb-a17c-4862-8f63-4ac5c2a3bc99 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:07:43.641688 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba4331-3c30-4333-bd13-1142e778a298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:07:43.642384 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba4331-3c30-4333-bd13-1142e778a298 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:43.649251 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba4331-3c30-4333-bd13-1142e778a298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:43.649851 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba4331-3c30-4333-bd13-1142e778a298 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:43.650656 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba4331-3c30-4333-bd13-1142e778a298 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:07:43.653502 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba4331-3c30-4333-bd13-1142e778a298 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:07:43.827963 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1170/2319] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:07:43 2022] POST /identity/v3/users => generated 286 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 04:07:43.834400 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41fc4eb-6f8c-410d-a64f-e55817028662 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:07:43.860181 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41fc4eb-6f8c-410d-a64f-e55817028662 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:07:43.865709 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f302f-db86-44de-9b94-4cd1842d3d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:07:43.866402 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f302f-db86-44de-9b94-4cd1842d3d70 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:43.866682 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f302f-db86-44de-9b94-4cd1842d3d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:43.866976 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f302f-db86-44de-9b94-4cd1842d3d70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:43.867785 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f302f-db86-44de-9b94-4cd1842d3d70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:07:43.869393 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f302f-db86-44de-9b94-4cd1842d3d70 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:07:43.881442 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1150/2320] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:07:43 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 04:07:43.885990 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba4331-3c30-4333-bd13-1142e778a298 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:07:43.899220 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba4331-3c30-4333-bd13-1142e778a298 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:07:43.902914 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc443dd5-b4eb-4235-936a-ab83895b7ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:07:43.903674 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc443dd5-b4eb-4235-936a-ab83895b7ded admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:43.903959 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc443dd5-b4eb-4235-936a-ab83895b7ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:43.904241 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc443dd5-b4eb-4235-936a-ab83895b7ded admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:43.904976 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc443dd5-b4eb-4235-936a-ab83895b7ded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:07:43.906732 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc443dd5-b4eb-4235-936a-ab83895b7ded admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:07:43.920583 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1171/2321] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:07:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:07:43.925433 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f302f-db86-44de-9b94-4cd1842d3d70 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:07:43.936505 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f302f-db86-44de-9b94-4cd1842d3d70 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:07:43.941989 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d233931-9854-4e46-83f6-dc32069c00b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:07:43.943011 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d233931-9854-4e46-83f6-dc32069c00b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:43.943326 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d233931-9854-4e46-83f6-dc32069c00b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:43.943683 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d233931-9854-4e46-83f6-dc32069c00b2 admin admin] PATH_INFO: `/v3/projects/34bf57ec095743a4817171afe863b141/users/d47ac1425db34e9184306e705bff7087/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:43.964428 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d233931-9854-4e46-83f6-dc32069c00b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34bf57ec095743a4817171afe863b141, user_id=d47ac1425db34e9184306e705bff7087, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:07:43.967408 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d233931-9854-4e46-83f6-dc32069c00b2 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:07:44.210480 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1151/2322] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:07:43 2022] PUT /identity/v3/projects/34bf57ec095743a4817171afe863b141/users/d47ac1425db34e9184306e705bff7087/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:07:44.222502 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae8e66-db24-4480-8795-352fba734db7 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:44.222804 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae8e66-db24-4480-8795-352fba734db7 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:44.223082 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae8e66-db24-4480-8795-352fba734db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:44.254799 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-85ae8e66-db24-4480-8795-352fba734db7 None None] MFA Rules not processed for user `d47ac1425db34e9184306e705bff7087`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:07:44.256196 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-85ae8e66-db24-4480-8795-352fba734db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:07:44.363977 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1172/2323] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:07:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:07:44.383608 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d233931-9854-4e46-83f6-dc32069c00b2 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:07:44.386172 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-7d233931-9854-4e46-83f6-dc32069c00b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:07:44.498105 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d233931-9854-4e46-83f6-dc32069c00b2 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:07:44.504104 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b8a9d-9d79-42b6-b2e8-66fdef1df763 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:07:44.504953 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b8a9d-9d79-42b6-b2e8-66fdef1df763 service cinder] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:44.505296 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b8a9d-9d79-42b6-b2e8-66fdef1df763 service cinder] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:44.505599 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b8a9d-9d79-42b6-b2e8-66fdef1df763 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:44.526053 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51b8a9d-9d79-42b6-b2e8-66fdef1df763 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:07:44.529639 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51b8a9d-9d79-42b6-b2e8-66fdef1df763 service cinder] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:07:44.550668 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1152/2324] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:07:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 04:07:44.588267 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae8e66-db24-4480-8795-352fba734db7 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:07:44.677918 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae8e66-db24-4480-8795-352fba734db7 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:07:44.685855 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584f0b53-fdb9-4533-a7a5-2d974932e6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:07:44.687114 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f0b53-fdb9-4533-a7a5-2d974932e6fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:44.687630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f0b53-fdb9-4533-a7a5-2d974932e6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:44.688102 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f0b53-fdb9-4533-a7a5-2d974932e6fd admin admin] PATH_INFO: `/v3/users/d47ac1425db34e9184306e705bff7087` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:44.689744 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584f0b53-fdb9-4533-a7a5-2d974932e6fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d47ac1425db34e9184306e705bff7087)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:07:44.692470 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584f0b53-fdb9-4533-a7a5-2d974932e6fd admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:07:45.098297 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-584f0b53-fdb9-4533-a7a5-2d974932e6fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd47ac1425db34e9184306e705bff7087'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:45.099196 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-584f0b53-fdb9-4533-a7a5-2d974932e6fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd47ac1425db34e9184306e705bff7087'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:45.121832 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-584f0b53-fdb9-4533-a7a5-2d974932e6fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd47ac1425db34e9184306e705bff7087'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:45.131121 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-584f0b53-fdb9-4533-a7a5-2d974932e6fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd47ac1425db34e9184306e705bff7087'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:45.132020 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-584f0b53-fdb9-4533-a7a5-2d974932e6fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd47ac1425db34e9184306e705bff7087'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:45.174669 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:45.286398 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1173/2325] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:07:44 2022] DELETE /identity/v3/users/d47ac1425db34e9184306e705bff7087 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:07:45.292463 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf26ee6-e587-4522-ac06-fac16a3d1596 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:45.293174 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf26ee6-e587-4522-ac06-fac16a3d1596 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:45.293953 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf26ee6-e587-4522-ac06-fac16a3d1596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:45.347219 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-8bf26ee6-e587-4522-ac06-fac16a3d1596 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:07:45.351720 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-8bf26ee6-e587-4522-ac06-fac16a3d1596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:07:45.512096 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:45.535204 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1153/2326] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:07:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:07:45.551059 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584f0b53-fdb9-4533-a7a5-2d974932e6fd admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:07:45.553076 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-584f0b53-fdb9-4533-a7a5-2d974932e6fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:07:45.634903 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584f0b53-fdb9-4533-a7a5-2d974932e6fd admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:07:45.640336 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02bd205-5d85-48d9-956a-c8eee95b5b11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:07:45.641171 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02bd205-5d85-48d9-956a-c8eee95b5b11 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:45.641675 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02bd205-5d85-48d9-956a-c8eee95b5b11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:45.642243 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02bd205-5d85-48d9-956a-c8eee95b5b11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:45.653701 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02bd205-5d85-48d9-956a-c8eee95b5b11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:07:45.655882 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02bd205-5d85-48d9-956a-c8eee95b5b11 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:07:45.672647 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1174/2327] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:07:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 04:07:46.660556 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf26ee6-e587-4522-ac06-fac16a3d1596 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:07:46.663312 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-8bf26ee6-e587-4522-ac06-fac16a3d1596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:07:46.698081 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf26ee6-e587-4522-ac06-fac16a3d1596 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:07:46.706293 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601db7e9-1dd7-4f4e-a465-0661f66b3cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:07:46.708303 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601db7e9-1dd7-4f4e-a465-0661f66b3cda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:46.708781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601db7e9-1dd7-4f4e-a465-0661f66b3cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:46.709431 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601db7e9-1dd7-4f4e-a465-0661f66b3cda admin admin] PATH_INFO: `/v3/projects/34bf57ec095743a4817171afe863b141` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:46.712600 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601db7e9-1dd7-4f4e-a465-0661f66b3cda admin admin] RBAC: Authorizing `identity:delete_project(project_id=34bf57ec095743a4817171afe863b141)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:07:46.733303 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601db7e9-1dd7-4f4e-a465-0661f66b3cda admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:07:46.950304 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-601db7e9-1dd7-4f4e-a465-0661f66b3cda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34bf57ec095743a4817171afe863b141', 'request_id': 'req-601db7e9-1dd7-4f4e-a465-0661f66b3cda'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:46.969265 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-601db7e9-1dd7-4f4e-a465-0661f66b3cda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34bf57ec095743a4817171afe863b141', 'request_id': 'req-601db7e9-1dd7-4f4e-a465-0661f66b3cda'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:46.980443 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-601db7e9-1dd7-4f4e-a465-0661f66b3cda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34bf57ec095743a4817171afe863b141', 'request_id': 'req-601db7e9-1dd7-4f4e-a465-0661f66b3cda'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:47.070556 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-601db7e9-1dd7-4f4e-a465-0661f66b3cda admin admin] The token cache is being invalidate because project 34bf57ec095743a4817171afe863b141 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:07:47.071110 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-601db7e9-1dd7-4f4e-a465-0661f66b3cda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:47.072815 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-601db7e9-1dd7-4f4e-a465-0661f66b3cda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:47.079433 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1154/2328] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:07:46 2022] DELETE /identity/v3/projects/34bf57ec095743a4817171afe863b141 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:07:47.087028 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e918091-4875-4bf1-b181-73476e7ba735 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:47.091412 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e918091-4875-4bf1-b181-73476e7ba735 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:47.091412 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e918091-4875-4bf1-b181-73476e7ba735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:47.133563 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-3e918091-4875-4bf1-b181-73476e7ba735 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:07:47.135577 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-3e918091-4875-4bf1-b181-73476e7ba735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:07:47.253101 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1175/2329] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:07:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 04:07:47.270757 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf3a3c-6771-4b09-835d-9ec7f00cc6f3 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:47.271630 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf3a3c-6771-4b09-835d-9ec7f00cc6f3 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:47.274167 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf3a3c-6771-4b09-835d-9ec7f00cc6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:47.310632 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-02bf3a3c-6771-4b09-835d-9ec7f00cc6f3 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:07:47.312504 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-02bf3a3c-6771-4b09-835d-9ec7f00cc6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:07:47.327778 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1155/2330] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:07:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:07:47.332731 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e918091-4875-4bf1-b181-73476e7ba735 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:07:47.346707 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e918091-4875-4bf1-b181-73476e7ba735 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:07:47.352664 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d7ee3-afa3-4b48-967b-68b99b5c2a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:07:47.353617 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d7ee3-afa3-4b48-967b-68b99b5c2a35 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:47.354059 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d7ee3-afa3-4b48-967b-68b99b5c2a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:47.355190 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d7ee3-afa3-4b48-967b-68b99b5c2a35 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:47.356230 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d7ee3-afa3-4b48-967b-68b99b5c2a35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:07:47.356648 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d7ee3-afa3-4b48-967b-68b99b5c2a35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:07:47.358735 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d7ee3-afa3-4b48-967b-68b99b5c2a35 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:07:47.383255 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1176/2331] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:07:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:07:47.384349 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf3a3c-6771-4b09-835d-9ec7f00cc6f3 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:07:47.404422 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf3a3c-6771-4b09-835d-9ec7f00cc6f3 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:07:47.404422 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7944c13-0bd4-4143-b104-7159c8d043ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:07:47.404422 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7944c13-0bd4-4143-b104-7159c8d043ab admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:47.404422 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7944c13-0bd4-4143-b104-7159c8d043ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:47.405119 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7944c13-0bd4-4143-b104-7159c8d043ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:47.405119 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7944c13-0bd4-4143-b104-7159c8d043ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:07:47.406055 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7944c13-0bd4-4143-b104-7159c8d043ab admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:07:47.524199 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1156/2332] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:07:47 2022] POST /identity/v3/projects => generated 389 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 04:07:47.527994 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d7ee3-afa3-4b48-967b-68b99b5c2a35 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:07:47.546662 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d7ee3-afa3-4b48-967b-68b99b5c2a35 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:07:47.576528 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:47.659108 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3adf8cc-5b99-4230-960a-34554be1dcdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:07:47.660066 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adf8cc-5b99-4230-960a-34554be1dcdc admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:47.660410 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adf8cc-5b99-4230-960a-34554be1dcdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:47.660692 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adf8cc-5b99-4230-960a-34554be1dcdc admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:47.661439 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3adf8cc-5b99-4230-960a-34554be1dcdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:07:47.663935 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3adf8cc-5b99-4230-960a-34554be1dcdc admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:07:47.838277 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1177/2333] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:07:47 2022] POST /identity/v3/users => generated 295 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 04:07:47.845549 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7944c13-0bd4-4143-b104-7159c8d043ab admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:07:47.882478 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7944c13-0bd4-4143-b104-7159c8d043ab admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:07:47.888416 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3f4a6-1eef-4fd2-99c2-d87f6a6c034f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:07:47.889191 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3f4a6-1eef-4fd2-99c2-d87f6a6c034f admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:47.889528 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3f4a6-1eef-4fd2-99c2-d87f6a6c034f admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:47.889824 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3f4a6-1eef-4fd2-99c2-d87f6a6c034f admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:47.890830 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b3f4a6-1eef-4fd2-99c2-d87f6a6c034f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:07:47.893340 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b3f4a6-1eef-4fd2-99c2-d87f6a6c034f admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:07:47.915223 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:47.915411 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1157/2334] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:07:47.919165 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3adf8cc-5b99-4230-960a-34554be1dcdc admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:07:47.940478 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3adf8cc-5b99-4230-960a-34554be1dcdc admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:07:47.951078 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6fc3e-5322-4ada-84b9-64dd7dc3dc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:07:47.952796 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6fc3e-5322-4ada-84b9-64dd7dc3dc22 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:47.953313 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6fc3e-5322-4ada-84b9-64dd7dc3dc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:47.953826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6fc3e-5322-4ada-84b9-64dd7dc3dc22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:47.955432 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a6fc3e-5322-4ada-84b9-64dd7dc3dc22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:07:47.959242 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a6fc3e-5322-4ada-84b9-64dd7dc3dc22 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:07:47.980411 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1178/2335] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:07:47.982514 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3f4a6-1eef-4fd2-99c2-d87f6a6c034f admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:07:47.997410 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3f4a6-1eef-4fd2-99c2-d87f6a6c034f admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:07:48.020065 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968c1e9-278b-4d03-8b76-462eb6cab3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:07:48.020065 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968c1e9-278b-4d03-8b76-462eb6cab3f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:48.020065 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968c1e9-278b-4d03-8b76-462eb6cab3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:48.020065 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968c1e9-278b-4d03-8b76-462eb6cab3f3 admin admin] PATH_INFO: `/v3/projects/94b861222fba49399ccd9e013a1c66a3/users/eb3533e36b9c47ddb766312f04447f50/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:48.048089 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968c1e9-278b-4d03-8b76-462eb6cab3f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94b861222fba49399ccd9e013a1c66a3, user_id=eb3533e36b9c47ddb766312f04447f50, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:07:48.051522 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968c1e9-278b-4d03-8b76-462eb6cab3f3 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:07:48.247129 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1158/2336] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:07:47 2022] PUT /identity/v3/projects/94b861222fba49399ccd9e013a1c66a3/users/eb3533e36b9c47ddb766312f04447f50/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:07:48.258600 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db49ab-f9b6-48f0-ae4d-24bc28ad6230 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:48.259390 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db49ab-f9b6-48f0-ae4d-24bc28ad6230 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:48.259390 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db49ab-f9b6-48f0-ae4d-24bc28ad6230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:48.312685 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-d3db49ab-f9b6-48f0-ae4d-24bc28ad6230 None None] MFA Rules not processed for user `eb3533e36b9c47ddb766312f04447f50`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:07:48.313963 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d3db49ab-f9b6-48f0-ae4d-24bc28ad6230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:07:48.419058 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1179/2337] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:07:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:07:48.725792 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968c1e9-278b-4d03-8b76-462eb6cab3f3 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:07:48.730985 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-c968c1e9-278b-4d03-8b76-462eb6cab3f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:07:48.918214 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968c1e9-278b-4d03-8b76-462eb6cab3f3 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:07:48.937384 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc07ad-72ff-4efe-8803-db1945a1d0b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:07:48.938508 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc07ad-72ff-4efe-8803-db1945a1d0b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:48.938999 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc07ad-72ff-4efe-8803-db1945a1d0b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:48.939440 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc07ad-72ff-4efe-8803-db1945a1d0b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:48.983887 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc07ad-72ff-4efe-8803-db1945a1d0b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:07:48.988600 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc07ad-72ff-4efe-8803-db1945a1d0b0 service cinder] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:07:49.004068 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1159/2338] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:07:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:07:50.300140 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:51.032913 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:52.236603 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:52.843934 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:53.284020 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:54.243910 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:54.303703 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfbecc-1101-4484-932a-b6437ec3d15e None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:54.304774 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfbecc-1101-4484-932a-b6437ec3d15e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:54.304774 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfbecc-1101-4484-932a-b6437ec3d15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:54.350491 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-4fcfbecc-1101-4484-932a-b6437ec3d15e None None] MFA Rules not processed for user `dd41221abea04808bed5ef4ac4528c62`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:07:54.352788 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-4fcfbecc-1101-4484-932a-b6437ec3d15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:07:54.485018 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1180/2339] 10.222.0.46 () {58 vars in 967 bytes} [Fri Jul 1 04:07:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:07:54.508562 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc07ad-72ff-4efe-8803-db1945a1d0b0 service cinder] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:07:54.513695 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-bbdc07ad-72ff-4efe-8803-db1945a1d0b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:07:54.655855 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc07ad-72ff-4efe-8803-db1945a1d0b0 service cinder] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:07:54.662824 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4075ab-96e4-49e5-b746-e2bfa0672180 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83787880173b459c8975b834bd47a51a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:07:54.663532 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4075ab-96e4-49e5-b746-e2bfa0672180 service swift] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:54.663820 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4075ab-96e4-49e5-b746-e2bfa0672180 service swift] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:54.664096 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4075ab-96e4-49e5-b746-e2bfa0672180 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:54.674255 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4075ab-96e4-49e5-b746-e2bfa0672180 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:07:54.676120 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4075ab-96e4-49e5-b746-e2bfa0672180 service swift] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:07:54.688232 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1160/2340] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Jul 1 04:07:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 01 04:07:54.921716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:55.839531 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:57.109162 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:57.933815 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:58.295873 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfbecc-1101-4484-932a-b6437ec3d15e None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:07:58.297484 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-4fcfbecc-1101-4484-932a-b6437ec3d15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:07:58.384167 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfbecc-1101-4484-932a-b6437ec3d15e None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:07:58.391766 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38164547-38bc-456d-a0ae-bae3b22f7921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:07:58.393104 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38164547-38bc-456d-a0ae-bae3b22f7921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:58.393651 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38164547-38bc-456d-a0ae-bae3b22f7921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:58.394106 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38164547-38bc-456d-a0ae-bae3b22f7921 admin admin] PATH_INFO: `/v3/users/05862744ad144ebcb851a9e98bac6c54` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:58.395804 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38164547-38bc-456d-a0ae-bae3b22f7921 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05862744ad144ebcb851a9e98bac6c54)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:07:58.397813 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38164547-38bc-456d-a0ae-bae3b22f7921 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:07:58.704581 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-38164547-38bc-456d-a0ae-bae3b22f7921 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05862744ad144ebcb851a9e98bac6c54'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:58.705471 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-38164547-38bc-456d-a0ae-bae3b22f7921 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05862744ad144ebcb851a9e98bac6c54'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:58.737606 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-38164547-38bc-456d-a0ae-bae3b22f7921 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05862744ad144ebcb851a9e98bac6c54'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:58.746577 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-38164547-38bc-456d-a0ae-bae3b22f7921 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05862744ad144ebcb851a9e98bac6c54'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:58.747372 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-38164547-38bc-456d-a0ae-bae3b22f7921 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05862744ad144ebcb851a9e98bac6c54'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:58.819112 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4075ab-96e4-49e5-b746-e2bfa0672180 service swift] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:07:58.821107 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-8f4075ab-96e4-49e5-b746-e2bfa0672180 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:07:58.848667 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1181/2341] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:07:58 2022] DELETE /identity/v3/users/05862744ad144ebcb851a9e98bac6c54 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:07:58.881361 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4075ab-96e4-49e5-b746-e2bfa0672180 service swift] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:07:59.058510 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:07:59.069311 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb29bc-c737-4148-872d-17af4aecc124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:07:59.070999 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb29bc-c737-4148-872d-17af4aecc124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:59.072145 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb29bc-c737-4148-872d-17af4aecc124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:59.072694 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb29bc-c737-4148-872d-17af4aecc124 admin admin] PATH_INFO: `/v3/users/87d63f772da6431abd35221bc9efa038` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:59.077242 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cb29bc-c737-4148-872d-17af4aecc124 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87d63f772da6431abd35221bc9efa038)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:07:59.081376 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cb29bc-c737-4148-872d-17af4aecc124 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:07:59.264836 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38164547-38bc-456d-a0ae-bae3b22f7921 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:07:59.267733 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-38164547-38bc-456d-a0ae-bae3b22f7921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:07:59.317679 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38164547-38bc-456d-a0ae-bae3b22f7921 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:07:59.330162 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc1d6a-12fe-457c-bda9-75df9f2730c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:07:59.332715 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc1d6a-12fe-457c-bda9-75df9f2730c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:07:59.349555 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc1d6a-12fe-457c-bda9-75df9f2730c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:07:59.350880 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc1d6a-12fe-457c-bda9-75df9f2730c5 admin admin] PATH_INFO: `/v3/projects/81d89cef45a1421f88fb9d8757043070` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:07:59.356141 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfc1d6a-12fe-457c-bda9-75df9f2730c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81d89cef45a1421f88fb9d8757043070)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:07:59.358212 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfc1d6a-12fe-457c-bda9-75df9f2730c5 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:07:59.377356 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-c8cb29bc-c737-4148-872d-17af4aecc124 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87d63f772da6431abd35221bc9efa038'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:59.379222 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-c8cb29bc-c737-4148-872d-17af4aecc124 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87d63f772da6431abd35221bc9efa038'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:59.815174 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-c8cb29bc-c737-4148-872d-17af4aecc124 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87d63f772da6431abd35221bc9efa038'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:59.819131 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-c8cb29bc-c737-4148-872d-17af4aecc124 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87d63f772da6431abd35221bc9efa038'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:59.828243 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-c8cb29bc-c737-4148-872d-17af4aecc124 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87d63f772da6431abd35221bc9efa038'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:07:59.867848 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1161/2342] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:07:58 2022] DELETE /identity/v3/users/87d63f772da6431abd35221bc9efa038 => generated 0 bytes in 1049 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:07:59.883794 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-bcfc1d6a-12fe-457c-bda9-75df9f2730c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81d89cef45a1421f88fb9d8757043070', 'request_id': 'req-bcfc1d6a-12fe-457c-bda9-75df9f2730c5'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:00.015140 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-bcfc1d6a-12fe-457c-bda9-75df9f2730c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81d89cef45a1421f88fb9d8757043070', 'request_id': 'req-bcfc1d6a-12fe-457c-bda9-75df9f2730c5'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:00.023605 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-bcfc1d6a-12fe-457c-bda9-75df9f2730c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81d89cef45a1421f88fb9d8757043070', 'request_id': 'req-bcfc1d6a-12fe-457c-bda9-75df9f2730c5'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:00.070429 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-bcfc1d6a-12fe-457c-bda9-75df9f2730c5 admin admin] The token cache is being invalidate because project 81d89cef45a1421f88fb9d8757043070 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:08:00.070429 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-bcfc1d6a-12fe-457c-bda9-75df9f2730c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:00.070429 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-bcfc1d6a-12fe-457c-bda9-75df9f2730c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:00.070429 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1182/2343] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:07:59 2022] DELETE /identity/v3/projects/81d89cef45a1421f88fb9d8757043070 => generated 0 bytes in 808 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:08:00.075915 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb29bc-c737-4148-872d-17af4aecc124 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:08:00.078321 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-c8cb29bc-c737-4148-872d-17af4aecc124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:08:00.206685 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb29bc-c737-4148-872d-17af4aecc124 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:08:00.215621 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10773d-b0fa-4b81-9811-61184dccc3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:08:00.219550 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10773d-b0fa-4b81-9811-61184dccc3c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:00.219550 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10773d-b0fa-4b81-9811-61184dccc3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:00.219550 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10773d-b0fa-4b81-9811-61184dccc3c1 admin admin] PATH_INFO: `/v3/users/71450a1dd85d4d00b5969685353d8faf` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:00.219550 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d10773d-b0fa-4b81-9811-61184dccc3c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71450a1dd85d4d00b5969685353d8faf)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:08:00.221967 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d10773d-b0fa-4b81-9811-61184dccc3c1 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:08:00.284709 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc1d6a-12fe-457c-bda9-75df9f2730c5 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:08:00.286814 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-bcfc1d6a-12fe-457c-bda9-75df9f2730c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:08:00.456087 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-9d10773d-b0fa-4b81-9811-61184dccc3c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71450a1dd85d4d00b5969685353d8faf'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:00.456959 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-9d10773d-b0fa-4b81-9811-61184dccc3c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71450a1dd85d4d00b5969685353d8faf'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:00.462620 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc1d6a-12fe-457c-bda9-75df9f2730c5 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:08:00.469771 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab24ce-d05a-453d-aeb0-321ec96f614e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:08:00.471199 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab24ce-d05a-453d-aeb0-321ec96f614e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:00.471199 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab24ce-d05a-453d-aeb0-321ec96f614e admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:00.471624 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab24ce-d05a-453d-aeb0-321ec96f614e admin admin] PATH_INFO: `/v3/projects/947e1f2e9a4b4ef08510e314ff195226` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:00.473566 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab24ce-d05a-453d-aeb0-321ec96f614e admin admin] RBAC: Authorizing `identity:delete_project(project_id=947e1f2e9a4b4ef08510e314ff195226)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:08:00.476514 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab24ce-d05a-453d-aeb0-321ec96f614e admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:08:00.563313 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-9d10773d-b0fa-4b81-9811-61184dccc3c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71450a1dd85d4d00b5969685353d8faf'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:00.567628 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-9d10773d-b0fa-4b81-9811-61184dccc3c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71450a1dd85d4d00b5969685353d8faf'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:00.580219 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-9d10773d-b0fa-4b81-9811-61184dccc3c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71450a1dd85d4d00b5969685353d8faf'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:00.613296 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1162/2344] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:08:00 2022] DELETE /identity/v3/users/71450a1dd85d4d00b5969685353d8faf => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:08:00.836664 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-baab24ce-d05a-453d-aeb0-321ec96f614e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '947e1f2e9a4b4ef08510e314ff195226', 'request_id': 'req-baab24ce-d05a-453d-aeb0-321ec96f614e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:00.858363 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:00.982104 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-baab24ce-d05a-453d-aeb0-321ec96f614e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '947e1f2e9a4b4ef08510e314ff195226', 'request_id': 'req-baab24ce-d05a-453d-aeb0-321ec96f614e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:00.992539 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-baab24ce-d05a-453d-aeb0-321ec96f614e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '947e1f2e9a4b4ef08510e314ff195226', 'request_id': 'req-baab24ce-d05a-453d-aeb0-321ec96f614e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:01.012412 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-baab24ce-d05a-453d-aeb0-321ec96f614e admin admin] The token cache is being invalidate because project 947e1f2e9a4b4ef08510e314ff195226 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:08:01.012951 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-baab24ce-d05a-453d-aeb0-321ec96f614e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:01.018010 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-baab24ce-d05a-453d-aeb0-321ec96f614e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:01.020955 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1183/2345] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:08:00 2022] DELETE /identity/v3/projects/947e1f2e9a4b4ef08510e314ff195226 => generated 0 bytes in 737 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:08:01.029692 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0fbfb5-ef72-41be-a860-7e140426bdb2 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:01.035373 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0fbfb5-ef72-41be-a860-7e140426bdb2 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:01.040850 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0fbfb5-ef72-41be-a860-7e140426bdb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:01.064864 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-5f0fbfb5-ef72-41be-a860-7e140426bdb2 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:08:01.069367 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-5f0fbfb5-ef72-41be-a860-7e140426bdb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:08:01.106481 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab24ce-d05a-453d-aeb0-321ec96f614e admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:08:01.106481 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-baab24ce-d05a-453d-aeb0-321ec96f614e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:08:01.202392 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1163/2346] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:08:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:08:01.210165 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8887b-0aee-465b-a10a-fd07368a12b7 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:01.210583 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8887b-0aee-465b-a10a-fd07368a12b7 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:01.210888 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8887b-0aee-465b-a10a-fd07368a12b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:01.228042 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab24ce-d05a-453d-aeb0-321ec96f614e admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:08:01.236898 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c41b78e-b91d-4946-8d50-2a91db6e23b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:08:01.240885 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41b78e-b91d-4946-8d50-2a91db6e23b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:01.241296 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41b78e-b91d-4946-8d50-2a91db6e23b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:01.241690 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41b78e-b91d-4946-8d50-2a91db6e23b0 admin admin] PATH_INFO: `/v3/projects/58e89e986c1e4d3992fbc7d934a039a4` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:01.243126 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c41b78e-b91d-4946-8d50-2a91db6e23b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58e89e986c1e4d3992fbc7d934a039a4)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:08:01.245468 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c41b78e-b91d-4946-8d50-2a91db6e23b0 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:08:01.256044 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-a3d8887b-0aee-465b-a10a-fd07368a12b7 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:08:01.259696 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-a3d8887b-0aee-465b-a10a-fd07368a12b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:08:01.284971 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1164/2347] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:08:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:08:01.286171 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8887b-0aee-465b-a10a-fd07368a12b7 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:08:01.297660 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8887b-0aee-465b-a10a-fd07368a12b7 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:08:01.303750 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919acb10-8e8a-4455-a562-47d02707fce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:08:01.305119 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919acb10-8e8a-4455-a562-47d02707fce8 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:01.305399 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919acb10-8e8a-4455-a562-47d02707fce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:01.305862 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919acb10-8e8a-4455-a562-47d02707fce8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:01.306827 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919acb10-8e8a-4455-a562-47d02707fce8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:08:01.307326 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919acb10-8e8a-4455-a562-47d02707fce8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:08:01.309354 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919acb10-8e8a-4455-a562-47d02707fce8 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:08:01.327633 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1165/2348] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:08:01.334199 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919acb10-8e8a-4455-a562-47d02707fce8 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:08:01.354739 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919acb10-8e8a-4455-a562-47d02707fce8 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:08:01.361660 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb273d-274d-47d4-8871-6e42a9aeaeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:08:01.362563 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb273d-274d-47d4-8871-6e42a9aeaeef admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:01.363015 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb273d-274d-47d4-8871-6e42a9aeaeef admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:01.363475 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb273d-274d-47d4-8871-6e42a9aeaeef admin admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:01.364465 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb273d-274d-47d4-8871-6e42a9aeaeef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:08:01.367101 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb273d-274d-47d4-8871-6e42a9aeaeef admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:08:01.400208 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2c41b78e-b91d-4946-8d50-2a91db6e23b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58e89e986c1e4d3992fbc7d934a039a4', 'request_id': 'req-2c41b78e-b91d-4946-8d50-2a91db6e23b0'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:01.498418 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1166/2349] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:08:01 2022] POST /identity/v3/projects => generated 371 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:08:01.501699 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb273d-274d-47d4-8871-6e42a9aeaeef admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:08:01.503103 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2c41b78e-b91d-4946-8d50-2a91db6e23b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58e89e986c1e4d3992fbc7d934a039a4', 'request_id': 'req-2c41b78e-b91d-4946-8d50-2a91db6e23b0'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:01.529335 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2c41b78e-b91d-4946-8d50-2a91db6e23b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58e89e986c1e4d3992fbc7d934a039a4', 'request_id': 'req-2c41b78e-b91d-4946-8d50-2a91db6e23b0'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:01.544368 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2c41b78e-b91d-4946-8d50-2a91db6e23b0 admin admin] The token cache is being invalidate because project 58e89e986c1e4d3992fbc7d934a039a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:08:01.545152 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2c41b78e-b91d-4946-8d50-2a91db6e23b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:01.546082 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2c41b78e-b91d-4946-8d50-2a91db6e23b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:01.548424 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1184/2350] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:08:01 2022] DELETE /identity/v3/projects/58e89e986c1e4d3992fbc7d934a039a4 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:08:01.569469 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d93e99-2837-4eb2-a9ef-e3a70e12ba0d None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:01.570141 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d93e99-2837-4eb2-a9ef-e3a70e12ba0d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:01.571859 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d93e99-2837-4eb2-a9ef-e3a70e12ba0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:01.639962 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-e8d93e99-2837-4eb2-a9ef-e3a70e12ba0d None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:08:01.641238 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e8d93e99-2837-4eb2-a9ef-e3a70e12ba0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:08:01.654657 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb273d-274d-47d4-8871-6e42a9aeaeef admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:08:01.666914 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5e33d-919d-497c-a38b-ed229158ee6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:08:01.666914 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5e33d-919d-497c-a38b-ed229158ee6b admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:01.666914 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5e33d-919d-497c-a38b-ed229158ee6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:01.666914 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5e33d-919d-497c-a38b-ed229158ee6b admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:01.667718 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1185/2351] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:08:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 04:08:01.669186 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc5e33d-919d-497c-a38b-ed229158ee6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:08:01.671863 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc5e33d-919d-497c-a38b-ed229158ee6b admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:08:01.676610 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5002a8-2b0e-41fd-ae22-7560dea1dfe4 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:01.676914 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5002a8-2b0e-41fd-ae22-7560dea1dfe4 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:01.677260 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5002a8-2b0e-41fd-ae22-7560dea1dfe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:01.713452 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-4f5002a8-2b0e-41fd-ae22-7560dea1dfe4 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:08:01.715352 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-4f5002a8-2b0e-41fd-ae22-7560dea1dfe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:08:01.732081 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1186/2352] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:08:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:08:01.736974 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5002a8-2b0e-41fd-ae22-7560dea1dfe4 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:08:01.748836 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5002a8-2b0e-41fd-ae22-7560dea1dfe4 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:08:01.764688 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf605d-9275-4f42-ba29-b8994a49e915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:08:01.765600 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf605d-9275-4f42-ba29-b8994a49e915 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:01.765971 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf605d-9275-4f42-ba29-b8994a49e915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:01.766467 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf605d-9275-4f42-ba29-b8994a49e915 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:01.767680 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cf605d-9275-4f42-ba29-b8994a49e915 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:08:01.768111 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cf605d-9275-4f42-ba29-b8994a49e915 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:08:01.770086 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cf605d-9275-4f42-ba29-b8994a49e915 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:08:01.793792 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1187/2353] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:08:01.798679 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf605d-9275-4f42-ba29-b8994a49e915 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:08:01.817865 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf605d-9275-4f42-ba29-b8994a49e915 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:08:01.826027 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df52d3c-a9bf-4473-8d21-649d822fb830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:08:01.827164 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df52d3c-a9bf-4473-8d21-649d822fb830 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:01.827709 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df52d3c-a9bf-4473-8d21-649d822fb830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:01.828171 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df52d3c-a9bf-4473-8d21-649d822fb830 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:01.829466 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df52d3c-a9bf-4473-8d21-649d822fb830 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:08:01.833352 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df52d3c-a9bf-4473-8d21-649d822fb830 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:08:01.892168 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1167/2354] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:08:01 2022] POST /identity/v3/users => generated 286 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:08:01.894125 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5e33d-919d-497c-a38b-ed229158ee6b admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:08:01.902968 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-cdc5e33d-919d-497c-a38b-ed229158ee6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:08:01.961371 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5e33d-919d-497c-a38b-ed229158ee6b admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:08:01.988744 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1188/2355] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:08:01 2022] POST /identity/v3/projects => generated 377 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 04:08:01.988744 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df52d3c-a9bf-4473-8d21-649d822fb830 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:08:01.992278 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a90c41-037c-41b7-8fb5-a3dcdace1e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:08:01.996920 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a90c41-037c-41b7-8fb5-a3dcdace1e75 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:02.002183 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a90c41-037c-41b7-8fb5-a3dcdace1e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:02.004407 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a90c41-037c-41b7-8fb5-a3dcdace1e75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:02.006122 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a90c41-037c-41b7-8fb5-a3dcdace1e75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:08:02.016346 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a90c41-037c-41b7-8fb5-a3dcdace1e75 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:08:02.049109 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1168/2356] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:08:02.052891 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a90c41-037c-41b7-8fb5-a3dcdace1e75 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:08:02.067155 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a90c41-037c-41b7-8fb5-a3dcdace1e75 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:08:02.154047 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1a594-a8f0-4fea-9787-a48c11b7d4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:08:02.154799 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df52d3c-a9bf-4473-8d21-649d822fb830 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:08:02.154961 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1a594-a8f0-4fea-9787-a48c11b7d4ad admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:02.155199 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1a594-a8f0-4fea-9787-a48c11b7d4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:02.155727 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1a594-a8f0-4fea-9787-a48c11b7d4ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:02.156569 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf1a594-a8f0-4fea-9787-a48c11b7d4ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:08:02.158977 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf1a594-a8f0-4fea-9787-a48c11b7d4ad admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:08:02.171005 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1169/2357] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:08:02.176826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b47302-2b09-43c4-8141-710782a6a726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:08:02.177939 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b47302-2b09-43c4-8141-710782a6a726 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:02.178374 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b47302-2b09-43c4-8141-710782a6a726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:02.178842 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b47302-2b09-43c4-8141-710782a6a726 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:02.179350 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1a594-a8f0-4fea-9787-a48c11b7d4ad admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:08:02.180051 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b47302-2b09-43c4-8141-710782a6a726 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:08:02.184148 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b47302-2b09-43c4-8141-710782a6a726 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:08:02.199317 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1a594-a8f0-4fea-9787-a48c11b7d4ad admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:08:02.204687 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c393fc9-9a8e-403e-8f00-8a5d8cd4bc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:08:02.206298 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c393fc9-9a8e-403e-8f00-8a5d8cd4bc94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:02.206582 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c393fc9-9a8e-403e-8f00-8a5d8cd4bc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:02.207187 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c393fc9-9a8e-403e-8f00-8a5d8cd4bc94 admin admin] PATH_INFO: `/v3/projects/7559582d749f4bacbe3f4585f5e6dc31/users/4324d7dfece4424495ac02b5eef824e3/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:02.230641 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c393fc9-9a8e-403e-8f00-8a5d8cd4bc94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7559582d749f4bacbe3f4585f5e6dc31, user_id=4324d7dfece4424495ac02b5eef824e3, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:08:02.234550 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c393fc9-9a8e-403e-8f00-8a5d8cd4bc94 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:08:02.311311 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1189/2358] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:08:01 2022] POST /identity/v3/users => generated 289 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:08:02.315597 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b47302-2b09-43c4-8141-710782a6a726 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:08:02.326935 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b47302-2b09-43c4-8141-710782a6a726 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:08:02.332646 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4df0c1-b50f-4211-94cf-bae822fe6f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:08:02.333368 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4df0c1-b50f-4211-94cf-bae822fe6f1f admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:02.333649 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4df0c1-b50f-4211-94cf-bae822fe6f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:02.333924 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4df0c1-b50f-4211-94cf-bae822fe6f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:02.334682 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4df0c1-b50f-4211-94cf-bae822fe6f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:08:02.336395 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4df0c1-b50f-4211-94cf-bae822fe6f1f admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:08:02.348762 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1190/2359] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 04:08:02.353118 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4df0c1-b50f-4211-94cf-bae822fe6f1f admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:08:02.365111 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4df0c1-b50f-4211-94cf-bae822fe6f1f admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:08:02.372854 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188697d2-05d1-41d2-a56a-4d0cafb6b1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:08:02.374272 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188697d2-05d1-41d2-a56a-4d0cafb6b1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:02.374723 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188697d2-05d1-41d2-a56a-4d0cafb6b1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:02.375007 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188697d2-05d1-41d2-a56a-4d0cafb6b1d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:02.375799 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188697d2-05d1-41d2-a56a-4d0cafb6b1d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:08:02.377714 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188697d2-05d1-41d2-a56a-4d0cafb6b1d1 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:08:02.379777 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1170/2360] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:08:02 2022] PUT /identity/v3/projects/7559582d749f4bacbe3f4585f5e6dc31/users/4324d7dfece4424495ac02b5eef824e3/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:08:02.391537 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1191/2361] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 04:08:02.394035 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07a4eb-b7f4-4974-8777-941ee31a4cc7 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:02.394269 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07a4eb-b7f4-4974-8777-941ee31a4cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:02.394548 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07a4eb-b7f4-4974-8777-941ee31a4cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:02.396755 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188697d2-05d1-41d2-a56a-4d0cafb6b1d1 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:08:02.417763 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188697d2-05d1-41d2-a56a-4d0cafb6b1d1 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:08:02.438199 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-db07a4eb-b7f4-4974-8777-941ee31a4cc7 None None] MFA Rules not processed for user `4324d7dfece4424495ac02b5eef824e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:08:02.439642 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-db07a4eb-b7f4-4974-8777-941ee31a4cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:08:02.504573 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114b3b6-3d35-4192-95f2-f0fe84b69066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:08:02.505667 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114b3b6-3d35-4192-95f2-f0fe84b69066 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:02.505962 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114b3b6-3d35-4192-95f2-f0fe84b69066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:02.506239 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114b3b6-3d35-4192-95f2-f0fe84b69066 admin admin] PATH_INFO: `/v3/projects/986500aa007a41e8b7f80274139a6e18/users/8727bbc376b1486bbf78ee0b6a502fba/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:02.525232 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114b3b6-3d35-4192-95f2-f0fe84b69066 admin admin] RBAC: Authorizing `identity:create_grant(project_id=986500aa007a41e8b7f80274139a6e18, user_id=8727bbc376b1486bbf78ee0b6a502fba, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:08:02.529209 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114b3b6-3d35-4192-95f2-f0fe84b69066 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:08:02.574809 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:02.576563 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1171/2362] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:08:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 04:08:02.593292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db07a4eb-b7f4-4974-8777-941ee31a4cc7 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:08:02.595009 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-db07a4eb-b7f4-4974-8777-941ee31a4cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:08:02.616381 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1192/2363] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:08:02 2022] PUT /identity/v3/projects/986500aa007a41e8b7f80274139a6e18/users/8727bbc376b1486bbf78ee0b6a502fba/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:08:02.635813 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c18030-0d07-40df-b2f2-43e82691540f None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:02.635813 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c18030-0d07-40df-b2f2-43e82691540f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:02.635813 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c18030-0d07-40df-b2f2-43e82691540f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:02.682695 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-20c18030-0d07-40df-b2f2-43e82691540f None None] MFA Rules not processed for user `8727bbc376b1486bbf78ee0b6a502fba`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:08:02.685201 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-20c18030-0d07-40df-b2f2-43e82691540f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:08:02.711313 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db07a4eb-b7f4-4974-8777-941ee31a4cc7 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:08:02.797314 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1193/2364] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:08:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 04:08:02.814059 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c18030-0d07-40df-b2f2-43e82691540f None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:08:02.816415 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a0e9a3-923e-4e96-8e74-737a838e8d51 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff2e6387d102445d963de072c55833d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:08:02.817150 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-20c18030-0d07-40df-b2f2-43e82691540f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:08:02.817327 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0e9a3-923e-4e96-8e74-737a838e8d51 service glance] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:02.817466 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0e9a3-923e-4e96-8e74-737a838e8d51 service glance] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:02.817746 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0e9a3-923e-4e96-8e74-737a838e8d51 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:02.833781 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c18030-0d07-40df-b2f2-43e82691540f None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:08:02.837936 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf68a1-288f-4060-9fac-22f1bccc88a3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff2e6387d102445d963de072c55833d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:08:02.838648 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf68a1-288f-4060-9fac-22f1bccc88a3 service glance] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:02.838931 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf68a1-288f-4060-9fac-22f1bccc88a3 service glance] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:02.839211 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf68a1-288f-4060-9fac-22f1bccc88a3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:02.872054 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf68a1-288f-4060-9fac-22f1bccc88a3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:08:02.873780 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf68a1-288f-4060-9fac-22f1bccc88a3 service glance] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:08:02.885952 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1194/2365] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:08:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 04:08:02.957226 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a0e9a3-923e-4e96-8e74-737a838e8d51 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:08:02.959316 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a0e9a3-923e-4e96-8e74-737a838e8d51 service glance] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:08:02.976061 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1172/2366] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:08:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 04:08:04.101520 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf68a1-288f-4060-9fac-22f1bccc88a3 service glance] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:08:04.104502 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-7bcf68a1-288f-4060-9fac-22f1bccc88a3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:08:04.249144 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf68a1-288f-4060-9fac-22f1bccc88a3 service glance] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:08:04.254464 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4221db74-8bf1-4e6f-b073-9e263c52db21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:08:04.256442 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221db74-8bf1-4e6f-b073-9e263c52db21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:04.256442 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221db74-8bf1-4e6f-b073-9e263c52db21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:04.256442 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221db74-8bf1-4e6f-b073-9e263c52db21 admin admin] PATH_INFO: `/v3/users/eb3533e36b9c47ddb766312f04447f50` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:04.258024 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4221db74-8bf1-4e6f-b073-9e263c52db21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb3533e36b9c47ddb766312f04447f50)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:08:04.259862 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4221db74-8bf1-4e6f-b073-9e263c52db21 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:08:04.546551 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-4221db74-8bf1-4e6f-b073-9e263c52db21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb3533e36b9c47ddb766312f04447f50'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:04.547892 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-4221db74-8bf1-4e6f-b073-9e263c52db21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb3533e36b9c47ddb766312f04447f50'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:04.573866 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-4221db74-8bf1-4e6f-b073-9e263c52db21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb3533e36b9c47ddb766312f04447f50'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:04.582325 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-4221db74-8bf1-4e6f-b073-9e263c52db21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb3533e36b9c47ddb766312f04447f50'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:04.583254 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-4221db74-8bf1-4e6f-b073-9e263c52db21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb3533e36b9c47ddb766312f04447f50'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:04.708279 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1195/2367] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:08:04 2022] DELETE /identity/v3/users/eb3533e36b9c47ddb766312f04447f50 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:08:04.714936 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a082c37-6b47-47c7-b04d-ff98a55d213c None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:04.715882 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a082c37-6b47-47c7-b04d-ff98a55d213c None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:04.715882 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a082c37-6b47-47c7-b04d-ff98a55d213c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:04.734326 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:04.741052 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-4a082c37-6b47-47c7-b04d-ff98a55d213c None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:08:04.742967 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-4a082c37-6b47-47c7-b04d-ff98a55d213c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:08:04.852244 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1173/2368] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:08:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:08:04.872745 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4221db74-8bf1-4e6f-b073-9e263c52db21 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:08:04.875427 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-4221db74-8bf1-4e6f-b073-9e263c52db21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:08:04.990151 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4221db74-8bf1-4e6f-b073-9e263c52db21 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:08:04.994243 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f49aab-3e07-4cba-a4fa-b0927a864858 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:08:04.995812 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f49aab-3e07-4cba-a4fa-b0927a864858 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:04.996097 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f49aab-3e07-4cba-a4fa-b0927a864858 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:04.996565 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f49aab-3e07-4cba-a4fa-b0927a864858 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:05.007654 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f49aab-3e07-4cba-a4fa-b0927a864858 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:08:05.009147 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f49aab-3e07-4cba-a4fa-b0927a864858 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:08:05.029783 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1196/2369] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:08:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:08:05.112370 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:05.688652 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a082c37-6b47-47c7-b04d-ff98a55d213c None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:08:05.691202 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-4a082c37-6b47-47c7-b04d-ff98a55d213c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:08:05.725073 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a082c37-6b47-47c7-b04d-ff98a55d213c None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:08:05.730899 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa448c-4da2-4381-9d9b-287458a46c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:08:05.735267 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa448c-4da2-4381-9d9b-287458a46c25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:05.735267 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa448c-4da2-4381-9d9b-287458a46c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:05.735267 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa448c-4da2-4381-9d9b-287458a46c25 admin admin] PATH_INFO: `/v3/projects/94b861222fba49399ccd9e013a1c66a3` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:05.735267 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa448c-4da2-4381-9d9b-287458a46c25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94b861222fba49399ccd9e013a1c66a3)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:08:05.736229 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa448c-4da2-4381-9d9b-287458a46c25 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:08:05.899272 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-23aa448c-4da2-4381-9d9b-287458a46c25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94b861222fba49399ccd9e013a1c66a3', 'request_id': 'req-23aa448c-4da2-4381-9d9b-287458a46c25'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:05.908198 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-23aa448c-4da2-4381-9d9b-287458a46c25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94b861222fba49399ccd9e013a1c66a3', 'request_id': 'req-23aa448c-4da2-4381-9d9b-287458a46c25'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:05.915527 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-23aa448c-4da2-4381-9d9b-287458a46c25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94b861222fba49399ccd9e013a1c66a3', 'request_id': 'req-23aa448c-4da2-4381-9d9b-287458a46c25'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:06.026151 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-23aa448c-4da2-4381-9d9b-287458a46c25 admin admin] The token cache is being invalidate because project 94b861222fba49399ccd9e013a1c66a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:08:06.026603 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-23aa448c-4da2-4381-9d9b-287458a46c25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:06.027347 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-23aa448c-4da2-4381-9d9b-287458a46c25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:06.029040 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1174/2370] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:08:05 2022] DELETE /identity/v3/projects/94b861222fba49399ccd9e013a1c66a3 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:08:06.872463 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:07.043982 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=78,keystone:DELETE=17,keystone:INSERT=5 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:07.644165 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:08.467261 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:09.177975 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:09.411917 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f49aab-3e07-4cba-a4fa-b0927a864858 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:08:09.430590 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f49aab-3e07-4cba-a4fa-b0927a864858 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:08:09.519651 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d22f3-1b57-4dd3-b610-7f19e797902d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:08:09.519651 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d22f3-1b57-4dd3-b610-7f19e797902d service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:09.519651 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d22f3-1b57-4dd3-b610-7f19e797902d service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:09.519651 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d22f3-1b57-4dd3-b610-7f19e797902d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:09.521153 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d10d22f3-1b57-4dd3-b610-7f19e797902d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:08:09.600664 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d22f3-1b57-4dd3-b610-7f19e797902d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:08:09.602294 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d22f3-1b57-4dd3-b610-7f19e797902d service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:08:09.613579 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1197/2371] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:08:09 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:08:10.009361 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:10.824546 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:12.028927 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:12.865607 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:13.965736 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:14.481607 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:15.255912 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13b8f3-75cd-4ad7-beef-8a088a6e89fa None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:15.256206 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13b8f3-75cd-4ad7-beef-8a088a6e89fa None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:15.256483 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13b8f3-75cd-4ad7-beef-8a088a6e89fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:15.276554 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-3a13b8f3-75cd-4ad7-beef-8a088a6e89fa None None] MFA Rules not processed for user `71b72d9b9e3a4eb2ba1aae5d8a924afd`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:08:15.277767 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-3a13b8f3-75cd-4ad7-beef-8a088a6e89fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:08:15.306678 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:15.353447 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1175/2372] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:08:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:08:16.226539 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:16.918636 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:17.118068 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:18.215654 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:18.380831 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:18.996590 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:19.111351 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:19.858769 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:19.941142 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:20.395087 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7835649-4119-4834-98dd-819521097405 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:20.395682 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7835649-4119-4834-98dd-819521097405 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:20.396070 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7835649-4119-4834-98dd-819521097405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:20.426790 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-c7835649-4119-4834-98dd-819521097405 None None] MFA Rules not processed for user `dd41221abea04808bed5ef4ac4528c62`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:08:20.428740 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c7835649-4119-4834-98dd-819521097405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:08:20.466226 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:20.503297 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1198/2373] 10.222.0.46 () {58 vars in 1009 bytes} [Fri Jul 1 04:08:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:08:20.519759 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13b8f3-75cd-4ad7-beef-8a088a6e89fa None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:08:20.521365 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-3a13b8f3-75cd-4ad7-beef-8a088a6e89fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:08:20.599145 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13b8f3-75cd-4ad7-beef-8a088a6e89fa None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:08:20.605835 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db057163-e074-46b7-801a-e71cd92e0874 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83787880173b459c8975b834bd47a51a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:08:20.606667 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db057163-e074-46b7-801a-e71cd92e0874 service swift] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:20.606826 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db057163-e074-46b7-801a-e71cd92e0874 service swift] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:20.607126 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db057163-e074-46b7-801a-e71cd92e0874 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:20.616340 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db057163-e074-46b7-801a-e71cd92e0874 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:08:20.617975 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db057163-e074-46b7-801a-e71cd92e0874 service swift] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:08:20.630554 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1176/2374] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Jul 1 04:08:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 04:08:20.682673 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:21.098760 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:21.196852 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:22.014786 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:22.215717 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:23.030471 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:23.112139 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:23.290248 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:23.706355 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:23.855939 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:24.838325 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:24.909222 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:25.355640 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:25.461137 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:26.021645 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:26.335270 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:27.184772 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:27.419534 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:27.436981 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7835649-4119-4834-98dd-819521097405 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:08:27.436981 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c7835649-4119-4834-98dd-819521097405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:08:27.512416 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7835649-4119-4834-98dd-819521097405 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:08:27.519345 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0babcf4a-b3ed-4717-8f0d-4f2abb8551d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:08:27.520474 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babcf4a-b3ed-4717-8f0d-4f2abb8551d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:27.520966 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babcf4a-b3ed-4717-8f0d-4f2abb8551d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:27.523378 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babcf4a-b3ed-4717-8f0d-4f2abb8551d9 admin admin] PATH_INFO: `/v3/users/8727bbc376b1486bbf78ee0b6a502fba` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:27.523378 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0babcf4a-b3ed-4717-8f0d-4f2abb8551d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8727bbc376b1486bbf78ee0b6a502fba)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:08:27.524508 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0babcf4a-b3ed-4717-8f0d-4f2abb8551d9 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:08:27.884281 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0babcf4a-b3ed-4717-8f0d-4f2abb8551d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8727bbc376b1486bbf78ee0b6a502fba'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:27.885018 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0babcf4a-b3ed-4717-8f0d-4f2abb8551d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8727bbc376b1486bbf78ee0b6a502fba'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:27.909984 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0babcf4a-b3ed-4717-8f0d-4f2abb8551d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8727bbc376b1486bbf78ee0b6a502fba'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:27.921708 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0babcf4a-b3ed-4717-8f0d-4f2abb8551d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8727bbc376b1486bbf78ee0b6a502fba'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:27.922593 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0babcf4a-b3ed-4717-8f0d-4f2abb8551d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8727bbc376b1486bbf78ee0b6a502fba'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:28.009893 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1199/2375] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:08:27 2022] DELETE /identity/v3/users/8727bbc376b1486bbf78ee0b6a502fba => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:08:28.015722 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf98344-e33a-4200-ba24-979e869fdd33 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:28.016073 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf98344-e33a-4200-ba24-979e869fdd33 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:28.016422 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf98344-e33a-4200-ba24-979e869fdd33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:28.042212 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-cdf98344-e33a-4200-ba24-979e869fdd33 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:08:28.043442 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-cdf98344-e33a-4200-ba24-979e869fdd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:08:28.103045 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1177/2376] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:08:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:08:28.113840 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0babcf4a-b3ed-4717-8f0d-4f2abb8551d9 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:08:28.115277 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0babcf4a-b3ed-4717-8f0d-4f2abb8551d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:08:28.218460 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0babcf4a-b3ed-4717-8f0d-4f2abb8551d9 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:08:28.223520 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58ecf7-626f-4871-8b02-45442eaea42e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:08:28.224284 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58ecf7-626f-4871-8b02-45442eaea42e service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:28.224790 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58ecf7-626f-4871-8b02-45442eaea42e service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:28.225076 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58ecf7-626f-4871-8b02-45442eaea42e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:28.239858 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad58ecf7-626f-4871-8b02-45442eaea42e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:08:28.241328 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad58ecf7-626f-4871-8b02-45442eaea42e service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:08:28.252973 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1200/2377] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:08:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:08:28.615037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:28.740778 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:28.931535 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf98344-e33a-4200-ba24-979e869fdd33 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:08:28.933913 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-cdf98344-e33a-4200-ba24-979e869fdd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:08:28.948794 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf98344-e33a-4200-ba24-979e869fdd33 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:08:28.954352 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eea288-6479-4724-99a4-cc0cf40512cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:08:28.955514 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eea288-6479-4724-99a4-cc0cf40512cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:28.956002 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eea288-6479-4724-99a4-cc0cf40512cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:28.956597 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eea288-6479-4724-99a4-cc0cf40512cc admin admin] PATH_INFO: `/v3/projects/986500aa007a41e8b7f80274139a6e18` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:28.958028 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eea288-6479-4724-99a4-cc0cf40512cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=986500aa007a41e8b7f80274139a6e18)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:08:28.960227 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eea288-6479-4724-99a4-cc0cf40512cc admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:08:29.128209 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-a3eea288-6479-4724-99a4-cc0cf40512cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '986500aa007a41e8b7f80274139a6e18', 'request_id': 'req-a3eea288-6479-4724-99a4-cc0cf40512cc'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:29.136505 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-a3eea288-6479-4724-99a4-cc0cf40512cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '986500aa007a41e8b7f80274139a6e18', 'request_id': 'req-a3eea288-6479-4724-99a4-cc0cf40512cc'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:29.144878 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-a3eea288-6479-4724-99a4-cc0cf40512cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '986500aa007a41e8b7f80274139a6e18', 'request_id': 'req-a3eea288-6479-4724-99a4-cc0cf40512cc'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:29.272623 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-a3eea288-6479-4724-99a4-cc0cf40512cc admin admin] The token cache is being invalidate because project 986500aa007a41e8b7f80274139a6e18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:08:29.273303 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-a3eea288-6479-4724-99a4-cc0cf40512cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:29.274324 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-a3eea288-6479-4724-99a4-cc0cf40512cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:29.280647 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1178/2378] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:08:28 2022] DELETE /identity/v3/projects/986500aa007a41e8b7f80274139a6e18 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:08:29.284072 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2affe8-33a6-4c2e-904e-e57885df6320 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:29.285157 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2affe8-33a6-4c2e-904e-e57885df6320 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:29.288541 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2affe8-33a6-4c2e-904e-e57885df6320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:29.324428 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-cf2affe8-33a6-4c2e-904e-e57885df6320 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:08:29.325755 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-cf2affe8-33a6-4c2e-904e-e57885df6320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:08:29.414487 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1201/2379] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:08:29.424056 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be0dfc-b847-4b87-9d6d-a107bce59aaf None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:29.424390 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be0dfc-b847-4b87-9d6d-a107bce59aaf None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:29.424661 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be0dfc-b847-4b87-9d6d-a107bce59aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:29.424819 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:29.450333 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-92be0dfc-b847-4b87-9d6d-a107bce59aaf None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:08:29.452040 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-92be0dfc-b847-4b87-9d6d-a107bce59aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:08:29.497321 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1179/2380] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:08:29.498080 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2affe8-33a6-4c2e-904e-e57885df6320 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:08:29.512903 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2affe8-33a6-4c2e-904e-e57885df6320 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:08:29.528668 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca891cf-09ac-4bab-99cd-7135618c63bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:08:29.530847 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca891cf-09ac-4bab-99cd-7135618c63bc admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:29.532571 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca891cf-09ac-4bab-99cd-7135618c63bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:29.533242 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca891cf-09ac-4bab-99cd-7135618c63bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:29.535470 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca891cf-09ac-4bab-99cd-7135618c63bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:08:29.537592 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca891cf-09ac-4bab-99cd-7135618c63bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:08:29.543199 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca891cf-09ac-4bab-99cd-7135618c63bc admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:08:29.577263 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1202/2381] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:08:29.582874 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be0dfc-b847-4b87-9d6d-a107bce59aaf None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:08:29.595057 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be0dfc-b847-4b87-9d6d-a107bce59aaf None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:08:29.601530 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc9d0b-a7b7-47fb-8d0d-cc46696cb36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:08:29.602857 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc9d0b-a7b7-47fb-8d0d-cc46696cb36a admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:29.603154 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc9d0b-a7b7-47fb-8d0d-cc46696cb36a admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:29.603432 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc9d0b-a7b7-47fb-8d0d-cc46696cb36a admin admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:29.604928 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc9d0b-a7b7-47fb-8d0d-cc46696cb36a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:08:29.613576 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc9d0b-a7b7-47fb-8d0d-cc46696cb36a admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:08:29.649582 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:29.735932 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1180/2382] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:08:29 2022] POST /identity/v3/projects => generated 367 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:08:29.740234 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca891cf-09ac-4bab-99cd-7135618c63bc admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:08:29.752441 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca891cf-09ac-4bab-99cd-7135618c63bc admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:08:29.819597 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1a616-898a-4268-ba86-825c93957c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:08:29.820308 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1a616-898a-4268-ba86-825c93957c49 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:29.820594 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1a616-898a-4268-ba86-825c93957c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:29.820873 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1a616-898a-4268-ba86-825c93957c49 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:29.821579 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b1a616-898a-4268-ba86-825c93957c49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:08:29.824268 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b1a616-898a-4268-ba86-825c93957c49 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:08:29.973647 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1203/2383] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:08:29 2022] POST /identity/v3/users => generated 284 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:08:29.977918 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc9d0b-a7b7-47fb-8d0d-cc46696cb36a admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:08:29.992233 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc9d0b-a7b7-47fb-8d0d-cc46696cb36a admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:08:30.005001 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df7e47-bd50-4ccd-8b6b-9442e620f2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:08:30.006087 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df7e47-bd50-4ccd-8b6b-9442e620f2ae admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:30.006371 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df7e47-bd50-4ccd-8b6b-9442e620f2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:30.006793 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df7e47-bd50-4ccd-8b6b-9442e620f2ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:30.007697 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df7e47-bd50-4ccd-8b6b-9442e620f2ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:08:30.009644 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df7e47-bd50-4ccd-8b6b-9442e620f2ae admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:08:30.022684 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1181/2384] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 04:08:30.026952 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1a616-898a-4268-ba86-825c93957c49 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:08:30.038242 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1a616-898a-4268-ba86-825c93957c49 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:08:30.043159 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d336f7-adac-4fbe-81a1-aeb7a8aa1b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:08:30.043877 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d336f7-adac-4fbe-81a1-aeb7a8aa1b82 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:30.044166 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d336f7-adac-4fbe-81a1-aeb7a8aa1b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:30.044445 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d336f7-adac-4fbe-81a1-aeb7a8aa1b82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:30.045181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d336f7-adac-4fbe-81a1-aeb7a8aa1b82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:08:30.046888 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d336f7-adac-4fbe-81a1-aeb7a8aa1b82 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:08:30.061581 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1204/2385] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 04:08:30.064054 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df7e47-bd50-4ccd-8b6b-9442e620f2ae admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:08:30.076753 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df7e47-bd50-4ccd-8b6b-9442e620f2ae admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:08:30.082590 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff354a-f031-4539-8727-97d5a984cb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:08:30.083846 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff354a-f031-4539-8727-97d5a984cb37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:30.084311 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff354a-f031-4539-8727-97d5a984cb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:30.085010 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff354a-f031-4539-8727-97d5a984cb37 admin admin] PATH_INFO: `/v3/projects/bc0cdda4c1c64d58b32696b7f43fcc25/users/d50ade57074b4d2dbc7ab48a9c6af3aa/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:30.106566 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff354a-f031-4539-8727-97d5a984cb37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc0cdda4c1c64d58b32696b7f43fcc25, user_id=d50ade57074b4d2dbc7ab48a9c6af3aa, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:08:30.109368 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff354a-f031-4539-8727-97d5a984cb37 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:08:30.157747 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:30.203469 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1182/2386] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:08:30 2022] PUT /identity/v3/projects/bc0cdda4c1c64d58b32696b7f43fcc25/users/d50ade57074b4d2dbc7ab48a9c6af3aa/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:08:30.214484 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d415e-eb92-4854-8a34-463aaac5af9c None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:30.215516 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d415e-eb92-4854-8a34-463aaac5af9c None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:30.215948 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d415e-eb92-4854-8a34-463aaac5af9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:30.261242 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:30.285275 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-591d415e-eb92-4854-8a34-463aaac5af9c None None] MFA Rules not processed for user `d50ade57074b4d2dbc7ab48a9c6af3aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:08:30.286831 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-591d415e-eb92-4854-8a34-463aaac5af9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:08:30.343569 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:30.435172 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1205/2387] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:08:30 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:08:30.469480 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff354a-f031-4539-8727-97d5a984cb37 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:08:30.474479 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-8cff354a-f031-4539-8727-97d5a984cb37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:08:30.570982 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff354a-f031-4539-8727-97d5a984cb37 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:08:30.575856 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e4f1ee-998a-488d-9a6a-dd500534ff98 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff2e6387d102445d963de072c55833d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:08:30.576624 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e4f1ee-998a-488d-9a6a-dd500534ff98 service glance] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:30.576971 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e4f1ee-998a-488d-9a6a-dd500534ff98 service glance] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:30.577487 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e4f1ee-998a-488d-9a6a-dd500534ff98 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:30.590266 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e4f1ee-998a-488d-9a6a-dd500534ff98 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:08:30.592225 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e4f1ee-998a-488d-9a6a-dd500534ff98 service glance] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:08:30.605168 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1183/2388] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:08:30 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:08:30.890163 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:31.152198 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:31.215722 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:32.621144 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:33.359052 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:34.318377 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:34.494114 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:35.410593 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:35.426235 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:35.556672 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d415e-eb92-4854-8a34-463aaac5af9c None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:08:35.560249 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-591d415e-eb92-4854-8a34-463aaac5af9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:08:35.625673 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:35.635860 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d415e-eb92-4854-8a34-463aaac5af9c None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:08:35.641376 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3a50b-e29f-4c66-be14-2f176913536b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:08:35.642233 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3a50b-e29f-4c66-be14-2f176913536b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:35.642545 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3a50b-e29f-4c66-be14-2f176913536b admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:35.643005 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3a50b-e29f-4c66-be14-2f176913536b admin admin] PATH_INFO: `/v3/users/4324d7dfece4424495ac02b5eef824e3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:35.644663 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3a50b-e29f-4c66-be14-2f176913536b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4324d7dfece4424495ac02b5eef824e3)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:08:35.646980 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3a50b-e29f-4c66-be14-2f176913536b admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:08:35.911024 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ecb3a50b-e29f-4c66-be14-2f176913536b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4324d7dfece4424495ac02b5eef824e3'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:35.911772 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ecb3a50b-e29f-4c66-be14-2f176913536b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4324d7dfece4424495ac02b5eef824e3'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:35.944683 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ecb3a50b-e29f-4c66-be14-2f176913536b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4324d7dfece4424495ac02b5eef824e3'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:35.954148 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ecb3a50b-e29f-4c66-be14-2f176913536b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4324d7dfece4424495ac02b5eef824e3'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:35.954888 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ecb3a50b-e29f-4c66-be14-2f176913536b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4324d7dfece4424495ac02b5eef824e3'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:36.058911 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1206/2389] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:08:35 2022] DELETE /identity/v3/users/4324d7dfece4424495ac02b5eef824e3 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:08:36.066077 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040ba56-acbe-42f0-92b5-ec41a94210a4 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:36.066555 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040ba56-acbe-42f0-92b5-ec41a94210a4 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:36.067075 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040ba56-acbe-42f0-92b5-ec41a94210a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:36.088282 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-b040ba56-acbe-42f0-92b5-ec41a94210a4 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:08:36.090064 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-b040ba56-acbe-42f0-92b5-ec41a94210a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:08:36.116544 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:36.143097 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:36.175170 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1184/2390] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:08:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:08:36.185820 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3a50b-e29f-4c66-be14-2f176913536b admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:08:36.190648 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ecb3a50b-e29f-4c66-be14-2f176913536b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:08:36.266559 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3a50b-e29f-4c66-be14-2f176913536b admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:08:36.270316 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6b851-2403-4214-925e-850aa07fc727 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:08:36.270985 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6b851-2403-4214-925e-850aa07fc727 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:36.271272 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6b851-2403-4214-925e-850aa07fc727 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:36.271663 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6b851-2403-4214-925e-850aa07fc727 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:36.283380 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc6b851-2403-4214-925e-850aa07fc727 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:08:36.285189 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc6b851-2403-4214-925e-850aa07fc727 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:08:36.297040 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1207/2391] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:08:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:08:36.358394 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:36.585664 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:36.702505 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:36.864351 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040ba56-acbe-42f0-92b5-ec41a94210a4 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:08:36.864351 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-b040ba56-acbe-42f0-92b5-ec41a94210a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:08:36.868518 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040ba56-acbe-42f0-92b5-ec41a94210a4 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:08:36.877807 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07490b-58bf-456a-8eac-0b42382bb459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:08:36.878693 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07490b-58bf-456a-8eac-0b42382bb459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:36.878971 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07490b-58bf-456a-8eac-0b42382bb459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:36.879243 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07490b-58bf-456a-8eac-0b42382bb459 admin admin] PATH_INFO: `/v3/projects/7559582d749f4bacbe3f4585f5e6dc31` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:36.881006 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf07490b-58bf-456a-8eac-0b42382bb459 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7559582d749f4bacbe3f4585f5e6dc31)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:08:36.882600 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf07490b-58bf-456a-8eac-0b42382bb459 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:08:37.064435 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-cf07490b-58bf-456a-8eac-0b42382bb459 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7559582d749f4bacbe3f4585f5e6dc31', 'request_id': 'req-cf07490b-58bf-456a-8eac-0b42382bb459'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:37.082247 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-cf07490b-58bf-456a-8eac-0b42382bb459 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7559582d749f4bacbe3f4585f5e6dc31', 'request_id': 'req-cf07490b-58bf-456a-8eac-0b42382bb459'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:37.085699 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-cf07490b-58bf-456a-8eac-0b42382bb459 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7559582d749f4bacbe3f4585f5e6dc31', 'request_id': 'req-cf07490b-58bf-456a-8eac-0b42382bb459'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:37.225173 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-cf07490b-58bf-456a-8eac-0b42382bb459 admin admin] The token cache is being invalidate because project 7559582d749f4bacbe3f4585f5e6dc31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:08:37.225537 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-cf07490b-58bf-456a-8eac-0b42382bb459 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:37.226293 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-cf07490b-58bf-456a-8eac-0b42382bb459 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:37.227999 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1185/2392] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:08:36 2022] DELETE /identity/v3/projects/7559582d749f4bacbe3f4585f5e6dc31 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:08:37.232979 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94f488-3bbb-4769-b9c6-da41e146c956 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:37.233267 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94f488-3bbb-4769-b9c6-da41e146c956 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:37.233549 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94f488-3bbb-4769-b9c6-da41e146c956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:37.252896 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-1e94f488-3bbb-4769-b9c6-da41e146c956 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:08:37.254156 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1e94f488-3bbb-4769-b9c6-da41e146c956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:08:37.341311 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1208/2393] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:08:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:08:37.356154 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d0337-61c3-4601-816b-ed0bc67e0229 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:37.356459 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d0337-61c3-4601-816b-ed0bc67e0229 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:37.356739 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d0337-61c3-4601-816b-ed0bc67e0229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:37.378371 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-d78d0337-61c3-4601-816b-ed0bc67e0229 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:08:37.379411 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-d78d0337-61c3-4601-816b-ed0bc67e0229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:08:37.381539 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:37.388508 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1186/2394] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:08:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:08:37.393001 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94f488-3bbb-4769-b9c6-da41e146c956 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:08:37.404803 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94f488-3bbb-4769-b9c6-da41e146c956 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:08:37.409905 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29448123-40de-4c06-9883-840ff3c88bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:08:37.410685 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29448123-40de-4c06-9883-840ff3c88bab admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:37.411375 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29448123-40de-4c06-9883-840ff3c88bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:37.411375 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29448123-40de-4c06-9883-840ff3c88bab admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:37.412043 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29448123-40de-4c06-9883-840ff3c88bab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:08:37.412499 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29448123-40de-4c06-9883-840ff3c88bab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:08:37.414244 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29448123-40de-4c06-9883-840ff3c88bab admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:08:37.431091 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1209/2395] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:08:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:08:37.432366 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d0337-61c3-4601-816b-ed0bc67e0229 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:08:37.444891 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d0337-61c3-4601-816b-ed0bc67e0229 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:08:37.450629 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99456d0-2b8b-4fe5-8790-553aaa0372a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:08:37.451357 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99456d0-2b8b-4fe5-8790-553aaa0372a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:37.457254 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99456d0-2b8b-4fe5-8790-553aaa0372a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:37.457254 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99456d0-2b8b-4fe5-8790-553aaa0372a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:37.457254 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99456d0-2b8b-4fe5-8790-553aaa0372a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:08:37.457254 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99456d0-2b8b-4fe5-8790-553aaa0372a1 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:08:37.564630 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1187/2396] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:08:37 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:08:37.565931 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29448123-40de-4c06-9883-840ff3c88bab admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:08:37.569424 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:37.577489 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29448123-40de-4c06-9883-840ff3c88bab admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:08:37.692570 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d938d6-29f6-4e29-9f54-67860f35b7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:08:37.692570 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d938d6-29f6-4e29-9f54-67860f35b7da admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:37.692570 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d938d6-29f6-4e29-9f54-67860f35b7da admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:37.692570 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d938d6-29f6-4e29-9f54-67860f35b7da admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:37.693091 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d938d6-29f6-4e29-9f54-67860f35b7da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:08:37.693091 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d938d6-29f6-4e29-9f54-67860f35b7da admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:08:37.871309 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1210/2397] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:08:37 2022] POST /identity/v3/users => generated 292 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:08:37.873257 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99456d0-2b8b-4fe5-8790-553aaa0372a1 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:08:37.884437 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99456d0-2b8b-4fe5-8790-553aaa0372a1 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:08:37.890775 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091ab65-6785-4931-8595-036382f3a241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:08:37.891501 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091ab65-6785-4931-8595-036382f3a241 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:37.891813 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091ab65-6785-4931-8595-036382f3a241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:37.892093 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091ab65-6785-4931-8595-036382f3a241 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:37.892960 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d091ab65-6785-4931-8595-036382f3a241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:08:37.894469 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d091ab65-6785-4931-8595-036382f3a241 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:08:37.906336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1188/2398] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 04:08:37.911895 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d938d6-29f6-4e29-9f54-67860f35b7da admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:08:37.923244 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d938d6-29f6-4e29-9f54-67860f35b7da admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:08:37.929063 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409bcf0c-38ce-430e-8a7d-f1e98e5b66ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:08:37.929741 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409bcf0c-38ce-430e-8a7d-f1e98e5b66ca admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:37.930021 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409bcf0c-38ce-430e-8a7d-f1e98e5b66ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:37.930296 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409bcf0c-38ce-430e-8a7d-f1e98e5b66ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:37.931056 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409bcf0c-38ce-430e-8a7d-f1e98e5b66ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:08:37.932712 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409bcf0c-38ce-430e-8a7d-f1e98e5b66ca admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:08:37.944793 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1211/2399] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 04:08:37.948998 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091ab65-6785-4931-8595-036382f3a241 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:08:37.959097 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091ab65-6785-4931-8595-036382f3a241 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:08:37.963840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd029f9f-f1b9-4c71-97bc-b27fd387c09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:08:37.965080 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd029f9f-f1b9-4c71-97bc-b27fd387c09e admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:37.965544 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd029f9f-f1b9-4c71-97bc-b27fd387c09e admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:37.965843 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd029f9f-f1b9-4c71-97bc-b27fd387c09e admin admin] PATH_INFO: `/v3/projects/14c7d7f868d24c839c0152995312908e/users/f3d2af465e624b86a0af448258ca4c97/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:37.983680 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd029f9f-f1b9-4c71-97bc-b27fd387c09e admin admin] RBAC: Authorizing `identity:create_grant(project_id=14c7d7f868d24c839c0152995312908e, user_id=f3d2af465e624b86a0af448258ca4c97, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:08:37.986368 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd029f9f-f1b9-4c71-97bc-b27fd387c09e admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:08:38.089651 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1189/2400] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:08:37 2022] PUT /identity/v3/projects/14c7d7f868d24c839c0152995312908e/users/f3d2af465e624b86a0af448258ca4c97/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:08:38.102504 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a874c79-1bb1-4287-ae29-e07ccf72812d None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:38.103500 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a874c79-1bb1-4287-ae29-e07ccf72812d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:38.103500 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a874c79-1bb1-4287-ae29-e07ccf72812d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:38.125251 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-3a874c79-1bb1-4287-ae29-e07ccf72812d None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:08:38.126482 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-3a874c79-1bb1-4287-ae29-e07ccf72812d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:08:38.209583 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1212/2401] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:08:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:08:38.215554 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd029f9f-f1b9-4c71-97bc-b27fd387c09e admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:08:38.217446 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-bd029f9f-f1b9-4c71-97bc-b27fd387c09e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:08:38.300241 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd029f9f-f1b9-4c71-97bc-b27fd387c09e admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:08:38.304785 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d0cca-faa1-48f5-b258-a04c63a10acd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:08:38.305677 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d0cca-faa1-48f5-b258-a04c63a10acd service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:38.306139 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d0cca-faa1-48f5-b258-a04c63a10acd service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:38.306569 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d0cca-faa1-48f5-b258-a04c63a10acd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:38.318531 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708d0cca-faa1-48f5-b258-a04c63a10acd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:08:38.320596 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708d0cca-faa1-48f5-b258-a04c63a10acd service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:08:38.334085 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1190/2402] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:08:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 04:08:38.747169 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:38.979730 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:39.460937 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:39.546856 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:39.873114 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:INSERT=1,keystone:SELECT=90,keystone:DELETE=9 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:39.907767 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41138df-5e05-4158-926c-7282320a78a9 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:39.912562 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41138df-5e05-4158-926c-7282320a78a9 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:39.913072 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41138df-5e05-4158-926c-7282320a78a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:39.953410 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-a41138df-5e05-4158-926c-7282320a78a9 None None] MFA Rules not processed for user `f3d2af465e624b86a0af448258ca4c97`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:08:39.954749 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a41138df-5e05-4158-926c-7282320a78a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:08:40.039300 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1213/2403] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:08:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:08:40.051888 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d0cca-faa1-48f5-b258-a04c63a10acd service neutron] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:08:40.055287 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-708d0cca-faa1-48f5-b258-a04c63a10acd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:08:40.103276 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:40.145796 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d0cca-faa1-48f5-b258-a04c63a10acd service neutron] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:08:40.157818 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66988dfc-2a60-44b1-8826-20faf5e03681 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:08:40.158745 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66988dfc-2a60-44b1-8826-20faf5e03681 service cinder] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:40.159375 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66988dfc-2a60-44b1-8826-20faf5e03681 service cinder] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:40.159841 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66988dfc-2a60-44b1-8826-20faf5e03681 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:40.174129 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66988dfc-2a60-44b1-8826-20faf5e03681 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:08:40.175500 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66988dfc-2a60-44b1-8826-20faf5e03681 service cinder] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:08:40.186306 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1191/2404] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:08:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:08:40.277023 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:40.550936 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:40.838435 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:41.466576 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:42.037935 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:42.052144 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476153e4-605b-4cb8-97d2-de04f0f9a8dc None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:42.052531 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476153e4-605b-4cb8-97d2-de04f0f9a8dc None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:42.052862 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476153e4-605b-4cb8-97d2-de04f0f9a8dc None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:42.054379 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1214/2405] 10.222.0.46 () {54 vars in 921 bytes} [Fri Jul 1 04:08:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 04:08:42.061653 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043bd6a-5c63-4d37-bb03-60f3d179e636 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:42.061942 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043bd6a-5c63-4d37-bb03-60f3d179e636 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:42.062184 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043bd6a-5c63-4d37-bb03-60f3d179e636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:42.109888 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-a043bd6a-5c63-4d37-bb03-60f3d179e636 None None] MFA Rules not processed for user `2da466ad31d344898f5c838f77d45181`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:08:42.111606 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-a043bd6a-5c63-4d37-bb03-60f3d179e636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:08:42.145608 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:42.204934 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b08e0-6d0e-4418-b08b-90b9dd53ff55 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:42.205238 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b08e0-6d0e-4418-b08b-90b9dd53ff55 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:42.205591 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b08e0-6d0e-4418-b08b-90b9dd53ff55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:42.224923 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-347b08e0-6d0e-4418-b08b-90b9dd53ff55 None None] MFA Rules not processed for user `f3d2af465e624b86a0af448258ca4c97`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:08:42.226320 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-347b08e0-6d0e-4418-b08b-90b9dd53ff55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:08:42.234054 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1215/2406] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:08:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 04:08:42.236428 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1192/2407] 10.222.0.46 () {58 vars in 1018 bytes} [Fri Jul 1 04:08:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:08:42.250535 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b08e0-6d0e-4418-b08b-90b9dd53ff55 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:08:42.252912 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-347b08e0-6d0e-4418-b08b-90b9dd53ff55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:08:42.337301 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:42.360213 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b08e0-6d0e-4418-b08b-90b9dd53ff55 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:08:42.367933 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7024fc-57de-4936-8f44-09f249f03946 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff2e6387d102445d963de072c55833d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:08:42.368832 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7024fc-57de-4936-8f44-09f249f03946 service glance] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:42.369176 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7024fc-57de-4936-8f44-09f249f03946 service glance] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:42.369525 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7024fc-57de-4936-8f44-09f249f03946 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:42.390408 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7024fc-57de-4936-8f44-09f249f03946 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:08:42.392829 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7024fc-57de-4936-8f44-09f249f03946 service glance] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:08:42.408234 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1216/2408] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:08:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:08:42.498056 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:42.638668 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50103417-170e-4dd9-b2ed-faf5c8d6b501 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:42.639082 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50103417-170e-4dd9-b2ed-faf5c8d6b501 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:42.639375 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50103417-170e-4dd9-b2ed-faf5c8d6b501 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:42.640938 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1193/2409] 10.222.0.46 () {54 vars in 921 bytes} [Fri Jul 1 04:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 04:08:42.646331 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38027b5-4e5e-4c21-98fb-a98c05b7cbec None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:42.646693 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38027b5-4e5e-4c21-98fb-a98c05b7cbec None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:42.646977 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38027b5-4e5e-4c21-98fb-a98c05b7cbec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:42.670800 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-a38027b5-4e5e-4c21-98fb-a98c05b7cbec None None] MFA Rules not processed for user `93929b81a23c482ca7ce47e7a94682e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:08:42.672372 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a38027b5-4e5e-4c21-98fb-a98c05b7cbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:08:42.680216 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1217/2410] 10.222.0.46 () {58 vars in 1018 bytes} [Fri Jul 1 04:08:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:08:42.697864 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50103417-170e-4dd9-b2ed-faf5c8d6b501 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:08:42.700453 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-50103417-170e-4dd9-b2ed-faf5c8d6b501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:08:42.725115 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50103417-170e-4dd9-b2ed-faf5c8d6b501 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:08:42.728988 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f10be4-8713-4d69-882f-d39713a12a20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:08:42.729675 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f10be4-8713-4d69-882f-d39713a12a20 service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:42.729962 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f10be4-8713-4d69-882f-d39713a12a20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:42.730245 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f10be4-8713-4d69-882f-d39713a12a20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:42.738381 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f10be4-8713-4d69-882f-d39713a12a20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:08:42.739924 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f10be4-8713-4d69-882f-d39713a12a20 service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:08:42.749299 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1194/2411] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:08:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:08:42.975707 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d85a4-2e96-4a54-9a24-b0d7512ca2e2 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:42.976000 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d85a4-2e96-4a54-9a24-b0d7512ca2e2 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:42.976278 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d85a4-2e96-4a54-9a24-b0d7512ca2e2 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:42.978643 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1218/2412] 10.222.0.46 () {54 vars in 921 bytes} [Fri Jul 1 04:08:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 04:08:42.989998 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b6b0a-bd02-44f6-a11b-85961ff13da1 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:42.990357 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b6b0a-bd02-44f6-a11b-85961ff13da1 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:42.990705 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b6b0a-bd02-44f6-a11b-85961ff13da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:43.022530 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-0b5b6b0a-bd02-44f6-a11b-85961ff13da1 None None] MFA Rules not processed for user `2da466ad31d344898f5c838f77d45181`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:08:43.023870 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-0b5b6b0a-bd02-44f6-a11b-85961ff13da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:08:43.033876 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1195/2413] 10.222.0.46 () {58 vars in 1018 bytes} [Fri Jul 1 04:08:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:08:43.049869 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d85a4-2e96-4a54-9a24-b0d7512ca2e2 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:08:43.070701 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d85a4-2e96-4a54-9a24-b0d7512ca2e2 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:08:43.079154 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c4ab3-93b8-49ad-af6f-2343db04d21a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:08:43.080254 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c4ab3-93b8-49ad-af6f-2343db04d21a service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:43.080800 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c4ab3-93b8-49ad-af6f-2343db04d21a service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:43.081119 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c4ab3-93b8-49ad-af6f-2343db04d21a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:43.090632 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:43.094529 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84c4ab3-93b8-49ad-af6f-2343db04d21a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:08:43.096105 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84c4ab3-93b8-49ad-af6f-2343db04d21a service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:08:43.110657 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1219/2414] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:08:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:08:43.183718 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:43.556454 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bda432-185b-418b-87e1-304255ca5bf4 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:43.557086 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bda432-185b-418b-87e1-304255ca5bf4 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:43.557086 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bda432-185b-418b-87e1-304255ca5bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:43.574788 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-18bda432-185b-418b-87e1-304255ca5bf4 None None] MFA Rules not processed for user `a61e50919a13413c9f641f23f6b30217`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:08:43.580078 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-18bda432-185b-418b-87e1-304255ca5bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:08:43.638802 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1196/2415] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:08:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 04:08:43.661269 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:44.215388 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:49.993499 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438fd83-10b3-48f2-a4a6-053c2c1f4a07 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:49.998333 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438fd83-10b3-48f2-a4a6-053c2c1f4a07 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:49.998333 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438fd83-10b3-48f2-a4a6-053c2c1f4a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:50.014420 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-9438fd83-10b3-48f2-a4a6-053c2c1f4a07 None None] MFA Rules not processed for user `dd41221abea04808bed5ef4ac4528c62`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:08:50.015732 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9438fd83-10b3-48f2-a4a6-053c2c1f4a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:08:50.110432 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1220/2416] 10.222.0.46 () {58 vars in 1009 bytes} [Fri Jul 1 04:08:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:08:50.124186 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bda432-185b-418b-87e1-304255ca5bf4 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:08:50.125701 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-18bda432-185b-418b-87e1-304255ca5bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:08:50.222986 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bda432-185b-418b-87e1-304255ca5bf4 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:08:50.230372 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1b20c-3725-411d-9afc-c8560aa342d0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83787880173b459c8975b834bd47a51a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:08:50.231312 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1b20c-3725-411d-9afc-c8560aa342d0 service swift] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:50.231646 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1b20c-3725-411d-9afc-c8560aa342d0 service swift] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:50.235078 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1b20c-3725-411d-9afc-c8560aa342d0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:50.242195 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1b20c-3725-411d-9afc-c8560aa342d0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:08:50.243869 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1b20c-3725-411d-9afc-c8560aa342d0 service swift] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:08:50.253457 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1197/2417] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Jul 1 04:08:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 04:08:59.275896 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438fd83-10b3-48f2-a4a6-053c2c1f4a07 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:08:59.278760 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9438fd83-10b3-48f2-a4a6-053c2c1f4a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:08:59.308284 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438fd83-10b3-48f2-a4a6-053c2c1f4a07 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:08:59.315413 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c58d7d-5e2f-4d67-9383-3ba9bb0e7855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:08:59.316499 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c58d7d-5e2f-4d67-9383-3ba9bb0e7855 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:59.317242 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c58d7d-5e2f-4d67-9383-3ba9bb0e7855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:59.317242 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c58d7d-5e2f-4d67-9383-3ba9bb0e7855 admin admin] PATH_INFO: `/v3/users/d50ade57074b4d2dbc7ab48a9c6af3aa` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:59.318318 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c58d7d-5e2f-4d67-9383-3ba9bb0e7855 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d50ade57074b4d2dbc7ab48a9c6af3aa)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:08:59.320523 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c58d7d-5e2f-4d67-9383-3ba9bb0e7855 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:08:59.624139 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:08:59.636026 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-79c58d7d-5e2f-4d67-9383-3ba9bb0e7855 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd50ade57074b4d2dbc7ab48a9c6af3aa'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:59.638457 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-79c58d7d-5e2f-4d67-9383-3ba9bb0e7855 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd50ade57074b4d2dbc7ab48a9c6af3aa'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:59.667917 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-79c58d7d-5e2f-4d67-9383-3ba9bb0e7855 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd50ade57074b4d2dbc7ab48a9c6af3aa'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:59.682885 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-79c58d7d-5e2f-4d67-9383-3ba9bb0e7855 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd50ade57074b4d2dbc7ab48a9c6af3aa'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:59.684474 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-79c58d7d-5e2f-4d67-9383-3ba9bb0e7855 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd50ade57074b4d2dbc7ab48a9c6af3aa'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:08:59.823568 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1221/2418] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:08:59 2022] DELETE /identity/v3/users/d50ade57074b4d2dbc7ab48a9c6af3aa => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:08:59.828361 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877ccfd-7020-4b45-ac8e-d5b41c09c65c None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:08:59.829007 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877ccfd-7020-4b45-ac8e-d5b41c09c65c None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:08:59.829007 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877ccfd-7020-4b45-ac8e-d5b41c09c65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:08:59.849875 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-b877ccfd-7020-4b45-ac8e-d5b41c09c65c None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:08:59.851925 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-b877ccfd-7020-4b45-ac8e-d5b41c09c65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:08:59.928109 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1198/2419] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:08:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:08:59.939657 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c58d7d-5e2f-4d67-9383-3ba9bb0e7855 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:08:59.941275 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-79c58d7d-5e2f-4d67-9383-3ba9bb0e7855 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:09:00.016121 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c58d7d-5e2f-4d67-9383-3ba9bb0e7855 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:09:00.019852 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f094b3-d6d4-4354-a4d1-9affd76d7fb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:09:00.020642 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f094b3-d6d4-4354-a4d1-9affd76d7fb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:09:00.020924 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f094b3-d6d4-4354-a4d1-9affd76d7fb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:09:00.021198 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f094b3-d6d4-4354-a4d1-9affd76d7fb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:09:00.032355 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f094b3-d6d4-4354-a4d1-9affd76d7fb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:09:00.037705 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f094b3-d6d4-4354-a4d1-9affd76d7fb1 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:09:00.046833 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1222/2420] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:08:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:09:00.518751 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877ccfd-7020-4b45-ac8e-d5b41c09c65c None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:09:00.524326 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-b877ccfd-7020-4b45-ac8e-d5b41c09c65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:09:00.548416 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877ccfd-7020-4b45-ac8e-d5b41c09c65c None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:09:00.560166 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879f288-ed26-40b4-9dfe-1f32a6cb72dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:09:00.561402 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879f288-ed26-40b4-9dfe-1f32a6cb72dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:09:00.561855 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879f288-ed26-40b4-9dfe-1f32a6cb72dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:09:00.562155 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879f288-ed26-40b4-9dfe-1f32a6cb72dc admin admin] PATH_INFO: `/v3/projects/bc0cdda4c1c64d58b32696b7f43fcc25` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:09:00.563685 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879f288-ed26-40b4-9dfe-1f32a6cb72dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc0cdda4c1c64d58b32696b7f43fcc25)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:09:00.565980 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879f288-ed26-40b4-9dfe-1f32a6cb72dc admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:09:00.777424 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-a879f288-ed26-40b4-9dfe-1f32a6cb72dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc0cdda4c1c64d58b32696b7f43fcc25', 'request_id': 'req-a879f288-ed26-40b4-9dfe-1f32a6cb72dc'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:09:00.789828 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-a879f288-ed26-40b4-9dfe-1f32a6cb72dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc0cdda4c1c64d58b32696b7f43fcc25', 'request_id': 'req-a879f288-ed26-40b4-9dfe-1f32a6cb72dc'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:09:00.800996 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-a879f288-ed26-40b4-9dfe-1f32a6cb72dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc0cdda4c1c64d58b32696b7f43fcc25', 'request_id': 'req-a879f288-ed26-40b4-9dfe-1f32a6cb72dc'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:09:00.956971 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:09:00.961959 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-a879f288-ed26-40b4-9dfe-1f32a6cb72dc admin admin] The token cache is being invalidate because project bc0cdda4c1c64d58b32696b7f43fcc25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:09:00.962252 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-a879f288-ed26-40b4-9dfe-1f32a6cb72dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:09:00.962894 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-a879f288-ed26-40b4-9dfe-1f32a6cb72dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:09:00.964482 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1199/2421] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:09:00 2022] DELETE /identity/v3/projects/bc0cdda4c1c64d58b32696b7f43fcc25 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:09:00.969654 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e845a-2f19-46cd-bca6-291e0e469622 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:09:00.970136 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e845a-2f19-46cd-bca6-291e0e469622 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:09:00.970228 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e845a-2f19-46cd-bca6-291e0e469622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:09:00.989707 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-fa6e845a-2f19-46cd-bca6-291e0e469622 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:09:00.990727 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-fa6e845a-2f19-46cd-bca6-291e0e469622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:09:01.056420 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1223/2422] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:09:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:09:01.064484 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3e6cb-24cd-47b5-8075-ba4ec0a17766 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:09:01.064931 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3e6cb-24cd-47b5-8075-ba4ec0a17766 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:09:01.065303 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3e6cb-24cd-47b5-8075-ba4ec0a17766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:09:01.086624 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-3bd3e6cb-24cd-47b5-8075-ba4ec0a17766 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:09:01.087880 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-3bd3e6cb-24cd-47b5-8075-ba4ec0a17766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:09:01.096689 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1200/2423] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:09:01.102096 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e845a-2f19-46cd-bca6-291e0e469622 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:09:01.113674 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e845a-2f19-46cd-bca6-291e0e469622 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:09:01.118763 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bead565-9506-40dd-a3fc-cba847fb5597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:09:01.119495 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bead565-9506-40dd-a3fc-cba847fb5597 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:09:01.119845 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bead565-9506-40dd-a3fc-cba847fb5597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:09:01.120126 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bead565-9506-40dd-a3fc-cba847fb5597 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:09:01.120905 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bead565-9506-40dd-a3fc-cba847fb5597 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:09:01.121188 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bead565-9506-40dd-a3fc-cba847fb5597 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:09:01.122846 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bead565-9506-40dd-a3fc-cba847fb5597 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:09:01.139543 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1224/2424] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:09:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:09:01.152148 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3e6cb-24cd-47b5-8075-ba4ec0a17766 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:09:01.162941 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3e6cb-24cd-47b5-8075-ba4ec0a17766 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:09:01.168802 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08a722-78fa-441f-bf5f-fdb1414b4e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:09:01.169469 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08a722-78fa-441f-bf5f-fdb1414b4e0e admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:09:01.169755 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08a722-78fa-441f-bf5f-fdb1414b4e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:09:01.170031 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08a722-78fa-441f-bf5f-fdb1414b4e0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:09:01.170736 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de08a722-78fa-441f-bf5f-fdb1414b4e0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:09:01.172735 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de08a722-78fa-441f-bf5f-fdb1414b4e0e admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:09:01.303230 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1201/2425] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:09:01 2022] POST /identity/v3/projects => generated 397 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:09:01.309370 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bead565-9506-40dd-a3fc-cba847fb5597 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:09:01.319908 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bead565-9506-40dd-a3fc-cba847fb5597 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:09:01.368248 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:09:01.382807 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5758380-ce55-4166-9b63-7a9ed13d6207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:09:01.383557 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5758380-ce55-4166-9b63-7a9ed13d6207 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:09:01.383793 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5758380-ce55-4166-9b63-7a9ed13d6207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:09:01.384055 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5758380-ce55-4166-9b63-7a9ed13d6207 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:09:01.384748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5758380-ce55-4166-9b63-7a9ed13d6207 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:09:01.387344 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5758380-ce55-4166-9b63-7a9ed13d6207 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:09:01.501726 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1225/2426] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:09:01 2022] POST /identity/v3/users => generated 299 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:09:01.506966 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08a722-78fa-441f-bf5f-fdb1414b4e0e admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:09:01.519631 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08a722-78fa-441f-bf5f-fdb1414b4e0e admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:09:01.524887 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420880e-278d-46b5-aada-87eafe68999d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:09:01.525571 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420880e-278d-46b5-aada-87eafe68999d admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:09:01.525852 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420880e-278d-46b5-aada-87eafe68999d admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:09:01.526122 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420880e-278d-46b5-aada-87eafe68999d admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:09:01.526852 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5420880e-278d-46b5-aada-87eafe68999d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:09:01.528525 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5420880e-278d-46b5-aada-87eafe68999d admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:09:01.540205 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1202/2427] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:09:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:09:01.546301 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5758380-ce55-4166-9b63-7a9ed13d6207 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:09:01.561306 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5758380-ce55-4166-9b63-7a9ed13d6207 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:09:01.566626 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912584c8-502f-4dad-bb37-c4efb9369095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:09:01.567306 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912584c8-502f-4dad-bb37-c4efb9369095 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:09:01.567623 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912584c8-502f-4dad-bb37-c4efb9369095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:09:01.567896 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912584c8-502f-4dad-bb37-c4efb9369095 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:09:01.568630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912584c8-502f-4dad-bb37-c4efb9369095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:09:01.570290 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912584c8-502f-4dad-bb37-c4efb9369095 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:09:01.582808 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1226/2428] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:09:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:09:01.587420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420880e-278d-46b5-aada-87eafe68999d admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:09:01.598433 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420880e-278d-46b5-aada-87eafe68999d admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:09:01.603540 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b1a087-218c-4cde-9383-b93a296f47ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:09:01.604516 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1a087-218c-4cde-9383-b93a296f47ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:09:01.604795 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1a087-218c-4cde-9383-b93a296f47ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:09:01.605063 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1a087-218c-4cde-9383-b93a296f47ac admin admin] PATH_INFO: `/v3/projects/b7cbf037bb044dbdbf158bf281d0be11/users/587d0f332d5c457582188396ddf5a1a8/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:09:01.622726 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b1a087-218c-4cde-9383-b93a296f47ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7cbf037bb044dbdbf158bf281d0be11, user_id=587d0f332d5c457582188396ddf5a1a8, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:09:01.625504 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b1a087-218c-4cde-9383-b93a296f47ac admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:09:01.787123 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1203/2429] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:09:01 2022] PUT /identity/v3/projects/b7cbf037bb044dbdbf158bf281d0be11/users/587d0f332d5c457582188396ddf5a1a8/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:09:01.798294 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4680a-fbbc-478d-a003-15109eb3fadb None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:09:01.798638 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4680a-fbbc-478d-a003-15109eb3fadb None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:09:01.798960 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4680a-fbbc-478d-a003-15109eb3fadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:09:01.829337 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-3db4680a-fbbc-478d-a003-15109eb3fadb None None] MFA Rules not processed for user `587d0f332d5c457582188396ddf5a1a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:09:01.830471 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-3db4680a-fbbc-478d-a003-15109eb3fadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:09:01.914428 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1227/2430] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:09:01 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:09:01.928110 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b1a087-218c-4cde-9383-b93a296f47ac admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:09:01.929937 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-95b1a087-218c-4cde-9383-b93a296f47ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:09:02.007897 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b1a087-218c-4cde-9383-b93a296f47ac admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:09:02.012542 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d4b47-107c-4199-b156-260467506f02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:09:02.013212 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d4b47-107c-4199-b156-260467506f02 service cinder] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:09:02.013673 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d4b47-107c-4199-b156-260467506f02 service cinder] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:09:02.013962 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d4b47-107c-4199-b156-260467506f02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:09:02.023637 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d4b47-107c-4199-b156-260467506f02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:09:02.025232 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d4b47-107c-4199-b156-260467506f02 service cinder] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:09:02.036140 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1204/2431] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:09:01 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:09:08.373300 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db4680a-fbbc-478d-a003-15109eb3fadb None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:09:08.452886 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db4680a-fbbc-478d-a003-15109eb3fadb None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:09:08.455927 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3109b3-4265-4e50-a16d-ea494e8e3e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:09:08.456862 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3109b3-4265-4e50-a16d-ea494e8e3e51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:09:08.457147 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3109b3-4265-4e50-a16d-ea494e8e3e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:09:08.457419 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3109b3-4265-4e50-a16d-ea494e8e3e51 admin admin] PATH_INFO: `/v3/users/587d0f332d5c457582188396ddf5a1a8` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:09:08.458712 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3109b3-4265-4e50-a16d-ea494e8e3e51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=587d0f332d5c457582188396ddf5a1a8)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:09:08.460717 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3109b3-4265-4e50-a16d-ea494e8e3e51 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:09:08.689735 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e3b4b-6509-41b7-9de8-68388a4de9e2 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:09:08.690419 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e3b4b-6509-41b7-9de8-68388a4de9e2 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:09:08.690419 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e3b4b-6509-41b7-9de8-68388a4de9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:09:08.710730 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-de9e3b4b-6509-41b7-9de8-68388a4de9e2 None None] MFA Rules not processed for user `dd41221abea04808bed5ef4ac4528c62`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:09:08.712034 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-de9e3b4b-6509-41b7-9de8-68388a4de9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:09:08.765241 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5b3109b3-4265-4e50-a16d-ea494e8e3e51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '587d0f332d5c457582188396ddf5a1a8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:09:08.766253 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5b3109b3-4265-4e50-a16d-ea494e8e3e51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '587d0f332d5c457582188396ddf5a1a8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:09:08.775699 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:09:08.783663 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5b3109b3-4265-4e50-a16d-ea494e8e3e51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '587d0f332d5c457582188396ddf5a1a8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:09:08.790344 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1205/2432] 10.222.0.46 () {58 vars in 967 bytes} [Fri Jul 1 04:09:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:09:08.796258 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5b3109b3-4265-4e50-a16d-ea494e8e3e51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '587d0f332d5c457582188396ddf5a1a8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:09:08.797428 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5b3109b3-4265-4e50-a16d-ea494e8e3e51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '587d0f332d5c457582188396ddf5a1a8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:09:08.810070 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e3b4b-6509-41b7-9de8-68388a4de9e2 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:09:08.811891 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-de9e3b4b-6509-41b7-9de8-68388a4de9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:09:08.877368 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:09:08.906176 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e3b4b-6509-41b7-9de8-68388a4de9e2 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:09:08.912818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1228/2433] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:09:08 2022] DELETE /identity/v3/users/587d0f332d5c457582188396ddf5a1a8 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:09:08.913698 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69042316-05ab-4172-9766-5ea327fa5a80 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83787880173b459c8975b834bd47a51a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:09:08.914605 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69042316-05ab-4172-9766-5ea327fa5a80 service swift] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:09:08.915099 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69042316-05ab-4172-9766-5ea327fa5a80 service swift] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:09:08.915626 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69042316-05ab-4172-9766-5ea327fa5a80 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:09:08.923613 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffbc50-f4b1-4656-94b4-74a43af3c16f None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:09:08.923848 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffbc50-f4b1-4656-94b4-74a43af3c16f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:09:08.924198 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffbc50-f4b1-4656-94b4-74a43af3c16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:09:08.929041 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69042316-05ab-4172-9766-5ea327fa5a80 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:09:08.930795 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69042316-05ab-4172-9766-5ea327fa5a80 service swift] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:09:08.940805 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1206/2434] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Jul 1 04:09:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 01 04:09:08.953956 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-56ffbc50-f4b1-4656-94b4-74a43af3c16f None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:09:08.955754 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-56ffbc50-f4b1-4656-94b4-74a43af3c16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:09:09.023071 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1229/2435] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:09:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 04:09:09.034388 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69042316-05ab-4172-9766-5ea327fa5a80 service swift] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:09:09.036292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-69042316-05ab-4172-9766-5ea327fa5a80 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:09:09.101688 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69042316-05ab-4172-9766-5ea327fa5a80 service swift] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:09:09.160396 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595daca-e17c-49da-8927-517e94ece37f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:09:09.161077 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595daca-e17c-49da-8927-517e94ece37f service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:09:09.161358 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595daca-e17c-49da-8927-517e94ece37f service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:09:09.161653 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595daca-e17c-49da-8927-517e94ece37f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:09:09.171773 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595daca-e17c-49da-8927-517e94ece37f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:09:09.173200 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595daca-e17c-49da-8927-517e94ece37f service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:09:09.183019 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1207/2436] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:09:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:09:09.714009 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ffbc50-f4b1-4656-94b4-74a43af3c16f None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:09:09.716621 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-56ffbc50-f4b1-4656-94b4-74a43af3c16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:09:09.732889 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ffbc50-f4b1-4656-94b4-74a43af3c16f None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:09:09.743183 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e01e9-7889-4484-9e57-4323009e5397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:09:09.745790 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e01e9-7889-4484-9e57-4323009e5397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:09:09.746361 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e01e9-7889-4484-9e57-4323009e5397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:09:09.746702 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e01e9-7889-4484-9e57-4323009e5397 admin admin] PATH_INFO: `/v3/projects/b7cbf037bb044dbdbf158bf281d0be11` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:09:09.755897 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32e01e9-7889-4484-9e57-4323009e5397 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7cbf037bb044dbdbf158bf281d0be11)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:09:09.760172 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32e01e9-7889-4484-9e57-4323009e5397 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:09:09.912080 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e32e01e9-7889-4484-9e57-4323009e5397 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7cbf037bb044dbdbf158bf281d0be11', 'request_id': 'req-e32e01e9-7889-4484-9e57-4323009e5397'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:09:10.036159 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e32e01e9-7889-4484-9e57-4323009e5397 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7cbf037bb044dbdbf158bf281d0be11', 'request_id': 'req-e32e01e9-7889-4484-9e57-4323009e5397'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:09:10.047652 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e32e01e9-7889-4484-9e57-4323009e5397 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7cbf037bb044dbdbf158bf281d0be11', 'request_id': 'req-e32e01e9-7889-4484-9e57-4323009e5397'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:09:10.068404 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e32e01e9-7889-4484-9e57-4323009e5397 admin admin] The token cache is being invalidate because project b7cbf037bb044dbdbf158bf281d0be11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:09:10.069180 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e32e01e9-7889-4484-9e57-4323009e5397 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:09:10.069986 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e32e01e9-7889-4484-9e57-4323009e5397 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:09:10.071930 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1230/2437] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:09:09 2022] DELETE /identity/v3/projects/b7cbf037bb044dbdbf158bf281d0be11 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:09:19.178690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=59 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:09:20.063743 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=63,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:09:31.899150 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407274e-c712-4a95-b3b7-20e86c332fc5 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:09:31.899800 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407274e-c712-4a95-b3b7-20e86c332fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:09:31.899800 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407274e-c712-4a95-b3b7-20e86c332fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:09:31.918083 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-1407274e-c712-4a95-b3b7-20e86c332fc5 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:09:31.919299 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-1407274e-c712-4a95-b3b7-20e86c332fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:09:31.980742 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1208/2438] 10.222.0.13 () {58 vars in 1016 bytes} [Fri Jul 1 04:09:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:09:31.995415 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e01e9-7889-4484-9e57-4323009e5397 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:09:31.996966 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e32e01e9-7889-4484-9e57-4323009e5397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:09:32.078010 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e01e9-7889-4484-9e57-4323009e5397 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:09:32.083786 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392a806-d0b3-4224-b402-dd1e11b7773e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:09:32.084442 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392a806-d0b3-4224-b402-dd1e11b7773e service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:09:32.084726 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392a806-d0b3-4224-b402-dd1e11b7773e service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:09:32.085008 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392a806-d0b3-4224-b402-dd1e11b7773e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:09:32.093559 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8392a806-d0b3-4224-b402-dd1e11b7773e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:09:32.095195 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8392a806-d0b3-4224-b402-dd1e11b7773e service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:09:32.105840 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1231/2439] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:09:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:09:40.373886 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313c4c9-962c-4d5c-b919-4df3fc856ec3 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:09:40.375626 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313c4c9-962c-4d5c-b919-4df3fc856ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:09:40.375937 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313c4c9-962c-4d5c-b919-4df3fc856ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:09:40.398541 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-3313c4c9-962c-4d5c-b919-4df3fc856ec3 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:09:40.400780 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-3313c4c9-962c-4d5c-b919-4df3fc856ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:09:40.414862 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1209/2440] 10.222.0.13 () {58 vars in 1016 bytes} [Fri Jul 1 04:09:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:09:40.429783 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392a806-d0b3-4224-b402-dd1e11b7773e service nova] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:09:40.444142 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392a806-d0b3-4224-b402-dd1e11b7773e service nova] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:09:40.451130 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dab65f-bf73-49a5-b303-1bafad6ff0c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:09:40.451909 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dab65f-bf73-49a5-b303-1bafad6ff0c8 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:09:40.452197 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dab65f-bf73-49a5-b303-1bafad6ff0c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:09:40.452606 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dab65f-bf73-49a5-b303-1bafad6ff0c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:09:40.463139 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dab65f-bf73-49a5-b303-1bafad6ff0c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:09:40.464918 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dab65f-bf73-49a5-b303-1bafad6ff0c8 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:09:40.475972 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1232/2441] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:09:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:09:43.861741 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ab042-a2e7-4802-99d6-a0e0fcf1c23b None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:09:43.862266 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ab042-a2e7-4802-99d6-a0e0fcf1c23b None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:09:43.862387 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ab042-a2e7-4802-99d6-a0e0fcf1c23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:09:43.882070 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-8b8ab042-a2e7-4802-99d6-a0e0fcf1c23b None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:09:43.883306 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-8b8ab042-a2e7-4802-99d6-a0e0fcf1c23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:09:43.891915 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1210/2442] 10.222.0.13 () {58 vars in 1016 bytes} [Fri Jul 1 04:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 04:09:43.909358 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dab65f-bf73-49a5-b303-1bafad6ff0c8 service nova] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:09:43.911050 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-93dab65f-bf73-49a5-b303-1bafad6ff0c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:09:43.925478 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dab65f-bf73-49a5-b303-1bafad6ff0c8 service nova] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:09:43.931301 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3641e9-cea5-4ef5-8369-677dc247e402 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:09:43.931988 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3641e9-cea5-4ef5-8369-677dc247e402 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:09:43.932271 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3641e9-cea5-4ef5-8369-677dc247e402 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:09:43.932550 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3641e9-cea5-4ef5-8369-677dc247e402 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:09:43.941068 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34268304-10ef-475d-a2f4-cb6ba3556112 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:09:43.941358 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34268304-10ef-475d-a2f4-cb6ba3556112 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:09:43.943051 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34268304-10ef-475d-a2f4-cb6ba3556112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:09:43.943207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3641e9-cea5-4ef5-8369-677dc247e402 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:09:43.943640 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3641e9-cea5-4ef5-8369-677dc247e402 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:09:43.955219 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1233/2443] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:09:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:09:43.960429 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-34268304-10ef-475d-a2f4-cb6ba3556112 None None] MFA Rules not processed for user `71b72d9b9e3a4eb2ba1aae5d8a924afd`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:09:43.961601 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-34268304-10ef-475d-a2f4-cb6ba3556112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:09:44.018095 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1211/2444] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:09:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:09:45.867948 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3641e9-cea5-4ef5-8369-677dc247e402 service nova] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:09:45.869342 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8f3641e9-cea5-4ef5-8369-677dc247e402 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:09:45.925562 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3641e9-cea5-4ef5-8369-677dc247e402 service nova] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:09:45.929158 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8314288-067f-4394-a511-0dc15596b51a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:09:45.929812 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8314288-067f-4394-a511-0dc15596b51a service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:09:45.930091 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8314288-067f-4394-a511-0dc15596b51a service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:09:45.930363 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8314288-067f-4394-a511-0dc15596b51a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:09:45.932149 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f8314288-067f-4394-a511-0dc15596b51a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:09:45.946586 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8314288-067f-4394-a511-0dc15596b51a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:09:45.948059 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8314288-067f-4394-a511-0dc15596b51a service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:09:45.959957 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1234/2445] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:09:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:09:48.822771 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99324a9-2b47-4a3a-b84e-c92680f35822 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:09:48.823287 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99324a9-2b47-4a3a-b84e-c92680f35822 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:09:48.823410 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99324a9-2b47-4a3a-b84e-c92680f35822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:09:48.842782 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-d99324a9-2b47-4a3a-b84e-c92680f35822 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:09:48.844738 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-d99324a9-2b47-4a3a-b84e-c92680f35822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:09:48.854200 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1212/2446] 10.222.0.13 () {58 vars in 1016 bytes} [Fri Jul 1 04:09:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:09:48.870205 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8314288-067f-4394-a511-0dc15596b51a service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:09:48.881353 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8314288-067f-4394-a511-0dc15596b51a service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:09:48.887267 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3217071-bbe0-4e62-be9c-0ee2f4b3679c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:09:48.888165 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3217071-bbe0-4e62-be9c-0ee2f4b3679c service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:09:48.888619 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3217071-bbe0-4e62-be9c-0ee2f4b3679c service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:09:48.889054 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3217071-bbe0-4e62-be9c-0ee2f4b3679c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:09:48.900301 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3217071-bbe0-4e62-be9c-0ee2f4b3679c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:09:48.901912 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3217071-bbe0-4e62-be9c-0ee2f4b3679c service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:09:48.914640 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1235/2447] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:09:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:09:49.210232 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99324a9-2b47-4a3a-b84e-c92680f35822 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:09:49.220348 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99324a9-2b47-4a3a-b84e-c92680f35822 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:09:49.223906 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ed637-a675-4ea6-ae55-114d1ce015fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:09:49.224554 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ed637-a675-4ea6-ae55-114d1ce015fe service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:09:49.224837 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ed637-a675-4ea6-ae55-114d1ce015fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:09:49.225242 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ed637-a675-4ea6-ae55-114d1ce015fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:09:49.226944 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-105ed637-a675-4ea6-ae55-114d1ce015fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:09:49.240858 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ed637-a675-4ea6-ae55-114d1ce015fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:09:49.242294 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ed637-a675-4ea6-ae55-114d1ce015fe service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:09:49.254476 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1213/2448] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:09:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:09:53.115605 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f6015-7a7e-43f8-99db-e84a31bd7f72 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:09:53.116110 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f6015-7a7e-43f8-99db-e84a31bd7f72 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:09:53.116207 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f6015-7a7e-43f8-99db-e84a31bd7f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:09:53.135067 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-193f6015-7a7e-43f8-99db-e84a31bd7f72 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:09:53.136292 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-193f6015-7a7e-43f8-99db-e84a31bd7f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:09:53.144705 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1236/2449] 10.222.0.13 () {58 vars in 1016 bytes} [Fri Jul 1 04:09:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:09:53.160647 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ed637-a675-4ea6-ae55-114d1ce015fe service neutron] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:09:53.172172 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ed637-a675-4ea6-ae55-114d1ce015fe service neutron] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:09:53.177665 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0e100-ea08-4669-a7b6-c1a60a070b7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:09:53.178330 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0e100-ea08-4669-a7b6-c1a60a070b7c service nova] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:09:53.178618 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0e100-ea08-4669-a7b6-c1a60a070b7c service nova] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:09:53.178899 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0e100-ea08-4669-a7b6-c1a60a070b7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:09:53.187015 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f0e100-ea08-4669-a7b6-c1a60a070b7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:09:53.188666 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f0e100-ea08-4669-a7b6-c1a60a070b7c service nova] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:09:53.198009 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1214/2450] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:09:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:09:57.387732 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f05ad-22d4-4302-83e4-c7319357b01c None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:09:57.388279 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f05ad-22d4-4302-83e4-c7319357b01c None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:09:57.388386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f05ad-22d4-4302-83e4-c7319357b01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:09:57.408143 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-b39f05ad-22d4-4302-83e4-c7319357b01c None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:09:57.409370 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b39f05ad-22d4-4302-83e4-c7319357b01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:09:57.418285 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1237/2451] 10.222.0.13 () {58 vars in 1016 bytes} [Fri Jul 1 04:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:09:57.433282 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0e100-ea08-4669-a7b6-c1a60a070b7c service nova] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:09:57.444831 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0e100-ea08-4669-a7b6-c1a60a070b7c service nova] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:09:57.450549 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b6763-9d30-4c00-bcec-ce3db5f8a3d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:09:57.451181 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b6763-9d30-4c00-bcec-ce3db5f8a3d2 service nova] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:09:57.451489 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b6763-9d30-4c00-bcec-ce3db5f8a3d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:09:57.451775 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b6763-9d30-4c00-bcec-ce3db5f8a3d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:09:57.460509 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b6763-9d30-4c00-bcec-ce3db5f8a3d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:09:57.462124 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b6763-9d30-4c00-bcec-ce3db5f8a3d2 service nova] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:09:57.472769 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1215/2452] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:09:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:09:57.989813 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39f05ad-22d4-4302-83e4-c7319357b01c None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:09:58.001720 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39f05ad-22d4-4302-83e4-c7319357b01c None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:09:58.008421 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1374baf-0d72-4f07-885e-860de21bfb9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:09:58.009084 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1374baf-0d72-4f07-885e-860de21bfb9b service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:09:58.009374 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1374baf-0d72-4f07-885e-860de21bfb9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:09:58.009652 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1374baf-0d72-4f07-885e-860de21bfb9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:09:58.011522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e1374baf-0d72-4f07-885e-860de21bfb9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:09:58.026108 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1374baf-0d72-4f07-885e-860de21bfb9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:09:58.027588 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1374baf-0d72-4f07-885e-860de21bfb9b service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:09:58.038505 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1238/2453] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:09:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:10:02.749121 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b6763-9d30-4c00-bcec-ce3db5f8a3d2 service nova] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:10:02.755078 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-ed5b6763-9d30-4c00-bcec-ce3db5f8a3d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:10:02.761132 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=80 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:10:02.912117 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b6763-9d30-4c00-bcec-ce3db5f8a3d2 service nova] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:10:02.918711 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b99cc4-b6e4-4514-a1f6-e3451aae43b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efe4a6dd11047688892641a936e2914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:10:02.919377 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b99cc4-b6e4-4514-a1f6-e3451aae43b0 service placement] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:10:02.919708 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b99cc4-b6e4-4514-a1f6-e3451aae43b0 service placement] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:10:02.919987 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b99cc4-b6e4-4514-a1f6-e3451aae43b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:10:02.921872 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-32b99cc4-b6e4-4514-a1f6-e3451aae43b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:10:02.935786 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b99cc4-b6e4-4514-a1f6-e3451aae43b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:10:02.938044 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b99cc4-b6e4-4514-a1f6-e3451aae43b0 service placement] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:10:02.955997 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1374baf-0d72-4f07-885e-860de21bfb9b service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:10:02.958342 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e1374baf-0d72-4f07-885e-860de21bfb9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:10:02.971922 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1216/2454] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:10:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:10:02.973683 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=91 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:10:03.010558 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1374baf-0d72-4f07-885e-860de21bfb9b service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:10:03.028996 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ac66d-b53b-425d-b76a-d05ecacb8861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:10:03.032208 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ac66d-b53b-425d-b76a-d05ecacb8861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:10:03.033216 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ac66d-b53b-425d-b76a-d05ecacb8861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:10:03.033762 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ac66d-b53b-425d-b76a-d05ecacb8861 admin admin] PATH_INFO: `/v3/users/a61e50919a13413c9f641f23f6b30217` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:10:03.037916 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ac66d-b53b-425d-b76a-d05ecacb8861 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a61e50919a13413c9f641f23f6b30217)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:10:03.043770 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ac66d-b53b-425d-b76a-d05ecacb8861 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:10:03.285714 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-308ac66d-b53b-425d-b76a-d05ecacb8861 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a61e50919a13413c9f641f23f6b30217'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:10:03.286646 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-308ac66d-b53b-425d-b76a-d05ecacb8861 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a61e50919a13413c9f641f23f6b30217'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:10:03.299403 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-308ac66d-b53b-425d-b76a-d05ecacb8861 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a61e50919a13413c9f641f23f6b30217'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:10:03.306257 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-308ac66d-b53b-425d-b76a-d05ecacb8861 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a61e50919a13413c9f641f23f6b30217'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:10:03.309795 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-308ac66d-b53b-425d-b76a-d05ecacb8861 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a61e50919a13413c9f641f23f6b30217'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:10:03.386237 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1239/2455] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:10:02 2022] DELETE /identity/v3/users/a61e50919a13413c9f641f23f6b30217 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:10:03.619192 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b99cc4-b6e4-4514-a1f6-e3451aae43b0 service placement] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:10:03.634933 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b99cc4-b6e4-4514-a1f6-e3451aae43b0 service placement] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:10:03.705065 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72693f8-6f59-4333-8b96-a6a8b53b0be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:10:03.705943 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72693f8-6f59-4333-8b96-a6a8b53b0be9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:10:03.706249 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72693f8-6f59-4333-8b96-a6a8b53b0be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:10:03.706558 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72693f8-6f59-4333-8b96-a6a8b53b0be9 admin admin] PATH_INFO: `/v3/projects/5b7b3ff91f9d446aae53f7966b7586cd` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:10:03.707773 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72693f8-6f59-4333-8b96-a6a8b53b0be9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b7b3ff91f9d446aae53f7966b7586cd)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:10:03.709699 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72693f8-6f59-4333-8b96-a6a8b53b0be9 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:10:03.825304 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-a72693f8-6f59-4333-8b96-a6a8b53b0be9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b7b3ff91f9d446aae53f7966b7586cd', 'request_id': 'req-a72693f8-6f59-4333-8b96-a6a8b53b0be9'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:10:03.833279 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-a72693f8-6f59-4333-8b96-a6a8b53b0be9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b7b3ff91f9d446aae53f7966b7586cd', 'request_id': 'req-a72693f8-6f59-4333-8b96-a6a8b53b0be9'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:10:03.839009 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-a72693f8-6f59-4333-8b96-a6a8b53b0be9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b7b3ff91f9d446aae53f7966b7586cd', 'request_id': 'req-a72693f8-6f59-4333-8b96-a6a8b53b0be9'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:10:03.922536 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-a72693f8-6f59-4333-8b96-a6a8b53b0be9 admin admin] The token cache is being invalidate because project 5b7b3ff91f9d446aae53f7966b7586cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:10:03.922859 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-a72693f8-6f59-4333-8b96-a6a8b53b0be9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:10:03.923526 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-a72693f8-6f59-4333-8b96-a6a8b53b0be9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:10:03.925424 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1217/2456] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:10:03 2022] DELETE /identity/v3/projects/5b7b3ff91f9d446aae53f7966b7586cd => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:10:03.932229 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586083ba-33a8-497e-9dab-2bf9b2d477cc None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:10:03.932521 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586083ba-33a8-497e-9dab-2bf9b2d477cc None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:10:03.932803 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586083ba-33a8-497e-9dab-2bf9b2d477cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:10:03.950790 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-586083ba-33a8-497e-9dab-2bf9b2d477cc None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:10:03.952037 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-586083ba-33a8-497e-9dab-2bf9b2d477cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:10:04.014374 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1240/2457] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:10:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 04:10:04.022360 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc86f8c-7fde-4f00-979b-90ee554a9045 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:10:04.028024 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc86f8c-7fde-4f00-979b-90ee554a9045 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:10:04.028024 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc86f8c-7fde-4f00-979b-90ee554a9045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:10:04.042984 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-dfc86f8c-7fde-4f00-979b-90ee554a9045 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:10:04.044228 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-dfc86f8c-7fde-4f00-979b-90ee554a9045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:10:04.052431 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1218/2458] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:10:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:10:04.056610 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586083ba-33a8-497e-9dab-2bf9b2d477cc None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:10:04.067046 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586083ba-33a8-497e-9dab-2bf9b2d477cc None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:10:04.072289 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970bb7d-dc78-49f5-81a8-00bc75c3bbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:10:04.072938 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970bb7d-dc78-49f5-81a8-00bc75c3bbec admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:10:04.073221 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970bb7d-dc78-49f5-81a8-00bc75c3bbec admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:10:04.073496 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970bb7d-dc78-49f5-81a8-00bc75c3bbec admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:10:04.074246 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0970bb7d-dc78-49f5-81a8-00bc75c3bbec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:10:04.074647 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0970bb7d-dc78-49f5-81a8-00bc75c3bbec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:10:04.076256 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0970bb7d-dc78-49f5-81a8-00bc75c3bbec admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:10:04.089147 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1241/2459] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:10:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:10:04.093513 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc86f8c-7fde-4f00-979b-90ee554a9045 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:10:04.103554 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc86f8c-7fde-4f00-979b-90ee554a9045 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:10:04.108687 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1fd03f-7ca3-4a4b-9615-bdfc2b376d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:10:04.109381 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fd03f-7ca3-4a4b-9615-bdfc2b376d3d admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:10:04.109693 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fd03f-7ca3-4a4b-9615-bdfc2b376d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:10:04.109976 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fd03f-7ca3-4a4b-9615-bdfc2b376d3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:10:04.110754 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1fd03f-7ca3-4a4b-9615-bdfc2b376d3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:10:04.112927 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1fd03f-7ca3-4a4b-9615-bdfc2b376d3d admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:10:04.127684 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:10:04.183748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970bb7d-dc78-49f5-81a8-00bc75c3bbec admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:10:04.185482 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0970bb7d-dc78-49f5-81a8-00bc75c3bbec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:10:04.211043 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1219/2460] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:10:04 2022] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:10:04.214833 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1fd03f-7ca3-4a4b-9615-bdfc2b376d3d admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:10:04.279552 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:10:04.299323 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970bb7d-dc78-49f5-81a8-00bc75c3bbec admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:10:04.318080 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1fd03f-7ca3-4a4b-9615-bdfc2b376d3d admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:10:04.323346 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3a672-f292-45d1-a5a1-31b17babff61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:10:04.324056 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3a672-f292-45d1-a5a1-31b17babff61 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:10:04.324591 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3a672-f292-45d1-a5a1-31b17babff61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:10:04.324867 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3a672-f292-45d1-a5a1-31b17babff61 admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:10:04.325567 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e3a672-f292-45d1-a5a1-31b17babff61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:10:04.327624 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e3a672-f292-45d1-a5a1-31b17babff61 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:10:04.368133 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ee6f5-fa01-4f5c-9070-01a816103bc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:10:04.368789 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ee6f5-fa01-4f5c-9070-01a816103bc4 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:10:04.369077 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ee6f5-fa01-4f5c-9070-01a816103bc4 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:10:04.369360 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ee6f5-fa01-4f5c-9070-01a816103bc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:10:04.371220 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-167ee6f5-fa01-4f5c-9070-01a816103bc4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:10:04.420852 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1220/2461] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:10:04 2022] POST /identity/v3/users => generated 289 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 04:10:04.428376 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3a672-f292-45d1-a5a1-31b17babff61 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:10:04.432100 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ee6f5-fa01-4f5c-9070-01a816103bc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:10:04.433716 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ee6f5-fa01-4f5c-9070-01a816103bc4 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:10:04.439052 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3a672-f292-45d1-a5a1-31b17babff61 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:10:04.443608 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1242/2462] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:10:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:10:04.445072 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe1a7f-848a-4186-acdd-b7afbaf9001c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:10:04.445870 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe1a7f-848a-4186-acdd-b7afbaf9001c admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:10:04.446158 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe1a7f-848a-4186-acdd-b7afbaf9001c admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:10:04.446437 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe1a7f-848a-4186-acdd-b7afbaf9001c admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:10:04.447166 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe1a7f-848a-4186-acdd-b7afbaf9001c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:10:04.448821 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe1a7f-848a-4186-acdd-b7afbaf9001c admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:10:04.463761 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1221/2463] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 04:10:04.466416 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ee6f5-fa01-4f5c-9070-01a816103bc4 service nova] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:10:04.476707 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ee6f5-fa01-4f5c-9070-01a816103bc4 service nova] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:10:04.481330 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9e1d8-4f58-4362-bd29-6d6bc79c4379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:10:04.481994 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9e1d8-4f58-4362-bd29-6d6bc79c4379 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:10:04.482280 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9e1d8-4f58-4362-bd29-6d6bc79c4379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:10:04.482551 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9e1d8-4f58-4362-bd29-6d6bc79c4379 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:10:04.483271 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d9e1d8-4f58-4362-bd29-6d6bc79c4379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:10:04.486884 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d9e1d8-4f58-4362-bd29-6d6bc79c4379 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:10:04.496823 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1243/2464] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:10:04.501735 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe1a7f-848a-4186-acdd-b7afbaf9001c admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:10:04.512583 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe1a7f-848a-4186-acdd-b7afbaf9001c admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:10:04.517396 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09d28f-feaf-420a-ad65-bc01d61b5c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:10:04.518364 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09d28f-feaf-420a-ad65-bc01d61b5c7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:10:04.518637 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09d28f-feaf-420a-ad65-bc01d61b5c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:10:04.518911 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09d28f-feaf-420a-ad65-bc01d61b5c7a admin admin] PATH_INFO: `/v3/projects/b055ff77f93c4facbc0ef5d35a6aeb76/users/474e8177791448b89962ade62816cb5c/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:10:04.535212 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a09d28f-feaf-420a-ad65-bc01d61b5c7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b055ff77f93c4facbc0ef5d35a6aeb76, user_id=474e8177791448b89962ade62816cb5c, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:10:04.538238 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a09d28f-feaf-420a-ad65-bc01d61b5c7a admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:10:04.609118 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1222/2465] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:10:04 2022] PUT /identity/v3/projects/b055ff77f93c4facbc0ef5d35a6aeb76/users/474e8177791448b89962ade62816cb5c/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:10:04.618629 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5048a5-32f7-4bb4-aac8-448f446ff773 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:10:04.618978 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5048a5-32f7-4bb4-aac8-448f446ff773 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:10:04.619237 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5048a5-32f7-4bb4-aac8-448f446ff773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:10:04.637547 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-9f5048a5-32f7-4bb4-aac8-448f446ff773 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:10:04.638829 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9f5048a5-32f7-4bb4-aac8-448f446ff773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:10:04.701183 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1244/2466] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:10:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:10:04.712070 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09d28f-feaf-420a-ad65-bc01d61b5c7a admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:10:04.713943 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-3a09d28f-feaf-420a-ad65-bc01d61b5c7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:10:04.779712 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09d28f-feaf-420a-ad65-bc01d61b5c7a admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:10:04.785755 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ad2a8-f284-4d82-8d45-ae7d2a12feff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:10:04.787652 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ad2a8-f284-4d82-8d45-ae7d2a12feff service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:10:04.787936 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ad2a8-f284-4d82-8d45-ae7d2a12feff service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:10:04.788215 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ad2a8-f284-4d82-8d45-ae7d2a12feff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:10:04.799652 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ad2a8-f284-4d82-8d45-ae7d2a12feff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:10:04.801153 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ad2a8-f284-4d82-8d45-ae7d2a12feff service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:10:04.811376 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1223/2467] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:10:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:10:09.752690 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b86bcb-9721-4a5d-8fe8-28456f10981a None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:10:09.753272 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b86bcb-9721-4a5d-8fe8-28456f10981a None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:10:09.753272 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b86bcb-9721-4a5d-8fe8-28456f10981a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:10:09.783443 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-b6b86bcb-9721-4a5d-8fe8-28456f10981a None None] MFA Rules not processed for user `9afe0c6c75c44f7e98d2e5d19b45912c`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:10:09.784818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b6b86bcb-9721-4a5d-8fe8-28456f10981a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:10:09.840091 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:10:09.887794 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1245/2468] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:10:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:10:11.030136 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ad2a8-f284-4d82-8d45-ae7d2a12feff service neutron] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:10:11.033370 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-2b9ad2a8-f284-4d82-8d45-ae7d2a12feff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:10:11.171522 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:10:11.197490 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ad2a8-f284-4d82-8d45-ae7d2a12feff service neutron] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:10:11.205924 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380caf4-6135-46d6-ac8e-18e8a796ac6b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efe4a6dd11047688892641a936e2914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:10:11.208125 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380caf4-6135-46d6-ac8e-18e8a796ac6b service placement] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:10:11.208826 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380caf4-6135-46d6-ac8e-18e8a796ac6b service placement] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:10:11.209321 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380caf4-6135-46d6-ac8e-18e8a796ac6b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:10:11.212308 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-a380caf4-6135-46d6-ac8e-18e8a796ac6b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:10:11.234911 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a380caf4-6135-46d6-ac8e-18e8a796ac6b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:10:11.237492 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a380caf4-6135-46d6-ac8e-18e8a796ac6b service placement] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:10:11.254155 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1224/2469] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:10:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:10:13.086657 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9aebc8-9b46-4507-896a-65b56936c95f None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:10:13.087247 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9aebc8-9b46-4507-896a-65b56936c95f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:10:13.087247 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9aebc8-9b46-4507-896a-65b56936c95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:10:13.118407 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-ce9aebc8-9b46-4507-896a-65b56936c95f None None] MFA Rules not processed for user `474e8177791448b89962ade62816cb5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:10:13.119963 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ce9aebc8-9b46-4507-896a-65b56936c95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:10:13.223014 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1246/2470] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:10:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:10:13.237863 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380caf4-6135-46d6-ac8e-18e8a796ac6b service placement] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:10:13.345373 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380caf4-6135-46d6-ac8e-18e8a796ac6b service placement] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:10:13.355177 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc1470-c032-486b-b924-4393127cec1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:10:13.356116 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc1470-c032-486b-b924-4393127cec1a service nova] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:10:13.356458 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc1470-c032-486b-b924-4393127cec1a service nova] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:10:13.356845 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc1470-c032-486b-b924-4393127cec1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:10:13.367760 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcc1470-c032-486b-b924-4393127cec1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:10:13.369572 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcc1470-c032-486b-b924-4393127cec1a service nova] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:10:13.381178 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1225/2471] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:10:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:10:15.191555 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9aebc8-9b46-4507-896a-65b56936c95f None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:10:15.194014 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ce9aebc8-9b46-4507-896a-65b56936c95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:10:15.219844 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9aebc8-9b46-4507-896a-65b56936c95f None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:10:15.231002 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39424a4-f03c-4569-9e8f-3d82a44af858 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:10:15.234073 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39424a4-f03c-4569-9e8f-3d82a44af858 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:10:15.236096 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39424a4-f03c-4569-9e8f-3d82a44af858 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:10:15.236657 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39424a4-f03c-4569-9e8f-3d82a44af858 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:10:15.245945 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e39424a4-f03c-4569-9e8f-3d82a44af858 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:10:15.266917 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39424a4-f03c-4569-9e8f-3d82a44af858 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:10:15.268919 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39424a4-f03c-4569-9e8f-3d82a44af858 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:10:15.284315 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1247/2472] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:10:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:10:17.148803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9f190-3168-4db9-9e05-11422656084c None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:10:17.149247 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9f190-3168-4db9-9e05-11422656084c None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:10:17.149466 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9f190-3168-4db9-9e05-11422656084c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:10:17.174937 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-6ab9f190-3168-4db9-9e05-11422656084c None None] MFA Rules not processed for user `474e8177791448b89962ade62816cb5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:10:17.176352 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-6ab9f190-3168-4db9-9e05-11422656084c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:10:17.184614 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1226/2473] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:10:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:10:17.817187 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39424a4-f03c-4569-9e8f-3d82a44af858 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:10:17.827093 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39424a4-f03c-4569-9e8f-3d82a44af858 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:10:17.832024 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9ad62-5a42-4d42-ba40-7bfdc908eb28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:10:17.832836 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9ad62-5a42-4d42-ba40-7bfdc908eb28 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:10:17.833151 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9ad62-5a42-4d42-ba40-7bfdc908eb28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:10:17.833436 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9ad62-5a42-4d42-ba40-7bfdc908eb28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:10:17.836019 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a2c9ad62-5a42-4d42-ba40-7bfdc908eb28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:10:17.848879 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c9ad62-5a42-4d42-ba40-7bfdc908eb28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:10:17.850666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c9ad62-5a42-4d42-ba40-7bfdc908eb28 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:10:17.860694 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1248/2474] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:10:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:10:18.302981 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332409e6-a774-46c0-8eaa-1968820c11d2 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:10:18.311676 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332409e6-a774-46c0-8eaa-1968820c11d2 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:10:18.311676 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332409e6-a774-46c0-8eaa-1968820c11d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:10:18.353679 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-332409e6-a774-46c0-8eaa-1968820c11d2 None None] MFA Rules not processed for user `f3d2af465e624b86a0af448258ca4c97`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:10:18.355272 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-332409e6-a774-46c0-8eaa-1968820c11d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:10:18.433671 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1227/2475] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:10:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 04:10:23.821604 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9ad62-5a42-4d42-ba40-7bfdc908eb28 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:10:23.847028 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9ad62-5a42-4d42-ba40-7bfdc908eb28 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:10:23.852835 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a52e1-1066-4ed5-a0b7-6b2f6cc8bbc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:10:23.853775 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a52e1-1066-4ed5-a0b7-6b2f6cc8bbc1 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:10:23.854239 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a52e1-1066-4ed5-a0b7-6b2f6cc8bbc1 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:10:23.854558 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a52e1-1066-4ed5-a0b7-6b2f6cc8bbc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:10:23.856588 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-5e0a52e1-1066-4ed5-a0b7-6b2f6cc8bbc1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:10:23.874304 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a52e1-1066-4ed5-a0b7-6b2f6cc8bbc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:10:23.876078 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a52e1-1066-4ed5-a0b7-6b2f6cc8bbc1 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:10:23.888100 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1249/2476] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:10:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:10:28.425576 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=71 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:10:33.882865 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=63 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:10:34.492812 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332409e6-a774-46c0-8eaa-1968820c11d2 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:10:34.507938 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332409e6-a774-46c0-8eaa-1968820c11d2 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:10:34.517608 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43553ed6-a536-422b-b5bc-48306e485eb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:10:34.518375 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43553ed6-a536-422b-b5bc-48306e485eb5 service nova] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:10:34.518731 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43553ed6-a536-422b-b5bc-48306e485eb5 service nova] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:10:34.520033 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43553ed6-a536-422b-b5bc-48306e485eb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:10:34.521340 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-43553ed6-a536-422b-b5bc-48306e485eb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:10:34.535593 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43553ed6-a536-422b-b5bc-48306e485eb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:10:34.542181 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43553ed6-a536-422b-b5bc-48306e485eb5 service nova] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:10:34.550982 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1228/2477] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:10:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:10:36.173270 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a52e1-1066-4ed5-a0b7-6b2f6cc8bbc1 service nova] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:10:36.189366 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a52e1-1066-4ed5-a0b7-6b2f6cc8bbc1 service nova] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:10:36.198929 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77496cb5-f4f2-453f-b585-f2d73abda00c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:10:36.200211 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77496cb5-f4f2-453f-b585-f2d73abda00c service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:10:36.200574 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77496cb5-f4f2-453f-b585-f2d73abda00c service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:10:36.201198 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77496cb5-f4f2-453f-b585-f2d73abda00c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:10:36.203348 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-77496cb5-f4f2-453f-b585-f2d73abda00c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:10:36.235873 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77496cb5-f4f2-453f-b585-f2d73abda00c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:10:36.238435 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77496cb5-f4f2-453f-b585-f2d73abda00c service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:10:36.251814 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1250/2478] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:10:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:10:42.614593 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1036f-8ebc-4a2a-b6f7-73e909ff92f0 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:10:42.615277 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1036f-8ebc-4a2a-b6f7-73e909ff92f0 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:10:42.615277 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1036f-8ebc-4a2a-b6f7-73e909ff92f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:10:42.636631 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-d6a1036f-8ebc-4a2a-b6f7-73e909ff92f0 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:10:42.637930 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-d6a1036f-8ebc-4a2a-b6f7-73e909ff92f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:10:42.646629 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1229/2479] 10.222.0.13 () {58 vars in 1016 bytes} [Fri Jul 1 04:10:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:10:42.662752 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77496cb5-f4f2-453f-b585-f2d73abda00c service nova] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:10:42.675043 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77496cb5-f4f2-453f-b585-f2d73abda00c service nova] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:10:42.681181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd3d661-21a4-4b83-8bb7-80eac203f4d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:10:42.682398 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3d661-21a4-4b83-8bb7-80eac203f4d3 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:10:42.682398 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3d661-21a4-4b83-8bb7-80eac203f4d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:10:42.682764 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3d661-21a4-4b83-8bb7-80eac203f4d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:10:42.692884 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd3d661-21a4-4b83-8bb7-80eac203f4d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:10:42.694513 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd3d661-21a4-4b83-8bb7-80eac203f4d3 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:10:42.705815 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1251/2480] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:10:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:10:48.403743 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f735b-5019-45bc-896f-8fc3f3d18a49 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:10:48.404360 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f735b-5019-45bc-896f-8fc3f3d18a49 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:10:48.404360 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f735b-5019-45bc-896f-8fc3f3d18a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:10:48.433794 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-a65f735b-5019-45bc-896f-8fc3f3d18a49 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:10:48.433794 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-a65f735b-5019-45bc-896f-8fc3f3d18a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:10:48.438296 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1230/2481] 10.222.0.13 () {58 vars in 1016 bytes} [Fri Jul 1 04:10:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 04:10:48.454168 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd3d661-21a4-4b83-8bb7-80eac203f4d3 service nova] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:10:48.456695 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-7cd3d661-21a4-4b83-8bb7-80eac203f4d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:10:48.478862 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd3d661-21a4-4b83-8bb7-80eac203f4d3 service nova] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:10:48.487157 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563eaa03-e47a-49f5-93ff-e3831c59ee2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:10:48.488159 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563eaa03-e47a-49f5-93ff-e3831c59ee2b service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:10:48.488575 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563eaa03-e47a-49f5-93ff-e3831c59ee2b service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:10:48.488984 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563eaa03-e47a-49f5-93ff-e3831c59ee2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:10:48.499699 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563eaa03-e47a-49f5-93ff-e3831c59ee2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:10:48.502009 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563eaa03-e47a-49f5-93ff-e3831c59ee2b service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:10:48.512972 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1252/2482] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:10:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:10:52.248509 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78afcd6-7ae0-483e-a64f-1d44e57459ab None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:10:52.252582 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78afcd6-7ae0-483e-a64f-1d44e57459ab None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:10:52.252582 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78afcd6-7ae0-483e-a64f-1d44e57459ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:10:52.270193 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-c78afcd6-7ae0-483e-a64f-1d44e57459ab None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:10:52.271407 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-c78afcd6-7ae0-483e-a64f-1d44e57459ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:10:52.279630 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1231/2483] 10.222.0.13 () {58 vars in 1016 bytes} [Fri Jul 1 04:10:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:10:52.296952 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563eaa03-e47a-49f5-93ff-e3831c59ee2b service nova] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:10:52.309580 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563eaa03-e47a-49f5-93ff-e3831c59ee2b service nova] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:10:52.317403 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8633b5-74b7-4f64-8772-6fb3ff69db04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:10:52.318446 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8633b5-74b7-4f64-8772-6fb3ff69db04 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:10:52.318937 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8633b5-74b7-4f64-8772-6fb3ff69db04 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:10:52.319422 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8633b5-74b7-4f64-8772-6fb3ff69db04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:10:52.328863 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8633b5-74b7-4f64-8772-6fb3ff69db04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:10:52.330546 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8633b5-74b7-4f64-8772-6fb3ff69db04 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:10:52.341943 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1253/2484] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:10:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:10:57.569191 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03a8fa-c5d9-4c5e-98b0-1ec9046ffb0d None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:10:57.569851 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03a8fa-c5d9-4c5e-98b0-1ec9046ffb0d None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:10:57.569851 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03a8fa-c5d9-4c5e-98b0-1ec9046ffb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:10:57.588184 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-1a03a8fa-c5d9-4c5e-98b0-1ec9046ffb0d None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:10:57.589383 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-1a03a8fa-c5d9-4c5e-98b0-1ec9046ffb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:10:57.597858 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1232/2485] 10.222.0.13 () {58 vars in 1016 bytes} [Fri Jul 1 04:10:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:10:57.613322 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8633b5-74b7-4f64-8772-6fb3ff69db04 service nova] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:10:57.624734 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8633b5-74b7-4f64-8772-6fb3ff69db04 service nova] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:10:57.630197 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1b736-3e09-4276-8060-aa8ab1d73ba1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:10:57.630835 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1b736-3e09-4276-8060-aa8ab1d73ba1 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:10:57.631209 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1b736-3e09-4276-8060-aa8ab1d73ba1 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:10:57.631614 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1b736-3e09-4276-8060-aa8ab1d73ba1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:10:57.641627 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec1b736-3e09-4276-8060-aa8ab1d73ba1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:10:57.643232 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec1b736-3e09-4276-8060-aa8ab1d73ba1 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:10:57.654016 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1254/2486] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:10:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:11:00.797300 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52beb760-2908-4a61-99ac-abe647c29ea2 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:00.798117 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52beb760-2908-4a61-99ac-abe647c29ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:00.798117 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52beb760-2908-4a61-99ac-abe647c29ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:00.809965 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=19 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:11:00.821102 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-52beb760-2908-4a61-99ac-abe647c29ea2 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:11:00.822350 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-52beb760-2908-4a61-99ac-abe647c29ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:00.831121 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1233/2487] 10.222.0.13 () {58 vars in 1016 bytes} [Fri Jul 1 04:11:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:11:00.855203 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1b736-3e09-4276-8060-aa8ab1d73ba1 service nova] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:00.868820 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1b736-3e09-4276-8060-aa8ab1d73ba1 service nova] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:00.875536 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013285d0-1ee1-4271-8a36-d53871184a0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:00.880400 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013285d0-1ee1-4271-8a36-d53871184a0f service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:00.880400 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013285d0-1ee1-4271-8a36-d53871184a0f service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:00.880400 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013285d0-1ee1-4271-8a36-d53871184a0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:00.887176 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013285d0-1ee1-4271-8a36-d53871184a0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:00.888944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013285d0-1ee1-4271-8a36-d53871184a0f service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:00.900979 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1255/2488] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:11:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:11:03.424642 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52beb760-2908-4a61-99ac-abe647c29ea2 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:03.434343 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52beb760-2908-4a61-99ac-abe647c29ea2 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:03.437970 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92785ef2-5e1a-4d91-9448-41515606a131 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:03.441178 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92785ef2-5e1a-4d91-9448-41515606a131 service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:03.441178 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92785ef2-5e1a-4d91-9448-41515606a131 service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:03.441178 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92785ef2-5e1a-4d91-9448-41515606a131 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:03.441178 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-92785ef2-5e1a-4d91-9448-41515606a131 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:03.452806 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92785ef2-5e1a-4d91-9448-41515606a131 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:03.454222 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92785ef2-5e1a-4d91-9448-41515606a131 service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:03.463834 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1234/2489] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:11:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 04:11:07.559612 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013285d0-1ee1-4271-8a36-d53871184a0f service nova] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:07.566738 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=37 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:11:07.573501 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013285d0-1ee1-4271-8a36-d53871184a0f service nova] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:07.580683 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93fa3f0-030c-426b-9df0-299ffde56e8a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efe4a6dd11047688892641a936e2914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:07.580683 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fa3f0-030c-426b-9df0-299ffde56e8a service placement] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:07.580683 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fa3f0-030c-426b-9df0-299ffde56e8a service placement] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:07.580683 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fa3f0-030c-426b-9df0-299ffde56e8a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:07.581836 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b93fa3f0-030c-426b-9df0-299ffde56e8a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:07.594173 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93fa3f0-030c-426b-9df0-299ffde56e8a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:07.595874 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93fa3f0-030c-426b-9df0-299ffde56e8a service placement] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:07.606980 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1256/2490] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:11:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:11:07.669224 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92785ef2-5e1a-4d91-9448-41515606a131 service neutron] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:07.670784 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-92785ef2-5e1a-4d91-9448-41515606a131 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:07.684059 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92785ef2-5e1a-4d91-9448-41515606a131 service neutron] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:07.689393 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde77ac-71ca-4edc-a17c-0659624c566d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:07.693519 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde77ac-71ca-4edc-a17c-0659624c566d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:07.693519 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde77ac-71ca-4edc-a17c-0659624c566d admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:07.693519 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde77ac-71ca-4edc-a17c-0659624c566d admin admin] PATH_INFO: `/v3/users/71b72d9b9e3a4eb2ba1aae5d8a924afd` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:07.693519 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdde77ac-71ca-4edc-a17c-0659624c566d admin admin] RBAC: Authorizing `identity:delete_user(user_id=71b72d9b9e3a4eb2ba1aae5d8a924afd)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:07.694038 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdde77ac-71ca-4edc-a17c-0659624c566d admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:07.902228 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-cdde77ac-71ca-4edc-a17c-0659624c566d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71b72d9b9e3a4eb2ba1aae5d8a924afd'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:07.902797 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-cdde77ac-71ca-4edc-a17c-0659624c566d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71b72d9b9e3a4eb2ba1aae5d8a924afd'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:07.985314 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-cdde77ac-71ca-4edc-a17c-0659624c566d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71b72d9b9e3a4eb2ba1aae5d8a924afd'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:07.986008 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-cdde77ac-71ca-4edc-a17c-0659624c566d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71b72d9b9e3a4eb2ba1aae5d8a924afd'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:07.994052 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-cdde77ac-71ca-4edc-a17c-0659624c566d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71b72d9b9e3a4eb2ba1aae5d8a924afd'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:08.012034 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1235/2491] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:11:07 2022] DELETE /identity/v3/users/71b72d9b9e3a4eb2ba1aae5d8a924afd => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:11:08.313934 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93fa3f0-030c-426b-9df0-299ffde56e8a service placement] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:08.325620 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93fa3f0-030c-426b-9df0-299ffde56e8a service placement] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:08.401461 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4d222-c90e-4995-b94e-e8671a022b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:08.402331 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4d222-c90e-4995-b94e-e8671a022b33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:08.402615 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4d222-c90e-4995-b94e-e8671a022b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:08.402890 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4d222-c90e-4995-b94e-e8671a022b33 admin admin] PATH_INFO: `/v3/projects/902042539e31408f95db82263b40c1df` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:08.404121 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4d222-c90e-4995-b94e-e8671a022b33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=902042539e31408f95db82263b40c1df)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:08.406165 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4d222-c90e-4995-b94e-e8671a022b33 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:08.512671 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-35b4d222-c90e-4995-b94e-e8671a022b33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '902042539e31408f95db82263b40c1df', 'request_id': 'req-35b4d222-c90e-4995-b94e-e8671a022b33'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:08.573953 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-35b4d222-c90e-4995-b94e-e8671a022b33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '902042539e31408f95db82263b40c1df', 'request_id': 'req-35b4d222-c90e-4995-b94e-e8671a022b33'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:08.581134 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-35b4d222-c90e-4995-b94e-e8671a022b33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '902042539e31408f95db82263b40c1df', 'request_id': 'req-35b4d222-c90e-4995-b94e-e8671a022b33'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:08.592748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-35b4d222-c90e-4995-b94e-e8671a022b33 admin admin] The token cache is being invalidate because project 902042539e31408f95db82263b40c1df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:11:08.593038 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-35b4d222-c90e-4995-b94e-e8671a022b33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:08.593705 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-35b4d222-c90e-4995-b94e-e8671a022b33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:08.595262 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1257/2492] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:11:08 2022] DELETE /identity/v3/projects/902042539e31408f95db82263b40c1df => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:11:08.601018 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009f3b0-cb89-43c5-ae70-331ddbc69d48 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:08.601315 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009f3b0-cb89-43c5-ae70-331ddbc69d48 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:08.601599 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009f3b0-cb89-43c5-ae70-331ddbc69d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:08.619735 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-9009f3b0-cb89-43c5-ae70-331ddbc69d48 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:11:08.620976 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-9009f3b0-cb89-43c5-ae70-331ddbc69d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:08.685018 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1236/2493] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:11:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:11:08.699750 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77262c31-793c-4395-a7c3-e1f40deaf964 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:08.700028 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77262c31-793c-4395-a7c3-e1f40deaf964 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:08.700305 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77262c31-793c-4395-a7c3-e1f40deaf964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:08.720921 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-77262c31-793c-4395-a7c3-e1f40deaf964 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:11:08.722204 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-77262c31-793c-4395-a7c3-e1f40deaf964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:08.730539 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1258/2494] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:11:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:11:08.736315 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009f3b0-cb89-43c5-ae70-331ddbc69d48 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:08.746487 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009f3b0-cb89-43c5-ae70-331ddbc69d48 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:08.752087 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927698ce-f8a3-4afa-baa2-bc5a36d45a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:08.752766 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927698ce-f8a3-4afa-baa2-bc5a36d45a26 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:08.753043 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927698ce-f8a3-4afa-baa2-bc5a36d45a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:08.753316 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927698ce-f8a3-4afa-baa2-bc5a36d45a26 admin admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:08.754074 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927698ce-f8a3-4afa-baa2-bc5a36d45a26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:11:08.754360 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927698ce-f8a3-4afa-baa2-bc5a36d45a26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:08.756050 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927698ce-f8a3-4afa-baa2-bc5a36d45a26 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:08.769294 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1237/2495] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:11:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:11:08.773798 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77262c31-793c-4395-a7c3-e1f40deaf964 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:08.783974 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77262c31-793c-4395-a7c3-e1f40deaf964 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:08.788946 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7913113-8fe6-4dca-9075-633479002ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:08.790654 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7913113-8fe6-4dca-9075-633479002ea9 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:08.790654 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7913113-8fe6-4dca-9075-633479002ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:08.790654 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7913113-8fe6-4dca-9075-633479002ea9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:08.791081 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7913113-8fe6-4dca-9075-633479002ea9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:08.792795 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7913113-8fe6-4dca-9075-633479002ea9 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:08.901724 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1259/2496] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:11:08 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:11:08.906116 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927698ce-f8a3-4afa-baa2-bc5a36d45a26 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:08.916630 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927698ce-f8a3-4afa-baa2-bc5a36d45a26 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:08.969551 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:11:08.988318 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a83cfd-be70-448e-ae76-b75def9980ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:08.989003 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a83cfd-be70-448e-ae76-b75def9980ff admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:08.989284 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a83cfd-be70-448e-ae76-b75def9980ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:08.989565 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a83cfd-be70-448e-ae76-b75def9980ff admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:08.990261 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a83cfd-be70-448e-ae76-b75def9980ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:08.992234 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a83cfd-be70-448e-ae76-b75def9980ff admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:09.130941 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1238/2497] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:11:08 2022] POST /identity/v3/users => generated 293 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:11:09.137043 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7913113-8fe6-4dca-9075-633479002ea9 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:09.151441 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7913113-8fe6-4dca-9075-633479002ea9 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:09.156633 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ae789-e843-4a8c-883f-e6c368528366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:09.157318 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ae789-e843-4a8c-883f-e6c368528366 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:09.157600 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ae789-e843-4a8c-883f-e6c368528366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:09.157916 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ae789-e843-4a8c-883f-e6c368528366 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:09.158685 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730ae789-e843-4a8c-883f-e6c368528366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:09.160358 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730ae789-e843-4a8c-883f-e6c368528366 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:09.172062 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1260/2498] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:11:09.176394 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a83cfd-be70-448e-ae76-b75def9980ff admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:09.186944 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a83cfd-be70-448e-ae76-b75def9980ff admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:09.191733 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4ec2f-6394-4b59-b581-a790875f34ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:09.192426 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4ec2f-6394-4b59-b581-a790875f34ae admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:09.192744 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4ec2f-6394-4b59-b581-a790875f34ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:09.193014 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4ec2f-6394-4b59-b581-a790875f34ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:09.193823 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f4ec2f-6394-4b59-b581-a790875f34ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:09.195587 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f4ec2f-6394-4b59-b581-a790875f34ae admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:09.206421 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1239/2499] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:11:09.210891 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ae789-e843-4a8c-883f-e6c368528366 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:09.221850 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ae789-e843-4a8c-883f-e6c368528366 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:09.226435 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82deb232-8b4d-49d7-b66e-2e10e1c38b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:09.227331 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82deb232-8b4d-49d7-b66e-2e10e1c38b38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:09.227669 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82deb232-8b4d-49d7-b66e-2e10e1c38b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:09.227919 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82deb232-8b4d-49d7-b66e-2e10e1c38b38 admin admin] PATH_INFO: `/v3/projects/f1e41cf8dd8f430ab0e9968f0a9a57e0/users/54b2a701779446c39bb4a4e29fda11ca/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:09.244933 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82deb232-8b4d-49d7-b66e-2e10e1c38b38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1e41cf8dd8f430ab0e9968f0a9a57e0, user_id=54b2a701779446c39bb4a4e29fda11ca, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:09.247667 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82deb232-8b4d-49d7-b66e-2e10e1c38b38 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:09.323481 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1261/2500] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:11:09 2022] PUT /identity/v3/projects/f1e41cf8dd8f430ab0e9968f0a9a57e0/users/54b2a701779446c39bb4a4e29fda11ca/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:11:09.334868 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aff842-ac85-4ede-9f03-1dd8fbc05d1e None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:09.335151 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aff842-ac85-4ede-9f03-1dd8fbc05d1e None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:09.335504 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aff842-ac85-4ede-9f03-1dd8fbc05d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:09.367330 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-e5aff842-ac85-4ede-9f03-1dd8fbc05d1e None None] MFA Rules not processed for user `54b2a701779446c39bb4a4e29fda11ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:11:09.368688 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-e5aff842-ac85-4ede-9f03-1dd8fbc05d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:09.449253 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1240/2501] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:11:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 04:11:09.460900 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82deb232-8b4d-49d7-b66e-2e10e1c38b38 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:09.463044 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-82deb232-8b4d-49d7-b66e-2e10e1c38b38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:09.475214 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:11:09.556122 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82deb232-8b4d-49d7-b66e-2e10e1c38b38 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:09.562011 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f54d9f0-a581-495e-b217-e4f7f946ca25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:09.562868 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54d9f0-a581-495e-b217-e4f7f946ca25 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:09.563608 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54d9f0-a581-495e-b217-e4f7f946ca25 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:09.563888 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54d9f0-a581-495e-b217-e4f7f946ca25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:09.572352 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f54d9f0-a581-495e-b217-e4f7f946ca25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:09.573964 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f54d9f0-a581-495e-b217-e4f7f946ca25 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:09.584432 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1262/2502] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:11:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:11:15.323649 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aff842-ac85-4ede-9f03-1dd8fbc05d1e None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:15.326113 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-e5aff842-ac85-4ede-9f03-1dd8fbc05d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:15.393860 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aff842-ac85-4ede-9f03-1dd8fbc05d1e None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:15.397633 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc3fb8a-2e89-4210-9047-c7a9b0b5f879 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:15.398336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3fb8a-2e89-4210-9047-c7a9b0b5f879 service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:15.398616 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3fb8a-2e89-4210-9047-c7a9b0b5f879 service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:15.398890 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3fb8a-2e89-4210-9047-c7a9b0b5f879 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:15.401009 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-0fc3fb8a-2e89-4210-9047-c7a9b0b5f879 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:15.467826 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc3fb8a-2e89-4210-9047-c7a9b0b5f879 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:15.469331 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc3fb8a-2e89-4210-9047-c7a9b0b5f879 service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:15.480746 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1241/2503] 10.222.0.46 () {60 vars in 1396 bytes} [Fri Jul 1 04:11:15 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3252 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:11:15.897935 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f54d9f0-a581-495e-b217-e4f7f946ca25 service nova] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:15.958442 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f54d9f0-a581-495e-b217-e4f7f946ca25 service nova] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:15.962916 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6056bb6-9f34-4cee-805b-50925aa1a8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:15.963839 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6056bb6-9f34-4cee-805b-50925aa1a8cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:15.964097 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6056bb6-9f34-4cee-805b-50925aa1a8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:15.964373 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6056bb6-9f34-4cee-805b-50925aa1a8cf admin admin] PATH_INFO: `/v3/users/54b2a701779446c39bb4a4e29fda11ca` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:15.965568 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6056bb6-9f34-4cee-805b-50925aa1a8cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=54b2a701779446c39bb4a4e29fda11ca)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:15.967566 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6056bb6-9f34-4cee-805b-50925aa1a8cf admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:16.764964 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e6056bb6-9f34-4cee-805b-50925aa1a8cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54b2a701779446c39bb4a4e29fda11ca'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:16.765609 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e6056bb6-9f34-4cee-805b-50925aa1a8cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54b2a701779446c39bb4a4e29fda11ca'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:16.777663 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e6056bb6-9f34-4cee-805b-50925aa1a8cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54b2a701779446c39bb4a4e29fda11ca'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:16.785229 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e6056bb6-9f34-4cee-805b-50925aa1a8cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54b2a701779446c39bb4a4e29fda11ca'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:16.785229 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e6056bb6-9f34-4cee-805b-50925aa1a8cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54b2a701779446c39bb4a4e29fda11ca'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:16.877035 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1263/2504] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:11:15 2022] DELETE /identity/v3/users/54b2a701779446c39bb4a4e29fda11ca => generated 0 bytes in 981 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:11:16.881637 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d57e66-9db2-40b5-b070-a790fcbb1221 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:16.882139 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d57e66-9db2-40b5-b070-a790fcbb1221 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:16.882278 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d57e66-9db2-40b5-b070-a790fcbb1221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:16.888813 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:11:16.899631 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-45d57e66-9db2-40b5-b070-a790fcbb1221 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:11:16.900885 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-45d57e66-9db2-40b5-b070-a790fcbb1221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:16.960784 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1242/2505] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:11:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:11:16.971557 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6056bb6-9f34-4cee-805b-50925aa1a8cf admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:16.973049 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e6056bb6-9f34-4cee-805b-50925aa1a8cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:16.987085 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:11:17.031747 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6056bb6-9f34-4cee-805b-50925aa1a8cf admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:17.035870 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c81fdb-4148-40da-aa72-f8d049f59f59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:17.036556 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c81fdb-4148-40da-aa72-f8d049f59f59 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:17.036840 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c81fdb-4148-40da-aa72-f8d049f59f59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:17.037113 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c81fdb-4148-40da-aa72-f8d049f59f59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:17.047587 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c81fdb-4148-40da-aa72-f8d049f59f59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:17.049039 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c81fdb-4148-40da-aa72-f8d049f59f59 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:17.058831 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1264/2506] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:11:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:11:17.508049 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d57e66-9db2-40b5-b070-a790fcbb1221 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:17.509666 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-45d57e66-9db2-40b5-b070-a790fcbb1221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:17.525529 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d57e66-9db2-40b5-b070-a790fcbb1221 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:17.530471 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288bed65-dc66-4b7e-87f9-1f252eae5db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:17.531478 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bed65-dc66-4b7e-87f9-1f252eae5db3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:17.531842 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bed65-dc66-4b7e-87f9-1f252eae5db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:17.532221 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bed65-dc66-4b7e-87f9-1f252eae5db3 admin admin] PATH_INFO: `/v3/projects/f1e41cf8dd8f430ab0e9968f0a9a57e0` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:17.533887 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288bed65-dc66-4b7e-87f9-1f252eae5db3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1e41cf8dd8f430ab0e9968f0a9a57e0)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:17.536119 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288bed65-dc66-4b7e-87f9-1f252eae5db3 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:17.681807 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-288bed65-dc66-4b7e-87f9-1f252eae5db3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1e41cf8dd8f430ab0e9968f0a9a57e0', 'request_id': 'req-288bed65-dc66-4b7e-87f9-1f252eae5db3'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:17.689641 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-288bed65-dc66-4b7e-87f9-1f252eae5db3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1e41cf8dd8f430ab0e9968f0a9a57e0', 'request_id': 'req-288bed65-dc66-4b7e-87f9-1f252eae5db3'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:17.697129 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-288bed65-dc66-4b7e-87f9-1f252eae5db3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1e41cf8dd8f430ab0e9968f0a9a57e0', 'request_id': 'req-288bed65-dc66-4b7e-87f9-1f252eae5db3'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:17.877797 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-288bed65-dc66-4b7e-87f9-1f252eae5db3 admin admin] The token cache is being invalidate because project f1e41cf8dd8f430ab0e9968f0a9a57e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:11:17.878227 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-288bed65-dc66-4b7e-87f9-1f252eae5db3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:17.878917 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-288bed65-dc66-4b7e-87f9-1f252eae5db3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:17.880607 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1243/2507] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:11:17 2022] DELETE /identity/v3/projects/f1e41cf8dd8f430ab0e9968f0a9a57e0 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:11:17.885621 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a0bc1-b572-4e76-94ee-6b918d460033 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:17.885912 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a0bc1-b572-4e76-94ee-6b918d460033 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:17.886194 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a0bc1-b572-4e76-94ee-6b918d460033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:17.909710 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-2d5a0bc1-b572-4e76-94ee-6b918d460033 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:11:17.910962 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2d5a0bc1-b572-4e76-94ee-6b918d460033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:17.972640 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1265/2508] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:11:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:11:17.980416 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7732b4-40b9-4ae8-9e78-ac00804ded00 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:17.980943 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7732b4-40b9-4ae8-9e78-ac00804ded00 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:17.981042 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7732b4-40b9-4ae8-9e78-ac00804ded00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:18.000256 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-5d7732b4-40b9-4ae8-9e78-ac00804ded00 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:11:18.001986 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-5d7732b4-40b9-4ae8-9e78-ac00804ded00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:18.009814 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1244/2509] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:11:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:11:18.014166 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a0bc1-b572-4e76-94ee-6b918d460033 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:18.023803 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a0bc1-b572-4e76-94ee-6b918d460033 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:18.028283 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c74dc-830f-4c9e-b8c5-a0efcd85ee83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:18.028947 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c74dc-830f-4c9e-b8c5-a0efcd85ee83 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:18.029247 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c74dc-830f-4c9e-b8c5-a0efcd85ee83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:18.029502 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c74dc-830f-4c9e-b8c5-a0efcd85ee83 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:18.030296 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c74dc-830f-4c9e-b8c5-a0efcd85ee83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:11:18.030687 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c74dc-830f-4c9e-b8c5-a0efcd85ee83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:18.032474 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c74dc-830f-4c9e-b8c5-a0efcd85ee83 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:18.044483 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1266/2510] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:11:18.049707 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7732b4-40b9-4ae8-9e78-ac00804ded00 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:18.059762 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7732b4-40b9-4ae8-9e78-ac00804ded00 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:18.064893 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffbe51-c7ec-4feb-9891-9c896fd1fadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:18.065538 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffbe51-c7ec-4feb-9891-9c896fd1fadc admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:18.065914 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffbe51-c7ec-4feb-9891-9c896fd1fadc admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:18.066223 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffbe51-c7ec-4feb-9891-9c896fd1fadc admin admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:18.066918 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ffbe51-c7ec-4feb-9891-9c896fd1fadc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:18.069039 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ffbe51-c7ec-4feb-9891-9c896fd1fadc admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:18.229956 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1245/2511] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:11:18 2022] POST /identity/v3/projects => generated 375 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 04:11:18.232961 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c74dc-830f-4c9e-b8c5-a0efcd85ee83 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:18.243803 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c74dc-830f-4c9e-b8c5-a0efcd85ee83 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:18.300897 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818677c2-a6e1-4a9f-801a-8db745bbf86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:18.301572 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818677c2-a6e1-4a9f-801a-8db745bbf86a admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:18.301854 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818677c2-a6e1-4a9f-801a-8db745bbf86a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:18.302130 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818677c2-a6e1-4a9f-801a-8db745bbf86a admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:18.302816 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818677c2-a6e1-4a9f-801a-8db745bbf86a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:18.304777 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818677c2-a6e1-4a9f-801a-8db745bbf86a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:18.443251 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1267/2512] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:11:18 2022] POST /identity/v3/users => generated 288 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 04:11:18.447480 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffbe51-c7ec-4feb-9891-9c896fd1fadc admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:18.458343 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffbe51-c7ec-4feb-9891-9c896fd1fadc admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:18.463398 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faeca80-dac2-4743-92ee-c413e9896196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:18.464163 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faeca80-dac2-4743-92ee-c413e9896196 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:18.464567 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faeca80-dac2-4743-92ee-c413e9896196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:18.464845 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faeca80-dac2-4743-92ee-c413e9896196 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:18.465598 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faeca80-dac2-4743-92ee-c413e9896196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:18.467221 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faeca80-dac2-4743-92ee-c413e9896196 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:18.480150 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1246/2513] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:11:18.484362 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818677c2-a6e1-4a9f-801a-8db745bbf86a admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:18.495301 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818677c2-a6e1-4a9f-801a-8db745bbf86a admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:18.504456 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23a954-0bf0-46f5-8926-30f73e887700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:18.505138 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23a954-0bf0-46f5-8926-30f73e887700 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:18.505420 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23a954-0bf0-46f5-8926-30f73e887700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:18.505707 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23a954-0bf0-46f5-8926-30f73e887700 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:18.506435 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23a954-0bf0-46f5-8926-30f73e887700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:18.508093 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23a954-0bf0-46f5-8926-30f73e887700 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:18.519171 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1268/2514] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:11:18.523944 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faeca80-dac2-4743-92ee-c413e9896196 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:18.534774 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faeca80-dac2-4743-92ee-c413e9896196 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:18.539682 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b739a-7889-4536-9e3a-4bc9d73135b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:18.540621 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b739a-7889-4536-9e3a-4bc9d73135b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:18.540976 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b739a-7889-4536-9e3a-4bc9d73135b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:18.541260 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b739a-7889-4536-9e3a-4bc9d73135b6 admin admin] PATH_INFO: `/v3/projects/f16bc5019b9c4e5aa7bbbabc9b3bb15e/users/a4d5acbd7ad246e8907f6fdc72a38672/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:18.556388 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b739a-7889-4536-9e3a-4bc9d73135b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f16bc5019b9c4e5aa7bbbabc9b3bb15e, user_id=a4d5acbd7ad246e8907f6fdc72a38672, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:18.561351 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b739a-7889-4536-9e3a-4bc9d73135b6 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:18.659706 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1247/2515] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:11:18 2022] PUT /identity/v3/projects/f16bc5019b9c4e5aa7bbbabc9b3bb15e/users/a4d5acbd7ad246e8907f6fdc72a38672/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:11:18.670113 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abdffde-daa1-4c52-842b-ac3a4145734c None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:18.670405 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abdffde-daa1-4c52-842b-ac3a4145734c None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:18.670687 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abdffde-daa1-4c52-842b-ac3a4145734c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:18.700023 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-2abdffde-daa1-4c52-842b-ac3a4145734c None None] MFA Rules not processed for user `a4d5acbd7ad246e8907f6fdc72a38672`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:11:18.701278 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2abdffde-daa1-4c52-842b-ac3a4145734c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:18.709523 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:11:18.766386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1269/2516] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:11:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:11:18.780429 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b739a-7889-4536-9e3a-4bc9d73135b6 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:18.782228 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-ff4b739a-7889-4536-9e3a-4bc9d73135b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:18.811713 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:11:18.859635 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b739a-7889-4536-9e3a-4bc9d73135b6 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:18.865995 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f44f3b-fbdb-45ef-ba64-7a8734cfa17c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:18.866655 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f44f3b-fbdb-45ef-ba64-7a8734cfa17c service nova] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:18.866939 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f44f3b-fbdb-45ef-ba64-7a8734cfa17c service nova] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:18.867215 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f44f3b-fbdb-45ef-ba64-7a8734cfa17c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:18.876003 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f44f3b-fbdb-45ef-ba64-7a8734cfa17c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:18.877669 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f44f3b-fbdb-45ef-ba64-7a8734cfa17c service nova] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:18.887898 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1248/2517] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:11:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:11:19.110883 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abdffde-daa1-4c52-842b-ac3a4145734c None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:19.173360 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abdffde-daa1-4c52-842b-ac3a4145734c None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:19.178357 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26034e2-b09f-4554-a1e7-52eceb5ee1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:19.179232 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26034e2-b09f-4554-a1e7-52eceb5ee1c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:19.179546 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26034e2-b09f-4554-a1e7-52eceb5ee1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:19.179822 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26034e2-b09f-4554-a1e7-52eceb5ee1c5 admin admin] PATH_INFO: `/v3/users/a4d5acbd7ad246e8907f6fdc72a38672` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:19.180988 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26034e2-b09f-4554-a1e7-52eceb5ee1c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4d5acbd7ad246e8907f6fdc72a38672)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:19.182955 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26034e2-b09f-4554-a1e7-52eceb5ee1c5 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:19.375963 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e26034e2-b09f-4554-a1e7-52eceb5ee1c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4d5acbd7ad246e8907f6fdc72a38672'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:19.377520 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e26034e2-b09f-4554-a1e7-52eceb5ee1c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4d5acbd7ad246e8907f6fdc72a38672'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:19.389167 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e26034e2-b09f-4554-a1e7-52eceb5ee1c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4d5acbd7ad246e8907f6fdc72a38672'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:19.395923 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e26034e2-b09f-4554-a1e7-52eceb5ee1c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4d5acbd7ad246e8907f6fdc72a38672'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:19.396598 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e26034e2-b09f-4554-a1e7-52eceb5ee1c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4d5acbd7ad246e8907f6fdc72a38672'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:19.443851 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1270/2518] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:11:19 2022] DELETE /identity/v3/users/a4d5acbd7ad246e8907f6fdc72a38672 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:11:19.448354 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678302e5-fec7-41c7-ac89-5c4f0074e4ba None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:19.448870 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678302e5-fec7-41c7-ac89-5c4f0074e4ba None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:19.448963 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678302e5-fec7-41c7-ac89-5c4f0074e4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:19.466348 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-678302e5-fec7-41c7-ac89-5c4f0074e4ba None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:11:19.467675 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-678302e5-fec7-41c7-ac89-5c4f0074e4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:19.536363 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1249/2519] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:11:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:11:19.547058 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26034e2-b09f-4554-a1e7-52eceb5ee1c5 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:19.548977 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e26034e2-b09f-4554-a1e7-52eceb5ee1c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:19.587057 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:11:19.615521 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26034e2-b09f-4554-a1e7-52eceb5ee1c5 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:19.619271 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92d74d-2213-4c24-bd0f-59a594158574 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:19.619967 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92d74d-2213-4c24-bd0f-59a594158574 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:19.620242 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92d74d-2213-4c24-bd0f-59a594158574 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:19.620522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92d74d-2213-4c24-bd0f-59a594158574 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:19.633775 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c92d74d-2213-4c24-bd0f-59a594158574 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:19.635278 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c92d74d-2213-4c24-bd0f-59a594158574 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:19.645389 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1271/2520] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:11:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:11:20.168845 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678302e5-fec7-41c7-ac89-5c4f0074e4ba None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:20.170296 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-678302e5-fec7-41c7-ac89-5c4f0074e4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:20.182309 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678302e5-fec7-41c7-ac89-5c4f0074e4ba None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:20.187001 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d60dc-126b-4828-9a7d-9450869777e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:20.195018 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d60dc-126b-4828-9a7d-9450869777e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:20.195018 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d60dc-126b-4828-9a7d-9450869777e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:20.195018 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d60dc-126b-4828-9a7d-9450869777e2 admin admin] PATH_INFO: `/v3/projects/f16bc5019b9c4e5aa7bbbabc9b3bb15e` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:20.195018 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d60dc-126b-4828-9a7d-9450869777e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f16bc5019b9c4e5aa7bbbabc9b3bb15e)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:20.195018 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d60dc-126b-4828-9a7d-9450869777e2 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:20.358729 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-8f1d60dc-126b-4828-9a7d-9450869777e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f16bc5019b9c4e5aa7bbbabc9b3bb15e', 'request_id': 'req-8f1d60dc-126b-4828-9a7d-9450869777e2'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:20.369777 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-8f1d60dc-126b-4828-9a7d-9450869777e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f16bc5019b9c4e5aa7bbbabc9b3bb15e', 'request_id': 'req-8f1d60dc-126b-4828-9a7d-9450869777e2'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:20.376209 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-8f1d60dc-126b-4828-9a7d-9450869777e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f16bc5019b9c4e5aa7bbbabc9b3bb15e', 'request_id': 'req-8f1d60dc-126b-4828-9a7d-9450869777e2'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:20.481788 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-8f1d60dc-126b-4828-9a7d-9450869777e2 admin admin] The token cache is being invalidate because project f16bc5019b9c4e5aa7bbbabc9b3bb15e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:11:20.482426 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-8f1d60dc-126b-4828-9a7d-9450869777e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:20.482622 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-8f1d60dc-126b-4828-9a7d-9450869777e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:20.484312 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1250/2521] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:11:20 2022] DELETE /identity/v3/projects/f16bc5019b9c4e5aa7bbbabc9b3bb15e => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:11:20.489351 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e975920-48bd-41aa-b4ba-f3a5104522d0 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:20.489793 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e975920-48bd-41aa-b4ba-f3a5104522d0 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:20.489890 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e975920-48bd-41aa-b4ba-f3a5104522d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:20.511627 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-2e975920-48bd-41aa-b4ba-f3a5104522d0 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:11:20.512929 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2e975920-48bd-41aa-b4ba-f3a5104522d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:20.574429 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1272/2522] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:11:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 04:11:20.582781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce201d-a2e8-4413-9ed4-9141d2694792 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:20.583062 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce201d-a2e8-4413-9ed4-9141d2694792 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:20.583365 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce201d-a2e8-4413-9ed4-9141d2694792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:20.602413 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-f6ce201d-a2e8-4413-9ed4-9141d2694792 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:11:20.603643 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-f6ce201d-a2e8-4413-9ed4-9141d2694792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:20.611408 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1251/2523] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:11:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:11:20.615944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e975920-48bd-41aa-b4ba-f3a5104522d0 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:20.626104 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e975920-48bd-41aa-b4ba-f3a5104522d0 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:20.631269 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997b30f-6b02-4ac3-a08d-322d6f482e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:20.631959 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997b30f-6b02-4ac3-a08d-322d6f482e0c admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:20.632238 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997b30f-6b02-4ac3-a08d-322d6f482e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:20.632513 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997b30f-6b02-4ac3-a08d-322d6f482e0c admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:20.633234 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7997b30f-6b02-4ac3-a08d-322d6f482e0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:11:20.633542 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7997b30f-6b02-4ac3-a08d-322d6f482e0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:20.635139 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7997b30f-6b02-4ac3-a08d-322d6f482e0c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:20.648279 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1273/2524] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:11:20.654266 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce201d-a2e8-4413-9ed4-9141d2694792 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:20.664150 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce201d-a2e8-4413-9ed4-9141d2694792 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:20.669041 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b1ce4-f354-4725-9a88-2cd4b6a9a7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:20.669706 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b1ce4-f354-4725-9a88-2cd4b6a9a7f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:20.669987 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b1ce4-f354-4725-9a88-2cd4b6a9a7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:20.670261 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b1ce4-f354-4725-9a88-2cd4b6a9a7f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:20.670995 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b1ce4-f354-4725-9a88-2cd4b6a9a7f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:20.672941 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b1ce4-f354-4725-9a88-2cd4b6a9a7f0 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:20.753347 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1252/2525] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:11:20 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:11:20.761577 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997b30f-6b02-4ac3-a08d-322d6f482e0c admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:20.772004 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997b30f-6b02-4ac3-a08d-322d6f482e0c admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:20.828360 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3d635-9590-490f-aaf3-0c8b1df58b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:20.829031 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3d635-9590-490f-aaf3-0c8b1df58b5d admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:20.829380 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3d635-9590-490f-aaf3-0c8b1df58b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:20.829584 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3d635-9590-490f-aaf3-0c8b1df58b5d admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:20.830446 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa3d635-9590-490f-aaf3-0c8b1df58b5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:20.832417 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa3d635-9590-490f-aaf3-0c8b1df58b5d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:20.933350 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1274/2526] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:11:20 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:11:20.937537 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b1ce4-f354-4725-9a88-2cd4b6a9a7f0 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:20.944685 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:11:20.948529 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b1ce4-f354-4725-9a88-2cd4b6a9a7f0 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:20.953251 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8c8f4-b076-4ec5-8962-be6c04f63006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:20.953907 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8c8f4-b076-4ec5-8962-be6c04f63006 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:20.954191 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8c8f4-b076-4ec5-8962-be6c04f63006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:20.954466 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8c8f4-b076-4ec5-8962-be6c04f63006 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:20.955219 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c8c8f4-b076-4ec5-8962-be6c04f63006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:20.956951 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c8c8f4-b076-4ec5-8962-be6c04f63006 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:20.967227 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1253/2527] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:11:20.971430 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3d635-9590-490f-aaf3-0c8b1df58b5d admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:20.981484 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3d635-9590-490f-aaf3-0c8b1df58b5d admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:20.990163 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0fdef3-5dd6-4091-b220-a983970f9bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:20.990844 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fdef3-5dd6-4091-b220-a983970f9bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:20.993669 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fdef3-5dd6-4091-b220-a983970f9bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:20.993669 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fdef3-5dd6-4091-b220-a983970f9bd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:20.993669 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0fdef3-5dd6-4091-b220-a983970f9bd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:20.994007 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0fdef3-5dd6-4091-b220-a983970f9bd7 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:21.005172 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1275/2528] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:11:21.009698 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8c8f4-b076-4ec5-8962-be6c04f63006 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:21.019978 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8c8f4-b076-4ec5-8962-be6c04f63006 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:21.025251 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ec696-c2a0-4c73-aa5f-1848950daf2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:21.026139 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ec696-c2a0-4c73-aa5f-1848950daf2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:21.026421 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ec696-c2a0-4c73-aa5f-1848950daf2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:21.026696 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ec696-c2a0-4c73-aa5f-1848950daf2d admin admin] PATH_INFO: `/v3/projects/0d5ab4d576844fd7a2d0c550e9209bcd/users/bd8aa17d96f54240ad07b9bb8729e2ac/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:21.041568 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8ec696-c2a0-4c73-aa5f-1848950daf2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d5ab4d576844fd7a2d0c550e9209bcd, user_id=bd8aa17d96f54240ad07b9bb8729e2ac, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:21.044279 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8ec696-c2a0-4c73-aa5f-1848950daf2d admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:21.179860 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1254/2529] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:11:21 2022] PUT /identity/v3/projects/0d5ab4d576844fd7a2d0c550e9209bcd/users/bd8aa17d96f54240ad07b9bb8729e2ac/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:11:21.190464 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece5b81-f6a5-4393-b68c-623fd2c680f7 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:21.190758 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece5b81-f6a5-4393-b68c-623fd2c680f7 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:21.191041 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece5b81-f6a5-4393-b68c-623fd2c680f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:21.218427 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-fece5b81-f6a5-4393-b68c-623fd2c680f7 None None] MFA Rules not processed for user `bd8aa17d96f54240ad07b9bb8729e2ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:11:21.219668 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-fece5b81-f6a5-4393-b68c-623fd2c680f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:21.247557 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:11:21.286842 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1276/2530] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:11:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:11:21.291731 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ec696-c2a0-4c73-aa5f-1848950daf2d admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:21.359210 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ec696-c2a0-4c73-aa5f-1848950daf2d admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:21.368739 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142747ba-1fb2-4287-ad3d-b050843d6e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:21.369421 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142747ba-1fb2-4287-ad3d-b050843d6e45 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:21.369713 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142747ba-1fb2-4287-ad3d-b050843d6e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:21.370417 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142747ba-1fb2-4287-ad3d-b050843d6e45 admin admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:21.370710 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142747ba-1fb2-4287-ad3d-b050843d6e45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:21.372661 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142747ba-1fb2-4287-ad3d-b050843d6e45 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:21.459189 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1255/2531] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:11:21 2022] POST /identity/v3/projects => generated 385 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:11:21.463092 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece5b81-f6a5-4393-b68c-623fd2c680f7 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:21.476164 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece5b81-f6a5-4393-b68c-623fd2c680f7 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:21.533813 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef036a3e-d873-4577-9ee0-c987e45b985c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:21.534506 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef036a3e-d873-4577-9ee0-c987e45b985c admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:21.534792 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef036a3e-d873-4577-9ee0-c987e45b985c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:21.535076 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef036a3e-d873-4577-9ee0-c987e45b985c admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:21.535859 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef036a3e-d873-4577-9ee0-c987e45b985c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:21.544066 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef036a3e-d873-4577-9ee0-c987e45b985c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:21.651199 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1277/2532] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:11:21 2022] POST /identity/v3/users => generated 299 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:11:21.652763 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142747ba-1fb2-4287-ad3d-b050843d6e45 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:21.663832 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142747ba-1fb2-4287-ad3d-b050843d6e45 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:21.668488 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69883f52-0dfa-4b29-b1d3-94c13cd79ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:21.669153 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69883f52-0dfa-4b29-b1d3-94c13cd79ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:21.669431 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69883f52-0dfa-4b29-b1d3-94c13cd79ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:21.669708 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69883f52-0dfa-4b29-b1d3-94c13cd79ba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:21.670431 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69883f52-0dfa-4b29-b1d3-94c13cd79ba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:21.672065 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69883f52-0dfa-4b29-b1d3-94c13cd79ba4 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:21.682949 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1256/2533] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:11:21.687581 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef036a3e-d873-4577-9ee0-c987e45b985c admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:21.698140 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef036a3e-d873-4577-9ee0-c987e45b985c admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:21.702757 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9aa93-998a-4781-b233-85dd838af1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:21.704211 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9aa93-998a-4781-b233-85dd838af1a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:21.704211 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9aa93-998a-4781-b233-85dd838af1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:21.704411 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9aa93-998a-4781-b233-85dd838af1a0 admin admin] PATH_INFO: `/v3/projects/a63ddfcad1134bf190e1b4e547d80c7b/users/f55c571d3e1b43c1be99380f74610142/roles/681755518698445fabd9a8accec13c0f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:21.719545 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c9aa93-998a-4781-b233-85dd838af1a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a63ddfcad1134bf190e1b4e547d80c7b, user_id=f55c571d3e1b43c1be99380f74610142, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:21.722858 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c9aa93-998a-4781-b233-85dd838af1a0 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:21.871700 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1278/2534] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:11:21 2022] PUT /identity/v3/projects/a63ddfcad1134bf190e1b4e547d80c7b/users/f55c571d3e1b43c1be99380f74610142/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:11:21.875636 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69883f52-0dfa-4b29-b1d3-94c13cd79ba4 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:21.886074 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69883f52-0dfa-4b29-b1d3-94c13cd79ba4 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:21.945372 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be822f3-d5e8-4de2-b596-02f40ceebd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:21.946051 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be822f3-d5e8-4de2-b596-02f40ceebd1c admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:21.946331 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be822f3-d5e8-4de2-b596-02f40ceebd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:21.946602 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be822f3-d5e8-4de2-b596-02f40ceebd1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:21.947326 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be822f3-d5e8-4de2-b596-02f40ceebd1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:21.948943 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be822f3-d5e8-4de2-b596-02f40ceebd1c admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:21.960010 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1257/2535] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:11:21.964240 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9aa93-998a-4781-b233-85dd838af1a0 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:21.974652 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9aa93-998a-4781-b233-85dd838af1a0 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:21.979244 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93846350-bc93-4a35-a6a5-48e13dbf51a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:21.980163 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93846350-bc93-4a35-a6a5-48e13dbf51a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:21.980446 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93846350-bc93-4a35-a6a5-48e13dbf51a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:21.980726 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93846350-bc93-4a35-a6a5-48e13dbf51a7 admin admin] PATH_INFO: `/v3/projects/a63ddfcad1134bf190e1b4e547d80c7b/users/f55c571d3e1b43c1be99380f74610142/roles/681755518698445fabd9a8accec13c0f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:21.982673 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93846350-bc93-4a35-a6a5-48e13dbf51a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a63ddfcad1134bf190e1b4e547d80c7b, user_id=f55c571d3e1b43c1be99380f74610142, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:21.985414 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93846350-bc93-4a35-a6a5-48e13dbf51a7 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:21.995641 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1279/2536] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:11:21 2022] PUT /identity/v3/projects/a63ddfcad1134bf190e1b4e547d80c7b/users/f55c571d3e1b43c1be99380f74610142/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:11:22.011833 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b1aeb-725c-47f0-abec-3f09640f6718 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:22.012132 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b1aeb-725c-47f0-abec-3f09640f6718 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:22.012439 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b1aeb-725c-47f0-abec-3f09640f6718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:22.038522 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-936b1aeb-725c-47f0-abec-3f09640f6718 None None] MFA Rules not processed for user `f55c571d3e1b43c1be99380f74610142`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:11:22.039761 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-936b1aeb-725c-47f0-abec-3f09640f6718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:22.069543 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:11:22.107658 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1258/2537] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:11:22 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:11:22.119697 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93846350-bc93-4a35-a6a5-48e13dbf51a7 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:22.121358 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-93846350-bc93-4a35-a6a5-48e13dbf51a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:22.180654 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93846350-bc93-4a35-a6a5-48e13dbf51a7 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:22.184186 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c93878-437a-4ea3-ac6b-afd052ee7ebd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:22.184893 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c93878-437a-4ea3-ac6b-afd052ee7ebd service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:22.185149 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c93878-437a-4ea3-ac6b-afd052ee7ebd service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:22.185422 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c93878-437a-4ea3-ac6b-afd052ee7ebd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:22.195044 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c93878-437a-4ea3-ac6b-afd052ee7ebd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:22.196540 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c93878-437a-4ea3-ac6b-afd052ee7ebd service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:22.206466 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1280/2538] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:11:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:11:22.234007 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b1aeb-725c-47f0-abec-3f09640f6718 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:22.298012 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b1aeb-725c-47f0-abec-3f09640f6718 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:22.303054 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef280d71-2744-4b48-990f-7eca796e5fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:22.304010 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef280d71-2744-4b48-990f-7eca796e5fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:22.304269 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef280d71-2744-4b48-990f-7eca796e5fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:22.304541 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef280d71-2744-4b48-990f-7eca796e5fa5 admin admin] PATH_INFO: `/v3/users/bd8aa17d96f54240ad07b9bb8729e2ac` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:22.305795 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef280d71-2744-4b48-990f-7eca796e5fa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd8aa17d96f54240ad07b9bb8729e2ac)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:22.307743 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef280d71-2744-4b48-990f-7eca796e5fa5 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:22.496258 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-ef280d71-2744-4b48-990f-7eca796e5fa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd8aa17d96f54240ad07b9bb8729e2ac'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:22.496968 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-ef280d71-2744-4b48-990f-7eca796e5fa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd8aa17d96f54240ad07b9bb8729e2ac'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:22.619634 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-ef280d71-2744-4b48-990f-7eca796e5fa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd8aa17d96f54240ad07b9bb8729e2ac'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:22.620293 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-ef280d71-2744-4b48-990f-7eca796e5fa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd8aa17d96f54240ad07b9bb8729e2ac'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:22.628455 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-ef280d71-2744-4b48-990f-7eca796e5fa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd8aa17d96f54240ad07b9bb8729e2ac'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:22.646789 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1259/2539] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:11:22 2022] DELETE /identity/v3/users/bd8aa17d96f54240ad07b9bb8729e2ac => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:11:22.652366 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd1366-8208-4c99-a1b4-1fa7f8c44fee None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:22.652882 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd1366-8208-4c99-a1b4-1fa7f8c44fee None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:22.653008 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd1366-8208-4c99-a1b4-1fa7f8c44fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:22.672568 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-45cd1366-8208-4c99-a1b4-1fa7f8c44fee None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:11:22.673921 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-45cd1366-8208-4c99-a1b4-1fa7f8c44fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:22.691554 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:11:22.734158 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1281/2540] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 04:11:22.743769 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef280d71-2744-4b48-990f-7eca796e5fa5 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:22.745173 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-ef280d71-2744-4b48-990f-7eca796e5fa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:22.793237 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:11:22.805103 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef280d71-2744-4b48-990f-7eca796e5fa5 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:22.808713 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4dab4-c6a5-4f8d-a7a1-23532c100fe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:22.809367 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4dab4-c6a5-4f8d-a7a1-23532c100fe1 service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:22.809651 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4dab4-c6a5-4f8d-a7a1-23532c100fe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:22.809930 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4dab4-c6a5-4f8d-a7a1-23532c100fe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:22.820647 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4dab4-c6a5-4f8d-a7a1-23532c100fe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:22.822181 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4dab4-c6a5-4f8d-a7a1-23532c100fe1 service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:22.833245 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1260/2541] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:11:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:11:23.307517 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd1366-8208-4c99-a1b4-1fa7f8c44fee None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:23.308922 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-45cd1366-8208-4c99-a1b4-1fa7f8c44fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:23.330523 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd1366-8208-4c99-a1b4-1fa7f8c44fee None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:23.335279 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76911d5-58fb-42b8-a164-9a5ccf0a1e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:23.336182 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76911d5-58fb-42b8-a164-9a5ccf0a1e17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:23.336469 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76911d5-58fb-42b8-a164-9a5ccf0a1e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:23.336746 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76911d5-58fb-42b8-a164-9a5ccf0a1e17 admin admin] PATH_INFO: `/v3/projects/0d5ab4d576844fd7a2d0c550e9209bcd` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:23.337976 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76911d5-58fb-42b8-a164-9a5ccf0a1e17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d5ab4d576844fd7a2d0c550e9209bcd)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:23.339946 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76911d5-58fb-42b8-a164-9a5ccf0a1e17 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:23.438507 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c76911d5-58fb-42b8-a164-9a5ccf0a1e17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d5ab4d576844fd7a2d0c550e9209bcd', 'request_id': 'req-c76911d5-58fb-42b8-a164-9a5ccf0a1e17'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:23.488696 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c76911d5-58fb-42b8-a164-9a5ccf0a1e17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d5ab4d576844fd7a2d0c550e9209bcd', 'request_id': 'req-c76911d5-58fb-42b8-a164-9a5ccf0a1e17'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:23.496529 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c76911d5-58fb-42b8-a164-9a5ccf0a1e17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d5ab4d576844fd7a2d0c550e9209bcd', 'request_id': 'req-c76911d5-58fb-42b8-a164-9a5ccf0a1e17'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:23.508384 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c76911d5-58fb-42b8-a164-9a5ccf0a1e17 admin admin] The token cache is being invalidate because project 0d5ab4d576844fd7a2d0c550e9209bcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:11:23.508669 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c76911d5-58fb-42b8-a164-9a5ccf0a1e17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:23.509936 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c76911d5-58fb-42b8-a164-9a5ccf0a1e17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:23.512118 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1282/2542] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:11:23 2022] DELETE /identity/v3/projects/0d5ab4d576844fd7a2d0c550e9209bcd => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:11:23.515211 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4dab4-c6a5-4f8d-a7a1-23532c100fe1 service neutron] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:23.525327 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4dab4-c6a5-4f8d-a7a1-23532c100fe1 service neutron] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:23.583615 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b44f5-6d2e-4c50-9647-54efae59f175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:23.584575 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b44f5-6d2e-4c50-9647-54efae59f175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:23.584839 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b44f5-6d2e-4c50-9647-54efae59f175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:23.585119 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b44f5-6d2e-4c50-9647-54efae59f175 admin admin] PATH_INFO: `/v3/users/f55c571d3e1b43c1be99380f74610142` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:23.586366 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b44f5-6d2e-4c50-9647-54efae59f175 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f55c571d3e1b43c1be99380f74610142)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:23.588336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b44f5-6d2e-4c50-9647-54efae59f175 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:23.776451 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-a83b44f5-6d2e-4c50-9647-54efae59f175 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f55c571d3e1b43c1be99380f74610142'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:23.777577 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-a83b44f5-6d2e-4c50-9647-54efae59f175 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f55c571d3e1b43c1be99380f74610142'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:23.847765 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-a83b44f5-6d2e-4c50-9647-54efae59f175 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f55c571d3e1b43c1be99380f74610142'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:23.848486 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-a83b44f5-6d2e-4c50-9647-54efae59f175 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f55c571d3e1b43c1be99380f74610142'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:23.856066 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-a83b44f5-6d2e-4c50-9647-54efae59f175 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f55c571d3e1b43c1be99380f74610142'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:23.873888 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1261/2543] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:11:23 2022] DELETE /identity/v3/users/f55c571d3e1b43c1be99380f74610142 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:11:24.286578 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76911d5-58fb-42b8-a164-9a5ccf0a1e17 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:24.286578 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c76911d5-58fb-42b8-a164-9a5ccf0a1e17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:24.300957 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76911d5-58fb-42b8-a164-9a5ccf0a1e17 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:24.359306 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605d5d2-82a1-4d54-ad31-48d9d22e876d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:24.360234 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605d5d2-82a1-4d54-ad31-48d9d22e876d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:24.360522 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605d5d2-82a1-4d54-ad31-48d9d22e876d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:24.360804 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605d5d2-82a1-4d54-ad31-48d9d22e876d admin admin] PATH_INFO: `/v3/projects/a63ddfcad1134bf190e1b4e547d80c7b` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:24.361988 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9605d5d2-82a1-4d54-ad31-48d9d22e876d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a63ddfcad1134bf190e1b4e547d80c7b)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:24.363958 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9605d5d2-82a1-4d54-ad31-48d9d22e876d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:24.513272 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-9605d5d2-82a1-4d54-ad31-48d9d22e876d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a63ddfcad1134bf190e1b4e547d80c7b', 'request_id': 'req-9605d5d2-82a1-4d54-ad31-48d9d22e876d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:24.516104 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:11:24.653044 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-9605d5d2-82a1-4d54-ad31-48d9d22e876d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a63ddfcad1134bf190e1b4e547d80c7b', 'request_id': 'req-9605d5d2-82a1-4d54-ad31-48d9d22e876d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:24.658960 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-9605d5d2-82a1-4d54-ad31-48d9d22e876d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a63ddfcad1134bf190e1b4e547d80c7b', 'request_id': 'req-9605d5d2-82a1-4d54-ad31-48d9d22e876d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:24.670349 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-9605d5d2-82a1-4d54-ad31-48d9d22e876d admin admin] The token cache is being invalidate because project a63ddfcad1134bf190e1b4e547d80c7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:11:24.670736 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-9605d5d2-82a1-4d54-ad31-48d9d22e876d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:24.671440 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-9605d5d2-82a1-4d54-ad31-48d9d22e876d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:24.673065 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1283/2544] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:11:24 2022] DELETE /identity/v3/projects/a63ddfcad1134bf190e1b4e547d80c7b => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:11:24.678608 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b83a40-9ce8-4119-a72a-d3500176eba1 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:24.678953 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b83a40-9ce8-4119-a72a-d3500176eba1 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:24.679202 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b83a40-9ce8-4119-a72a-d3500176eba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:24.699667 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-43b83a40-9ce8-4119-a72a-d3500176eba1 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:11:24.700899 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-43b83a40-9ce8-4119-a72a-d3500176eba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:24.763104 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1262/2545] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:11:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:11:24.770725 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0db05-ba65-414b-9833-85be6d44cab2 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:24.771009 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0db05-ba65-414b-9833-85be6d44cab2 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:24.771316 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0db05-ba65-414b-9833-85be6d44cab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:24.790154 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-3cb0db05-ba65-414b-9833-85be6d44cab2 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:11:24.791345 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-3cb0db05-ba65-414b-9833-85be6d44cab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:24.799217 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1284/2546] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:11:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:11:24.804254 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b83a40-9ce8-4119-a72a-d3500176eba1 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:24.814240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b83a40-9ce8-4119-a72a-d3500176eba1 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:24.821153 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205443a0-ef9e-46e8-8abb-88541b6bc745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:24.821968 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205443a0-ef9e-46e8-8abb-88541b6bc745 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:24.824970 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205443a0-ef9e-46e8-8abb-88541b6bc745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:24.824970 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205443a0-ef9e-46e8-8abb-88541b6bc745 admin admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:24.824970 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205443a0-ef9e-46e8-8abb-88541b6bc745 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:11:24.824970 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205443a0-ef9e-46e8-8abb-88541b6bc745 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:24.825331 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205443a0-ef9e-46e8-8abb-88541b6bc745 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:24.835091 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:11:24.841906 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1263/2547] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:11:24.845900 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0db05-ba65-414b-9833-85be6d44cab2 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:24.856336 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0db05-ba65-414b-9833-85be6d44cab2 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:24.861375 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88baa3fb-a061-41ce-95e6-b17010ad968e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:24.862058 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88baa3fb-a061-41ce-95e6-b17010ad968e admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:24.862923 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88baa3fb-a061-41ce-95e6-b17010ad968e admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:24.863323 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88baa3fb-a061-41ce-95e6-b17010ad968e admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:24.864081 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88baa3fb-a061-41ce-95e6-b17010ad968e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:24.866011 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88baa3fb-a061-41ce-95e6-b17010ad968e admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:25.008658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1285/2548] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:11:24 2022] POST /identity/v3/projects => generated 381 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:11:25.009813 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205443a0-ef9e-46e8-8abb-88541b6bc745 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:25.024060 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205443a0-ef9e-46e8-8abb-88541b6bc745 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:25.085237 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29c9c0-5f29-4ba0-989f-9c70ad82fa51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:25.085909 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29c9c0-5f29-4ba0-989f-9c70ad82fa51 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:25.086240 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29c9c0-5f29-4ba0-989f-9c70ad82fa51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:25.086518 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29c9c0-5f29-4ba0-989f-9c70ad82fa51 admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:25.087206 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da29c9c0-5f29-4ba0-989f-9c70ad82fa51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:25.089187 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da29c9c0-5f29-4ba0-989f-9c70ad82fa51 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:25.197855 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1264/2549] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:11:25 2022] POST /identity/v3/users => generated 291 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 04:11:25.202092 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88baa3fb-a061-41ce-95e6-b17010ad968e admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:25.212644 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88baa3fb-a061-41ce-95e6-b17010ad968e admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:25.217361 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861748d3-932f-43d2-9200-9ed332de67e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:25.218115 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861748d3-932f-43d2-9200-9ed332de67e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:25.218397 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861748d3-932f-43d2-9200-9ed332de67e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:25.218672 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861748d3-932f-43d2-9200-9ed332de67e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:25.219411 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861748d3-932f-43d2-9200-9ed332de67e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:25.221097 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861748d3-932f-43d2-9200-9ed332de67e8 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:25.231962 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1286/2550] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:11:25.236120 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29c9c0-5f29-4ba0-989f-9c70ad82fa51 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:25.246567 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29c9c0-5f29-4ba0-989f-9c70ad82fa51 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:25.251331 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b4a91-9961-46fc-8e39-06b8b0715dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:25.252037 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b4a91-9961-46fc-8e39-06b8b0715dba admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:25.252320 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b4a91-9961-46fc-8e39-06b8b0715dba admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:25.252598 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b4a91-9961-46fc-8e39-06b8b0715dba admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:25.253965 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b4a91-9961-46fc-8e39-06b8b0715dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:25.255588 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b4a91-9961-46fc-8e39-06b8b0715dba admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:25.265813 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1265/2551] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:11:25.270100 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861748d3-932f-43d2-9200-9ed332de67e8 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:25.280187 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861748d3-932f-43d2-9200-9ed332de67e8 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:25.284850 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4821b-0d21-41a2-9192-9553dd12fdae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:25.285726 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4821b-0d21-41a2-9192-9553dd12fdae admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:25.286005 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4821b-0d21-41a2-9192-9553dd12fdae admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:25.286280 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4821b-0d21-41a2-9192-9553dd12fdae admin admin] PATH_INFO: `/v3/projects/bc23d7cb6e29444187a7cfea4525d923/users/c98d603d144d4c0d94ca9531cadbb88e/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:25.301919 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a4821b-0d21-41a2-9192-9553dd12fdae admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc23d7cb6e29444187a7cfea4525d923, user_id=c98d603d144d4c0d94ca9531cadbb88e, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:25.304767 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a4821b-0d21-41a2-9192-9553dd12fdae admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:25.402742 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1287/2552] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:11:25 2022] PUT /identity/v3/projects/bc23d7cb6e29444187a7cfea4525d923/users/c98d603d144d4c0d94ca9531cadbb88e/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:11:25.413645 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48dfcf6-0e5b-48dd-9b0c-f0544743061e None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:25.413933 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48dfcf6-0e5b-48dd-9b0c-f0544743061e None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:25.414211 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48dfcf6-0e5b-48dd-9b0c-f0544743061e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:25.440695 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-c48dfcf6-0e5b-48dd-9b0c-f0544743061e None None] MFA Rules not processed for user `c98d603d144d4c0d94ca9531cadbb88e`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:11:25.441886 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-c48dfcf6-0e5b-48dd-9b0c-f0544743061e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:25.508759 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1266/2553] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:11:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:11:25.516300 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4821b-0d21-41a2-9192-9553dd12fdae admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:25.579636 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4821b-0d21-41a2-9192-9553dd12fdae admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:25.584414 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552933cf-d06d-4246-a7d2-3683fb09680b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:25.585087 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552933cf-d06d-4246-a7d2-3683fb09680b admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:25.585372 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552933cf-d06d-4246-a7d2-3683fb09680b admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:25.585652 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552933cf-d06d-4246-a7d2-3683fb09680b admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:25.586365 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552933cf-d06d-4246-a7d2-3683fb09680b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:25.588404 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552933cf-d06d-4246-a7d2-3683fb09680b admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:25.690174 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1288/2554] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:11:25 2022] POST /identity/v3/projects => generated 385 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:11:25.694429 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48dfcf6-0e5b-48dd-9b0c-f0544743061e None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:25.705587 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48dfcf6-0e5b-48dd-9b0c-f0544743061e None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:25.765540 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161df9e-d7f1-4bdc-84c8-985a5bdba201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:25.766270 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161df9e-d7f1-4bdc-84c8-985a5bdba201 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:25.766552 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161df9e-d7f1-4bdc-84c8-985a5bdba201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:25.766824 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161df9e-d7f1-4bdc-84c8-985a5bdba201 admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:25.767588 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e161df9e-d7f1-4bdc-84c8-985a5bdba201 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:25.769500 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e161df9e-d7f1-4bdc-84c8-985a5bdba201 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:25.777069 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:11:25.957634 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1267/2555] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:11:25 2022] POST /identity/v3/users => generated 299 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:11:25.962375 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552933cf-d06d-4246-a7d2-3683fb09680b admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:25.974010 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552933cf-d06d-4246-a7d2-3683fb09680b admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:25.979010 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e4bdd9-978b-4c47-b42b-9f83a28feef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:25.979715 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4bdd9-978b-4c47-b42b-9f83a28feef6 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:25.980001 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4bdd9-978b-4c47-b42b-9f83a28feef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:25.980280 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4bdd9-978b-4c47-b42b-9f83a28feef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:25.981006 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e4bdd9-978b-4c47-b42b-9f83a28feef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:25.982614 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e4bdd9-978b-4c47-b42b-9f83a28feef6 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:25.993506 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1289/2556] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:11:25.997614 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161df9e-d7f1-4bdc-84c8-985a5bdba201 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:26.009373 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161df9e-d7f1-4bdc-84c8-985a5bdba201 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:26.014126 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac16763-5128-4381-bea4-84f0c23c964d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:26.015017 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac16763-5128-4381-bea4-84f0c23c964d admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:26.015299 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac16763-5128-4381-bea4-84f0c23c964d admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:26.015719 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac16763-5128-4381-bea4-84f0c23c964d admin admin] PATH_INFO: `/v3/projects/3e8d7a1a63694782a3d0df5ebc27c09b/users/c7cd1d9de51b4981998b98e42c8668da/roles/681755518698445fabd9a8accec13c0f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:26.031066 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac16763-5128-4381-bea4-84f0c23c964d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e8d7a1a63694782a3d0df5ebc27c09b, user_id=c7cd1d9de51b4981998b98e42c8668da, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:26.033788 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac16763-5128-4381-bea4-84f0c23c964d admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:26.118162 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1268/2557] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:11:25 2022] PUT /identity/v3/projects/3e8d7a1a63694782a3d0df5ebc27c09b/users/c7cd1d9de51b4981998b98e42c8668da/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:11:26.129920 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e4bdd9-978b-4c47-b42b-9f83a28feef6 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:26.140289 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e4bdd9-978b-4c47-b42b-9f83a28feef6 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:26.198158 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:11:26.218177 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12113a-0774-4f02-b4a5-823c00ea30b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:26.219567 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12113a-0774-4f02-b4a5-823c00ea30b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:26.219567 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12113a-0774-4f02-b4a5-823c00ea30b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:26.219860 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12113a-0774-4f02-b4a5-823c00ea30b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:26.220631 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae12113a-0774-4f02-b4a5-823c00ea30b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:26.222906 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae12113a-0774-4f02-b4a5-823c00ea30b6 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:26.236163 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1290/2558] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 04:11:26.238966 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac16763-5128-4381-bea4-84f0c23c964d admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:26.249552 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac16763-5128-4381-bea4-84f0c23c964d admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:26.255087 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37e746-be33-46ae-8910-252e6b044b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:26.256005 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37e746-be33-46ae-8910-252e6b044b04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:26.256294 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37e746-be33-46ae-8910-252e6b044b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:26.256571 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37e746-be33-46ae-8910-252e6b044b04 admin admin] PATH_INFO: `/v3/projects/3e8d7a1a63694782a3d0df5ebc27c09b/users/c7cd1d9de51b4981998b98e42c8668da/roles/681755518698445fabd9a8accec13c0f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:26.258763 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e37e746-be33-46ae-8910-252e6b044b04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e8d7a1a63694782a3d0df5ebc27c09b, user_id=c7cd1d9de51b4981998b98e42c8668da, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:26.261505 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e37e746-be33-46ae-8910-252e6b044b04 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:26.273064 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1269/2559] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:11:26 2022] PUT /identity/v3/projects/3e8d7a1a63694782a3d0df5ebc27c09b/users/c7cd1d9de51b4981998b98e42c8668da/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:11:26.284531 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c76b8-ba29-411e-aba9-5947e3cc5746 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:26.284969 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c76b8-ba29-411e-aba9-5947e3cc5746 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:26.285289 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c76b8-ba29-411e-aba9-5947e3cc5746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:26.313147 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-547c76b8-ba29-411e-aba9-5947e3cc5746 None None] MFA Rules not processed for user `c7cd1d9de51b4981998b98e42c8668da`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:11:26.314395 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-547c76b8-ba29-411e-aba9-5947e3cc5746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:26.384139 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1291/2560] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:11:26 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:11:26.395884 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37e746-be33-46ae-8910-252e6b044b04 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:26.397558 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-7e37e746-be33-46ae-8910-252e6b044b04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:26.455582 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37e746-be33-46ae-8910-252e6b044b04 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:26.459979 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fca064f-ef78-4f14-ae19-e25991094c60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:26.460623 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca064f-ef78-4f14-ae19-e25991094c60 service cinder] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:26.460903 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca064f-ef78-4f14-ae19-e25991094c60 service cinder] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:26.461179 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca064f-ef78-4f14-ae19-e25991094c60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:26.525419 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fca064f-ef78-4f14-ae19-e25991094c60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:26.526976 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fca064f-ef78-4f14-ae19-e25991094c60 service cinder] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:26.535933 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1270/2561] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:11:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 04:11:32.318571 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c76b8-ba29-411e-aba9-5947e3cc5746 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:32.320697 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-547c76b8-ba29-411e-aba9-5947e3cc5746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:32.332947 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c76b8-ba29-411e-aba9-5947e3cc5746 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:32.337213 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd4e3d-8304-45ed-80c5-e7896cf2b515 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:32.337945 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd4e3d-8304-45ed-80c5-e7896cf2b515 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:32.338162 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd4e3d-8304-45ed-80c5-e7896cf2b515 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:32.338493 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd4e3d-8304-45ed-80c5-e7896cf2b515 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:32.360859 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fd4e3d-8304-45ed-80c5-e7896cf2b515 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:32.360859 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fd4e3d-8304-45ed-80c5-e7896cf2b515 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:32.367172 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1292/2562] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:11:32 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:11:33.470578 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288c305-b67c-492f-990c-ce0a86350379 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:33.471557 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288c305-b67c-492f-990c-ce0a86350379 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:33.471866 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288c305-b67c-492f-990c-ce0a86350379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:33.491751 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-5288c305-b67c-492f-990c-ce0a86350379 None None] MFA Rules not processed for user `dd41221abea04808bed5ef4ac4528c62`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:11:33.492973 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-5288c305-b67c-492f-990c-ce0a86350379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:33.552430 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1271/2563] 10.222.0.46 () {58 vars in 1009 bytes} [Fri Jul 1 04:11:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:11:33.732591 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd4e3d-8304-45ed-80c5-e7896cf2b515 service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:33.734384 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a6fd4e3d-8304-45ed-80c5-e7896cf2b515 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:33.810956 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd4e3d-8304-45ed-80c5-e7896cf2b515 service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:33.816720 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3828c8-7c91-4161-91a6-ec842c46ea84 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83787880173b459c8975b834bd47a51a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:33.817404 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3828c8-7c91-4161-91a6-ec842c46ea84 service swift] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:33.817682 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3828c8-7c91-4161-91a6-ec842c46ea84 service swift] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:33.817963 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3828c8-7c91-4161-91a6-ec842c46ea84 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:33.826860 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3828c8-7c91-4161-91a6-ec842c46ea84 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:33.828502 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3828c8-7c91-4161-91a6-ec842c46ea84 service swift] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:33.837892 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1293/2564] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Jul 1 04:11:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 04:11:35.183361 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288c305-b67c-492f-990c-ce0a86350379 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:35.185629 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-5288c305-b67c-492f-990c-ce0a86350379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:35.204989 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:11:35.277602 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288c305-b67c-492f-990c-ce0a86350379 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:35.285029 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8c659-b146-4737-b820-c2e082669242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:35.285831 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8c659-b146-4737-b820-c2e082669242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:35.286010 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8c659-b146-4737-b820-c2e082669242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:35.286290 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8c659-b146-4737-b820-c2e082669242 admin admin] PATH_INFO: `/v3/users/f3d2af465e624b86a0af448258ca4c97` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:35.287579 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c8c659-b146-4737-b820-c2e082669242 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3d2af465e624b86a0af448258ca4c97)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:35.289791 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c8c659-b146-4737-b820-c2e082669242 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:35.479173 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-07c8c659-b146-4737-b820-c2e082669242 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3d2af465e624b86a0af448258ca4c97'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:35.480650 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-07c8c659-b146-4737-b820-c2e082669242 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3d2af465e624b86a0af448258ca4c97'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:35.576879 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-07c8c659-b146-4737-b820-c2e082669242 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3d2af465e624b86a0af448258ca4c97'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:35.580099 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-07c8c659-b146-4737-b820-c2e082669242 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3d2af465e624b86a0af448258ca4c97'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:35.594176 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-07c8c659-b146-4737-b820-c2e082669242 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3d2af465e624b86a0af448258ca4c97'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:35.618744 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1272/2565] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:11:35 2022] DELETE /identity/v3/users/f3d2af465e624b86a0af448258ca4c97 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:11:35.961261 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3828c8-7c91-4161-91a6-ec842c46ea84 service swift] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:36.011194 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3828c8-7c91-4161-91a6-ec842c46ea84 service swift] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:36.139229 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:11:36.203711 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37a1a94-d36a-4b94-bc98-d39b89e3f398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:36.203711 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a1a94-d36a-4b94-bc98-d39b89e3f398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:36.203711 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a1a94-d36a-4b94-bc98-d39b89e3f398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:36.203711 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a1a94-d36a-4b94-bc98-d39b89e3f398 admin admin] PATH_INFO: `/v3/projects/14c7d7f868d24c839c0152995312908e` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:36.204462 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37a1a94-d36a-4b94-bc98-d39b89e3f398 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14c7d7f868d24c839c0152995312908e)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:36.205789 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37a1a94-d36a-4b94-bc98-d39b89e3f398 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:36.377656 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c37a1a94-d36a-4b94-bc98-d39b89e3f398 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14c7d7f868d24c839c0152995312908e', 'request_id': 'req-c37a1a94-d36a-4b94-bc98-d39b89e3f398'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:36.476472 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c37a1a94-d36a-4b94-bc98-d39b89e3f398 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14c7d7f868d24c839c0152995312908e', 'request_id': 'req-c37a1a94-d36a-4b94-bc98-d39b89e3f398'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:36.489048 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c37a1a94-d36a-4b94-bc98-d39b89e3f398 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14c7d7f868d24c839c0152995312908e', 'request_id': 'req-c37a1a94-d36a-4b94-bc98-d39b89e3f398'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:36.504926 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c37a1a94-d36a-4b94-bc98-d39b89e3f398 admin admin] The token cache is being invalidate because project 14c7d7f868d24c839c0152995312908e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:11:36.505200 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c37a1a94-d36a-4b94-bc98-d39b89e3f398 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:36.505958 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c37a1a94-d36a-4b94-bc98-d39b89e3f398 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:36.519492 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1294/2566] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:11:35 2022] DELETE /identity/v3/projects/14c7d7f868d24c839c0152995312908e => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:11:38.783820 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8c659-b146-4737-b820-c2e082669242 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:38.793514 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-07c8c659-b146-4737-b820-c2e082669242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:38.803577 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8c659-b146-4737-b820-c2e082669242 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:38.888311 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c97b1-fa3b-4108-8b81-bfd1e098e406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:38.889359 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c97b1-fa3b-4108-8b81-bfd1e098e406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:38.890816 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c97b1-fa3b-4108-8b81-bfd1e098e406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:38.890816 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c97b1-fa3b-4108-8b81-bfd1e098e406 admin admin] PATH_INFO: `/v3/users/c98d603d144d4c0d94ca9531cadbb88e` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:38.891491 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8c97b1-fa3b-4108-8b81-bfd1e098e406 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c98d603d144d4c0d94ca9531cadbb88e)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:38.894321 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8c97b1-fa3b-4108-8b81-bfd1e098e406 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:39.108786 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:11:39.119387 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-da8c97b1-fa3b-4108-8b81-bfd1e098e406 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c98d603d144d4c0d94ca9531cadbb88e'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:39.120378 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-da8c97b1-fa3b-4108-8b81-bfd1e098e406 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c98d603d144d4c0d94ca9531cadbb88e'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:39.235198 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-da8c97b1-fa3b-4108-8b81-bfd1e098e406 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c98d603d144d4c0d94ca9531cadbb88e'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:39.236369 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-da8c97b1-fa3b-4108-8b81-bfd1e098e406 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c98d603d144d4c0d94ca9531cadbb88e'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:39.245180 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-da8c97b1-fa3b-4108-8b81-bfd1e098e406 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c98d603d144d4c0d94ca9531cadbb88e'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:39.286941 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1273/2567] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:11:38 2022] DELETE /identity/v3/users/c98d603d144d4c0d94ca9531cadbb88e => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:11:39.294288 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4b51a-686b-42a6-ae64-d8c407e7576f None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:39.294867 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4b51a-686b-42a6-ae64-d8c407e7576f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:39.295186 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4b51a-686b-42a6-ae64-d8c407e7576f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:39.317577 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-cae4b51a-686b-42a6-ae64-d8c407e7576f None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:11:39.318814 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-cae4b51a-686b-42a6-ae64-d8c407e7576f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:39.411183 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1295/2568] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:11:39.421859 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c97b1-fa3b-4108-8b81-bfd1e098e406 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:39.423413 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-da8c97b1-fa3b-4108-8b81-bfd1e098e406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:39.499396 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c97b1-fa3b-4108-8b81-bfd1e098e406 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:39.504053 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e82bf2-0e9c-4d9e-aae7-28d4ee2da3bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:39.504769 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e82bf2-0e9c-4d9e-aae7-28d4ee2da3bc service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:39.505058 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e82bf2-0e9c-4d9e-aae7-28d4ee2da3bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:39.505321 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e82bf2-0e9c-4d9e-aae7-28d4ee2da3bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:39.515849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e82bf2-0e9c-4d9e-aae7-28d4ee2da3bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:39.517841 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e82bf2-0e9c-4d9e-aae7-28d4ee2da3bc service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:39.530343 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1274/2569] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:11:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:11:40.381242 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae4b51a-686b-42a6-ae64-d8c407e7576f None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:40.382734 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-cae4b51a-686b-42a6-ae64-d8c407e7576f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:40.395076 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae4b51a-686b-42a6-ae64-d8c407e7576f None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:40.399989 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb657e-3882-4238-970a-d0fc90999a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:40.400885 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb657e-3882-4238-970a-d0fc90999a98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:40.401175 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb657e-3882-4238-970a-d0fc90999a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:40.401505 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb657e-3882-4238-970a-d0fc90999a98 admin admin] PATH_INFO: `/v3/projects/bc23d7cb6e29444187a7cfea4525d923` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:40.402756 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb657e-3882-4238-970a-d0fc90999a98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc23d7cb6e29444187a7cfea4525d923)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:40.404808 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb657e-3882-4238-970a-d0fc90999a98 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:40.579551 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a4fb657e-3882-4238-970a-d0fc90999a98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc23d7cb6e29444187a7cfea4525d923', 'request_id': 'req-a4fb657e-3882-4238-970a-d0fc90999a98'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:40.677020 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a4fb657e-3882-4238-970a-d0fc90999a98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc23d7cb6e29444187a7cfea4525d923', 'request_id': 'req-a4fb657e-3882-4238-970a-d0fc90999a98'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:40.686087 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a4fb657e-3882-4238-970a-d0fc90999a98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc23d7cb6e29444187a7cfea4525d923', 'request_id': 'req-a4fb657e-3882-4238-970a-d0fc90999a98'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:40.695182 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:11:40.700955 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a4fb657e-3882-4238-970a-d0fc90999a98 admin admin] The token cache is being invalidate because project bc23d7cb6e29444187a7cfea4525d923 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:11:40.700955 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a4fb657e-3882-4238-970a-d0fc90999a98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:40.701466 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a4fb657e-3882-4238-970a-d0fc90999a98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:40.703381 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1296/2570] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:11:40 2022] DELETE /identity/v3/projects/bc23d7cb6e29444187a7cfea4525d923 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:11:40.709681 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e82bf2-0e9c-4d9e-aae7-28d4ee2da3bc service neutron] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:40.725326 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e82bf2-0e9c-4d9e-aae7-28d4ee2da3bc service neutron] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:40.800512 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d49070f-9cbc-4c40-9651-0266d7593901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:40.801427 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49070f-9cbc-4c40-9651-0266d7593901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:40.801708 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49070f-9cbc-4c40-9651-0266d7593901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:40.801982 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49070f-9cbc-4c40-9651-0266d7593901 admin admin] PATH_INFO: `/v3/users/c7cd1d9de51b4981998b98e42c8668da` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:40.803212 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d49070f-9cbc-4c40-9651-0266d7593901 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7cd1d9de51b4981998b98e42c8668da)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:40.805382 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d49070f-9cbc-4c40-9651-0266d7593901 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:41.026643 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-6d49070f-9cbc-4c40-9651-0266d7593901 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7cd1d9de51b4981998b98e42c8668da'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:41.029178 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-6d49070f-9cbc-4c40-9651-0266d7593901 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7cd1d9de51b4981998b98e42c8668da'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:41.105592 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-6d49070f-9cbc-4c40-9651-0266d7593901 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7cd1d9de51b4981998b98e42c8668da'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:41.106463 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-6d49070f-9cbc-4c40-9651-0266d7593901 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7cd1d9de51b4981998b98e42c8668da'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:41.109458 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:11:41.136184 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-6d49070f-9cbc-4c40-9651-0266d7593901 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7cd1d9de51b4981998b98e42c8668da'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:41.163578 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1275/2571] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:11:40 2022] DELETE /identity/v3/users/c7cd1d9de51b4981998b98e42c8668da => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:11:41.866405 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb657e-3882-4238-970a-d0fc90999a98 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:41.871080 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a4fb657e-3882-4238-970a-d0fc90999a98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:41.897718 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb657e-3882-4238-970a-d0fc90999a98 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:41.990194 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1cacfe-f287-4941-bd9a-2ce82ffbf372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:41.991592 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1cacfe-f287-4941-bd9a-2ce82ffbf372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:41.994013 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1cacfe-f287-4941-bd9a-2ce82ffbf372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:41.994492 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1cacfe-f287-4941-bd9a-2ce82ffbf372 admin admin] PATH_INFO: `/v3/projects/3e8d7a1a63694782a3d0df5ebc27c09b` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:41.996059 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1cacfe-f287-4941-bd9a-2ce82ffbf372 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e8d7a1a63694782a3d0df5ebc27c09b)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:41.998300 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1cacfe-f287-4941-bd9a-2ce82ffbf372 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:42.146200 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-1f1cacfe-f287-4941-bd9a-2ce82ffbf372 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e8d7a1a63694782a3d0df5ebc27c09b', 'request_id': 'req-1f1cacfe-f287-4941-bd9a-2ce82ffbf372'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:42.293826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-1f1cacfe-f287-4941-bd9a-2ce82ffbf372 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e8d7a1a63694782a3d0df5ebc27c09b', 'request_id': 'req-1f1cacfe-f287-4941-bd9a-2ce82ffbf372'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:42.302356 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-1f1cacfe-f287-4941-bd9a-2ce82ffbf372 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e8d7a1a63694782a3d0df5ebc27c09b', 'request_id': 'req-1f1cacfe-f287-4941-bd9a-2ce82ffbf372'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:42.319227 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-1f1cacfe-f287-4941-bd9a-2ce82ffbf372 admin admin] The token cache is being invalidate because project 3e8d7a1a63694782a3d0df5ebc27c09b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:11:42.319435 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-1f1cacfe-f287-4941-bd9a-2ce82ffbf372 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:42.321806 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-1f1cacfe-f287-4941-bd9a-2ce82ffbf372 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:42.324303 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1297/2572] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:11:41 2022] DELETE /identity/v3/projects/3e8d7a1a63694782a3d0df5ebc27c09b => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:11:42.330379 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e7657-792a-41f8-8f82-f23877966959 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:42.330379 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e7657-792a-41f8-8f82-f23877966959 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:42.330874 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e7657-792a-41f8-8f82-f23877966959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:42.355821 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-3b1e7657-792a-41f8-8f82-f23877966959 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:11:42.357771 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-3b1e7657-792a-41f8-8f82-f23877966959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:42.497076 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1276/2573] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:11:42.499095 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e45608-514e-4f15-9fe6-779c31c8057d None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:42.499601 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e45608-514e-4f15-9fe6-779c31c8057d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:42.500038 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e45608-514e-4f15-9fe6-779c31c8057d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:42.525262 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-49e45608-514e-4f15-9fe6-779c31c8057d None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:11:42.526819 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-49e45608-514e-4f15-9fe6-779c31c8057d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:42.536911 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1298/2574] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:11:42.541628 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e7657-792a-41f8-8f82-f23877966959 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:42.552862 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e7657-792a-41f8-8f82-f23877966959 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:42.557843 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd90a48-5457-490f-9b73-86e5e3d70de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:42.558517 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd90a48-5457-490f-9b73-86e5e3d70de0 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:42.558802 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd90a48-5457-490f-9b73-86e5e3d70de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:42.559080 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd90a48-5457-490f-9b73-86e5e3d70de0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:42.559854 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd90a48-5457-490f-9b73-86e5e3d70de0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:11:42.560164 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd90a48-5457-490f-9b73-86e5e3d70de0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:42.561777 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd90a48-5457-490f-9b73-86e5e3d70de0 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:42.582931 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1277/2575] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:11:42.588106 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e45608-514e-4f15-9fe6-779c31c8057d None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:42.600828 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e45608-514e-4f15-9fe6-779c31c8057d None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:42.607550 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e74e19-275e-4e04-b93b-f8d741c997a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:42.608466 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e74e19-275e-4e04-b93b-f8d741c997a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:42.608951 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e74e19-275e-4e04-b93b-f8d741c997a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:42.609392 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e74e19-275e-4e04-b93b-f8d741c997a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:42.610974 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e74e19-275e-4e04-b93b-f8d741c997a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:42.613674 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e74e19-275e-4e04-b93b-f8d741c997a2 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:42.693334 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1299/2576] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:11:42 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:11:42.693520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd90a48-5457-490f-9b73-86e5e3d70de0 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:42.707227 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd90a48-5457-490f-9b73-86e5e3d70de0 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:42.782677 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03e0d0c-1609-40f7-b3b8-4177b6eedf58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:42.783374 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e0d0c-1609-40f7-b3b8-4177b6eedf58 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:42.783870 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e0d0c-1609-40f7-b3b8-4177b6eedf58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:42.784162 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e0d0c-1609-40f7-b3b8-4177b6eedf58 admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:42.785656 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03e0d0c-1609-40f7-b3b8-4177b6eedf58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:42.788340 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03e0d0c-1609-40f7-b3b8-4177b6eedf58 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:42.890726 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1278/2577] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:11:42 2022] POST /identity/v3/users => generated 287 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:11:42.895142 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e74e19-275e-4e04-b93b-f8d741c997a2 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:42.914066 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e74e19-275e-4e04-b93b-f8d741c997a2 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:42.919774 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104a201-4a03-46ae-a560-7cabf815a0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:42.920619 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104a201-4a03-46ae-a560-7cabf815a0e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:42.921122 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104a201-4a03-46ae-a560-7cabf815a0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:42.921446 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104a201-4a03-46ae-a560-7cabf815a0e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:42.922287 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5104a201-4a03-46ae-a560-7cabf815a0e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:42.924004 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5104a201-4a03-46ae-a560-7cabf815a0e2 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:42.942912 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03e0d0c-1609-40f7-b3b8-4177b6eedf58 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:42.952148 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1300/2578] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:11:42.955052 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03e0d0c-1609-40f7-b3b8-4177b6eedf58 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:42.960170 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b4611-8b26-4461-a265-10e1d69d31a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:42.960851 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b4611-8b26-4461-a265-10e1d69d31a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:42.961139 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b4611-8b26-4461-a265-10e1d69d31a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:42.961505 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b4611-8b26-4461-a265-10e1d69d31a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:42.962373 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31b4611-8b26-4461-a265-10e1d69d31a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:42.964057 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31b4611-8b26-4461-a265-10e1d69d31a8 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:42.986226 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1279/2579] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:11:42.987275 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104a201-4a03-46ae-a560-7cabf815a0e2 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:42.998934 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104a201-4a03-46ae-a560-7cabf815a0e2 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:43.006817 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156896bc-78b7-4da3-b793-efc50baa0161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:43.011633 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156896bc-78b7-4da3-b793-efc50baa0161 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:43.012216 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156896bc-78b7-4da3-b793-efc50baa0161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:43.012663 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156896bc-78b7-4da3-b793-efc50baa0161 admin admin] PATH_INFO: `/v3/projects/5d016032775c4fa6b03b16f1e4d65887/users/751d76dcef99498d865298b70788a421/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:43.047982 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156896bc-78b7-4da3-b793-efc50baa0161 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d016032775c4fa6b03b16f1e4d65887, user_id=751d76dcef99498d865298b70788a421, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:43.051581 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156896bc-78b7-4da3-b793-efc50baa0161 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:43.147132 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1301/2580] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:11:42 2022] PUT /identity/v3/projects/5d016032775c4fa6b03b16f1e4d65887/users/751d76dcef99498d865298b70788a421/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:11:43.168306 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea6dc1-88fe-46da-88df-66fa0ab455a3 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:43.168587 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea6dc1-88fe-46da-88df-66fa0ab455a3 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:43.168893 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea6dc1-88fe-46da-88df-66fa0ab455a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:43.201901 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-86ea6dc1-88fe-46da-88df-66fa0ab455a3 None None] MFA Rules not processed for user `751d76dcef99498d865298b70788a421`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:11:43.203283 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-86ea6dc1-88fe-46da-88df-66fa0ab455a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:43.245148 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:11:43.293501 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1280/2581] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:11:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:11:43.308897 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156896bc-78b7-4da3-b793-efc50baa0161 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:43.310756 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-156896bc-78b7-4da3-b793-efc50baa0161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:43.353016 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:11:43.389335 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156896bc-78b7-4da3-b793-efc50baa0161 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:43.394793 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d8202-cbff-4624-981b-7948fa55ac4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:43.395901 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d8202-cbff-4624-981b-7948fa55ac4c service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:43.396710 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d8202-cbff-4624-981b-7948fa55ac4c service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:43.397508 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d8202-cbff-4624-981b-7948fa55ac4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:43.408559 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d8202-cbff-4624-981b-7948fa55ac4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:43.410120 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d8202-cbff-4624-981b-7948fa55ac4c service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:43.423498 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1302/2582] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:11:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:11:43.448062 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ea6dc1-88fe-46da-88df-66fa0ab455a3 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:43.535661 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ea6dc1-88fe-46da-88df-66fa0ab455a3 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:43.547648 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c40314-b162-4512-bee8-57b2f9e06c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:43.548725 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c40314-b162-4512-bee8-57b2f9e06c0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:43.549121 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c40314-b162-4512-bee8-57b2f9e06c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:43.549497 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c40314-b162-4512-bee8-57b2f9e06c0d admin admin] PATH_INFO: `/v3/users/751d76dcef99498d865298b70788a421` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:43.551403 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c40314-b162-4512-bee8-57b2f9e06c0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=751d76dcef99498d865298b70788a421)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:43.553622 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c40314-b162-4512-bee8-57b2f9e06c0d admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:44.000736 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-33c40314-b162-4512-bee8-57b2f9e06c0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '751d76dcef99498d865298b70788a421'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:44.008755 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-33c40314-b162-4512-bee8-57b2f9e06c0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '751d76dcef99498d865298b70788a421'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:44.151089 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-33c40314-b162-4512-bee8-57b2f9e06c0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '751d76dcef99498d865298b70788a421'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:44.151718 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-33c40314-b162-4512-bee8-57b2f9e06c0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '751d76dcef99498d865298b70788a421'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:44.159590 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-33c40314-b162-4512-bee8-57b2f9e06c0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '751d76dcef99498d865298b70788a421'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:44.179080 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1281/2583] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:11:43 2022] DELETE /identity/v3/users/751d76dcef99498d865298b70788a421 => generated 0 bytes in 732 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:11:44.183946 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598beb8-2a16-4d87-9993-5da7645dcb34 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:44.184469 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598beb8-2a16-4d87-9993-5da7645dcb34 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:44.184565 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598beb8-2a16-4d87-9993-5da7645dcb34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:44.207832 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-d598beb8-2a16-4d87-9993-5da7645dcb34 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:11:44.207832 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d598beb8-2a16-4d87-9993-5da7645dcb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:44.268842 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1303/2584] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:11:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:11:44.278654 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c40314-b162-4512-bee8-57b2f9e06c0d admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:44.280123 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-33c40314-b162-4512-bee8-57b2f9e06c0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:44.346040 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:11:44.352007 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c40314-b162-4512-bee8-57b2f9e06c0d admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:44.356766 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eac737-1d3c-4b7a-92e1-91e3be1ac332 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:44.357546 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eac737-1d3c-4b7a-92e1-91e3be1ac332 service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:44.358174 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eac737-1d3c-4b7a-92e1-91e3be1ac332 service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:44.358583 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eac737-1d3c-4b7a-92e1-91e3be1ac332 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:44.372197 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eac737-1d3c-4b7a-92e1-91e3be1ac332 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:44.374852 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eac737-1d3c-4b7a-92e1-91e3be1ac332 service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:44.387762 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1282/2585] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:11:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:11:45.012075 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d598beb8-2a16-4d87-9993-5da7645dcb34 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:45.012075 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d598beb8-2a16-4d87-9993-5da7645dcb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:45.012075 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d598beb8-2a16-4d87-9993-5da7645dcb34 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:45.013156 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7b846-fb4d-4059-bf8e-1b3a7c351ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:45.013156 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7b846-fb4d-4059-bf8e-1b3a7c351ecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:45.013156 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7b846-fb4d-4059-bf8e-1b3a7c351ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:45.013156 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7b846-fb4d-4059-bf8e-1b3a7c351ecf admin admin] PATH_INFO: `/v3/projects/5d016032775c4fa6b03b16f1e4d65887` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:45.013823 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e7b846-fb4d-4059-bf8e-1b3a7c351ecf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d016032775c4fa6b03b16f1e4d65887)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:45.013823 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e7b846-fb4d-4059-bf8e-1b3a7c351ecf admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:45.237461 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-15e7b846-fb4d-4059-bf8e-1b3a7c351ecf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d016032775c4fa6b03b16f1e4d65887', 'request_id': 'req-15e7b846-fb4d-4059-bf8e-1b3a7c351ecf'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:45.317244 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-15e7b846-fb4d-4059-bf8e-1b3a7c351ecf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d016032775c4fa6b03b16f1e4d65887', 'request_id': 'req-15e7b846-fb4d-4059-bf8e-1b3a7c351ecf'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:45.324245 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-15e7b846-fb4d-4059-bf8e-1b3a7c351ecf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d016032775c4fa6b03b16f1e4d65887', 'request_id': 'req-15e7b846-fb4d-4059-bf8e-1b3a7c351ecf'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:45.337091 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-15e7b846-fb4d-4059-bf8e-1b3a7c351ecf admin admin] The token cache is being invalidate because project 5d016032775c4fa6b03b16f1e4d65887 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:11:45.337373 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-15e7b846-fb4d-4059-bf8e-1b3a7c351ecf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:45.338032 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-15e7b846-fb4d-4059-bf8e-1b3a7c351ecf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:45.339596 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1304/2586] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:11:44 2022] DELETE /identity/v3/projects/5d016032775c4fa6b03b16f1e4d65887 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:11:45.344792 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b84be-6f58-49d8-8564-2841a29909a2 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:45.345281 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b84be-6f58-49d8-8564-2841a29909a2 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:45.345378 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b84be-6f58-49d8-8564-2841a29909a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:45.363732 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-b52b84be-6f58-49d8-8564-2841a29909a2 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:11:45.364952 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-b52b84be-6f58-49d8-8564-2841a29909a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:45.430169 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1283/2587] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:11:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:11:45.439030 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cabe4e-987d-4c0a-a8b5-fa2b88f3fa40 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:45.441785 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cabe4e-987d-4c0a-a8b5-fa2b88f3fa40 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:45.441785 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cabe4e-987d-4c0a-a8b5-fa2b88f3fa40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:45.458532 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-66cabe4e-987d-4c0a-a8b5-fa2b88f3fa40 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:11:45.459753 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-66cabe4e-987d-4c0a-a8b5-fa2b88f3fa40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:45.467620 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1305/2588] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:11:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:11:45.472021 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b84be-6f58-49d8-8564-2841a29909a2 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:45.481602 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b84be-6f58-49d8-8564-2841a29909a2 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:45.486209 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5182a245-efc2-4d14-a9c4-5c2c05195fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:45.486866 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182a245-efc2-4d14-a9c4-5c2c05195fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:45.487149 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182a245-efc2-4d14-a9c4-5c2c05195fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:45.488001 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182a245-efc2-4d14-a9c4-5c2c05195fc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:45.489038 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5182a245-efc2-4d14-a9c4-5c2c05195fc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:11:45.489038 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5182a245-efc2-4d14-a9c4-5c2c05195fc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:45.490547 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5182a245-efc2-4d14-a9c4-5c2c05195fc7 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:45.502782 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1284/2589] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:11:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:11:45.507885 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cabe4e-987d-4c0a-a8b5-fa2b88f3fa40 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:45.520455 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cabe4e-987d-4c0a-a8b5-fa2b88f3fa40 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:45.528796 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2530b96-5343-4e88-8fd1-52d2a6a354c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:45.529920 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2530b96-5343-4e88-8fd1-52d2a6a354c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:45.530386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2530b96-5343-4e88-8fd1-52d2a6a354c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:45.530921 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2530b96-5343-4e88-8fd1-52d2a6a354c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:45.532327 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2530b96-5343-4e88-8fd1-52d2a6a354c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:45.536563 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2530b96-5343-4e88-8fd1-52d2a6a354c8 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:45.667678 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1306/2590] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:11:45 2022] POST /identity/v3/projects => generated 361 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:11:45.672649 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5182a245-efc2-4d14-a9c4-5c2c05195fc7 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:45.682915 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5182a245-efc2-4d14-a9c4-5c2c05195fc7 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:45.742997 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ee3fb-28bf-470d-a6e4-7f76f36fc219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:45.743621 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ee3fb-28bf-470d-a6e4-7f76f36fc219 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:45.743910 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ee3fb-28bf-470d-a6e4-7f76f36fc219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:45.744188 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ee3fb-28bf-470d-a6e4-7f76f36fc219 admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:45.744886 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ee3fb-28bf-470d-a6e4-7f76f36fc219 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:45.751630 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ee3fb-28bf-470d-a6e4-7f76f36fc219 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:45.856060 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1285/2591] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:11:45 2022] POST /identity/v3/users => generated 281 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:11:45.857223 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2530b96-5343-4e88-8fd1-52d2a6a354c8 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:45.867622 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2530b96-5343-4e88-8fd1-52d2a6a354c8 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:45.872256 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b25fd-d9cc-4cc2-b855-23452e8a6736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:45.872913 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b25fd-d9cc-4cc2-b855-23452e8a6736 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:45.873196 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b25fd-d9cc-4cc2-b855-23452e8a6736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:45.873501 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b25fd-d9cc-4cc2-b855-23452e8a6736 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:45.874258 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552b25fd-d9cc-4cc2-b855-23452e8a6736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:45.875911 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552b25fd-d9cc-4cc2-b855-23452e8a6736 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:45.887112 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1307/2592] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:11:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 04:11:45.891421 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ee3fb-28bf-470d-a6e4-7f76f36fc219 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:45.902305 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ee3fb-28bf-470d-a6e4-7f76f36fc219 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:45.906905 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160fe69-3eb8-4386-bdb7-965110097735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:45.907594 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160fe69-3eb8-4386-bdb7-965110097735 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:45.907894 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160fe69-3eb8-4386-bdb7-965110097735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:45.908168 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160fe69-3eb8-4386-bdb7-965110097735 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:45.908904 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160fe69-3eb8-4386-bdb7-965110097735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:45.911030 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160fe69-3eb8-4386-bdb7-965110097735 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:45.921412 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1286/2593] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:11:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 04:11:45.926356 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b25fd-d9cc-4cc2-b855-23452e8a6736 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:45.936303 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b25fd-d9cc-4cc2-b855-23452e8a6736 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:45.942584 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f48d2-1cac-42d4-a89b-58bcbb23d5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:45.943710 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f48d2-1cac-42d4-a89b-58bcbb23d5e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:45.943991 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f48d2-1cac-42d4-a89b-58bcbb23d5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:45.944266 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f48d2-1cac-42d4-a89b-58bcbb23d5e9 admin admin] PATH_INFO: `/v3/projects/68f0100e8fee4515a334df5905414a8e/users/bbd284dda83540c5b374e28a97778f1f/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:45.953598 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:11:45.961415 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2f48d2-1cac-42d4-a89b-58bcbb23d5e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68f0100e8fee4515a334df5905414a8e, user_id=bbd284dda83540c5b374e28a97778f1f, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:45.964549 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2f48d2-1cac-42d4-a89b-58bcbb23d5e9 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:46.030464 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1308/2594] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:11:45 2022] PUT /identity/v3/projects/68f0100e8fee4515a334df5905414a8e/users/bbd284dda83540c5b374e28a97778f1f/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:11:46.041725 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c4105-162f-4f8f-af1e-772579a5e13e None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:46.042095 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c4105-162f-4f8f-af1e-772579a5e13e None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:46.042440 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c4105-162f-4f8f-af1e-772579a5e13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:46.069766 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-b91c4105-162f-4f8f-af1e-772579a5e13e None None] MFA Rules not processed for user `bbd284dda83540c5b374e28a97778f1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:11:46.070998 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-b91c4105-162f-4f8f-af1e-772579a5e13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:46.116682 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:11:46.141636 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1287/2595] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:11:46 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:11:46.176590 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f48d2-1cac-42d4-a89b-58bcbb23d5e9 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:46.178310 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0c2f48d2-1cac-42d4-a89b-58bcbb23d5e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:46.241809 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f48d2-1cac-42d4-a89b-58bcbb23d5e9 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:46.245634 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2694d55-7f31-44aa-ba2c-3b9e581abbfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:46.246316 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2694d55-7f31-44aa-ba2c-3b9e581abbfc service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:46.246654 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2694d55-7f31-44aa-ba2c-3b9e581abbfc service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:46.246879 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2694d55-7f31-44aa-ba2c-3b9e581abbfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:46.256091 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2694d55-7f31-44aa-ba2c-3b9e581abbfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:46.257575 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2694d55-7f31-44aa-ba2c-3b9e581abbfc service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:46.267280 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1309/2596] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:11:46 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:11:46.281445 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c4105-162f-4f8f-af1e-772579a5e13e None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:46.348451 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c4105-162f-4f8f-af1e-772579a5e13e None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:46.353229 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8722f5-adbe-4542-92b7-c294d470ab8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:46.354111 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8722f5-adbe-4542-92b7-c294d470ab8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:46.354397 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8722f5-adbe-4542-92b7-c294d470ab8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:46.354708 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8722f5-adbe-4542-92b7-c294d470ab8c admin admin] PATH_INFO: `/v3/users/bbd284dda83540c5b374e28a97778f1f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:46.355930 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8722f5-adbe-4542-92b7-c294d470ab8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbd284dda83540c5b374e28a97778f1f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:46.357856 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8722f5-adbe-4542-92b7-c294d470ab8c admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:46.522947 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-4f8722f5-adbe-4542-92b7-c294d470ab8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbd284dda83540c5b374e28a97778f1f'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:46.524329 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-4f8722f5-adbe-4542-92b7-c294d470ab8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbd284dda83540c5b374e28a97778f1f'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:46.591236 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-4f8722f5-adbe-4542-92b7-c294d470ab8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbd284dda83540c5b374e28a97778f1f'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:46.592237 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-4f8722f5-adbe-4542-92b7-c294d470ab8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbd284dda83540c5b374e28a97778f1f'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:46.605610 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-4f8722f5-adbe-4542-92b7-c294d470ab8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbd284dda83540c5b374e28a97778f1f'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:46.630203 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1288/2597] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:11:46 2022] DELETE /identity/v3/users/bbd284dda83540c5b374e28a97778f1f => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:11:46.636157 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4da8b-773f-4d08-93b8-b2e757aeedfe None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:46.636440 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4da8b-773f-4d08-93b8-b2e757aeedfe None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:46.636709 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4da8b-773f-4d08-93b8-b2e757aeedfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:46.655853 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-75e4da8b-773f-4d08-93b8-b2e757aeedfe None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:11:46.657084 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-75e4da8b-773f-4d08-93b8-b2e757aeedfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:46.719663 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1310/2598] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:11:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 04:11:46.729520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8722f5-adbe-4542-92b7-c294d470ab8c admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:46.730913 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-4f8722f5-adbe-4542-92b7-c294d470ab8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:46.792783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8722f5-adbe-4542-92b7-c294d470ab8c admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:46.796467 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b161505-df27-46ea-b748-cd98f6af485f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:46.797112 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b161505-df27-46ea-b748-cd98f6af485f service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:46.797393 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b161505-df27-46ea-b748-cd98f6af485f service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:46.797663 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b161505-df27-46ea-b748-cd98f6af485f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:46.807373 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b161505-df27-46ea-b748-cd98f6af485f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:46.808944 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b161505-df27-46ea-b748-cd98f6af485f service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:46.819896 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1289/2599] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:11:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:11:47.266775 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4da8b-773f-4d08-93b8-b2e757aeedfe None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:47.268467 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-75e4da8b-773f-4d08-93b8-b2e757aeedfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:47.286345 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4da8b-773f-4d08-93b8-b2e757aeedfe None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:47.292100 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dfb2f5-557b-46bc-ab3c-7107d2e4851b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:47.293370 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfb2f5-557b-46bc-ab3c-7107d2e4851b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:47.293927 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfb2f5-557b-46bc-ab3c-7107d2e4851b admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:47.294268 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfb2f5-557b-46bc-ab3c-7107d2e4851b admin admin] PATH_INFO: `/v3/projects/68f0100e8fee4515a334df5905414a8e` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:47.295732 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dfb2f5-557b-46bc-ab3c-7107d2e4851b admin admin] RBAC: Authorizing `identity:delete_project(project_id=68f0100e8fee4515a334df5905414a8e)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:47.299122 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dfb2f5-557b-46bc-ab3c-7107d2e4851b admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:47.410995 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-83dfb2f5-557b-46bc-ab3c-7107d2e4851b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68f0100e8fee4515a334df5905414a8e', 'request_id': 'req-83dfb2f5-557b-46bc-ab3c-7107d2e4851b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:47.482966 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-83dfb2f5-557b-46bc-ab3c-7107d2e4851b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68f0100e8fee4515a334df5905414a8e', 'request_id': 'req-83dfb2f5-557b-46bc-ab3c-7107d2e4851b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:47.490491 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-83dfb2f5-557b-46bc-ab3c-7107d2e4851b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68f0100e8fee4515a334df5905414a8e', 'request_id': 'req-83dfb2f5-557b-46bc-ab3c-7107d2e4851b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:47.502641 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-83dfb2f5-557b-46bc-ab3c-7107d2e4851b admin admin] The token cache is being invalidate because project 68f0100e8fee4515a334df5905414a8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:11:47.503115 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-83dfb2f5-557b-46bc-ab3c-7107d2e4851b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:47.503972 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-83dfb2f5-557b-46bc-ab3c-7107d2e4851b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:47.505593 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1311/2600] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:11:47 2022] DELETE /identity/v3/projects/68f0100e8fee4515a334df5905414a8e => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:11:47.510523 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50cca5-64a4-48c4-a445-da11eef96e20 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:47.511039 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50cca5-64a4-48c4-a445-da11eef96e20 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:47.516095 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50cca5-64a4-48c4-a445-da11eef96e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:47.534948 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-dd50cca5-64a4-48c4-a445-da11eef96e20 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:11:47.536238 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-dd50cca5-64a4-48c4-a445-da11eef96e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:47.541039 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:11:47.607322 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1290/2601] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:11:47.616462 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62002351-44f2-450e-97c4-c98d72c8e7de None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:47.616770 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62002351-44f2-450e-97c4-c98d72c8e7de None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:47.617047 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62002351-44f2-450e-97c4-c98d72c8e7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:47.635918 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-62002351-44f2-450e-97c4-c98d72c8e7de None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:11:47.637145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-62002351-44f2-450e-97c4-c98d72c8e7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:47.646711 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1312/2602] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:11:47.657626 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50cca5-64a4-48c4-a445-da11eef96e20 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:47.668754 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50cca5-64a4-48c4-a445-da11eef96e20 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:47.673656 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce684c1-5c2d-4e8b-8278-92c74683052b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:47.674345 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce684c1-5c2d-4e8b-8278-92c74683052b admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:47.674629 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce684c1-5c2d-4e8b-8278-92c74683052b admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:47.674935 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce684c1-5c2d-4e8b-8278-92c74683052b admin admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:47.675722 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce684c1-5c2d-4e8b-8278-92c74683052b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:11:47.676032 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce684c1-5c2d-4e8b-8278-92c74683052b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:47.677734 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce684c1-5c2d-4e8b-8278-92c74683052b admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:47.694721 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1291/2603] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:11:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:11:47.699769 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62002351-44f2-450e-97c4-c98d72c8e7de None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:47.710094 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62002351-44f2-450e-97c4-c98d72c8e7de None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:47.715031 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d261a18-b732-4430-9643-ae7ba8e94db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:47.715740 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d261a18-b732-4430-9643-ae7ba8e94db3 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:47.716026 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d261a18-b732-4430-9643-ae7ba8e94db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:47.716303 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d261a18-b732-4430-9643-ae7ba8e94db3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:47.717019 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d261a18-b732-4430-9643-ae7ba8e94db3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:47.719022 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d261a18-b732-4430-9643-ae7ba8e94db3 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:47.723543 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:11:47.828979 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1313/2604] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:11:47 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:11:47.833892 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce684c1-5c2d-4e8b-8278-92c74683052b admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:47.844500 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce684c1-5c2d-4e8b-8278-92c74683052b admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:47.907410 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c226d-4912-48e2-a721-9e323a4c9331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:47.908181 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c226d-4912-48e2-a721-9e323a4c9331 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:47.908425 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c226d-4912-48e2-a721-9e323a4c9331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:47.908700 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c226d-4912-48e2-a721-9e323a4c9331 admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:47.909996 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c226d-4912-48e2-a721-9e323a4c9331 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:47.912731 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c226d-4912-48e2-a721-9e323a4c9331 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:47.996882 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1292/2605] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:11:47 2022] POST /identity/v3/users => generated 292 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 04:11:48.006667 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d261a18-b732-4430-9643-ae7ba8e94db3 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:48.017695 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d261a18-b732-4430-9643-ae7ba8e94db3 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:48.023338 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d85b582-a816-450b-9685-c57b95e969a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:48.024107 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85b582-a816-450b-9685-c57b95e969a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:48.024388 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85b582-a816-450b-9685-c57b95e969a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:48.024673 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85b582-a816-450b-9685-c57b95e969a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:48.025421 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d85b582-a816-450b-9685-c57b95e969a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:48.027127 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d85b582-a816-450b-9685-c57b95e969a8 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:48.038422 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1314/2606] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:11:48.042900 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c226d-4912-48e2-a721-9e323a4c9331 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:48.055735 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c226d-4912-48e2-a721-9e323a4c9331 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:48.063622 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dcfa56-4a40-4eae-84c2-4fbd2a900b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:48.064784 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dcfa56-4a40-4eae-84c2-4fbd2a900b74 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:48.065205 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dcfa56-4a40-4eae-84c2-4fbd2a900b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:48.083796 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dcfa56-4a40-4eae-84c2-4fbd2a900b74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:48.083796 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dcfa56-4a40-4eae-84c2-4fbd2a900b74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:48.083796 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dcfa56-4a40-4eae-84c2-4fbd2a900b74 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:48.090869 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1293/2607] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:11:48.095429 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d85b582-a816-450b-9685-c57b95e969a8 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:48.106801 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d85b582-a816-450b-9685-c57b95e969a8 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:48.111601 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10231480-b1e6-4265-81aa-d31b624c7c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:48.112498 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10231480-b1e6-4265-81aa-d31b624c7c9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:48.112777 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10231480-b1e6-4265-81aa-d31b624c7c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:48.113053 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10231480-b1e6-4265-81aa-d31b624c7c9e admin admin] PATH_INFO: `/v3/projects/68d7deb38a254e4d829483d17da00d83/users/7669bf6d742f4ceaa176a5b24c552bbb/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:48.129347 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10231480-b1e6-4265-81aa-d31b624c7c9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=68d7deb38a254e4d829483d17da00d83, user_id=7669bf6d742f4ceaa176a5b24c552bbb, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:48.132172 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10231480-b1e6-4265-81aa-d31b624c7c9e admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:48.209153 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1315/2608] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:11:48 2022] PUT /identity/v3/projects/68d7deb38a254e4d829483d17da00d83/users/7669bf6d742f4ceaa176a5b24c552bbb/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:11:48.275686 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7e4aa-af08-4607-8f5b-d28f95bece42 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:48.275983 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7e4aa-af08-4607-8f5b-d28f95bece42 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:48.276262 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7e4aa-af08-4607-8f5b-d28f95bece42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:48.303355 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-3bb7e4aa-af08-4607-8f5b-d28f95bece42 None None] MFA Rules not processed for user `7669bf6d742f4ceaa176a5b24c552bbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:11:48.307197 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-3bb7e4aa-af08-4607-8f5b-d28f95bece42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:48.370582 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1294/2609] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:11:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:11:48.375857 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10231480-b1e6-4265-81aa-d31b624c7c9e admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:48.441783 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10231480-b1e6-4265-81aa-d31b624c7c9e admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:48.447042 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ad8a7-8afd-42ed-b552-6f87d6dcc04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:48.447823 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ad8a7-8afd-42ed-b552-6f87d6dcc04c admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:48.448235 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ad8a7-8afd-42ed-b552-6f87d6dcc04c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:48.448519 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ad8a7-8afd-42ed-b552-6f87d6dcc04c admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:48.449212 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ad8a7-8afd-42ed-b552-6f87d6dcc04c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:48.451133 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ad8a7-8afd-42ed-b552-6f87d6dcc04c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:48.557794 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1316/2610] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:11:48 2022] POST /identity/v3/projects => generated 385 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 04:11:48.559401 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb7e4aa-af08-4607-8f5b-d28f95bece42 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:48.567803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:11:48.573482 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb7e4aa-af08-4607-8f5b-d28f95bece42 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:48.633956 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd76cf6-bac6-4381-923f-2a3309af96b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:48.634645 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd76cf6-bac6-4381-923f-2a3309af96b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:48.635042 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd76cf6-bac6-4381-923f-2a3309af96b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:48.635375 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd76cf6-bac6-4381-923f-2a3309af96b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:48.636131 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd76cf6-bac6-4381-923f-2a3309af96b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:48.638081 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd76cf6-bac6-4381-923f-2a3309af96b0 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:48.773534 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1295/2611] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:11:48 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:11:48.777782 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ad8a7-8afd-42ed-b552-6f87d6dcc04c admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:48.789474 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ad8a7-8afd-42ed-b552-6f87d6dcc04c admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:48.793883 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f72bad-6f93-4e2d-b7d1-b09a2e6765fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:48.794575 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f72bad-6f93-4e2d-b7d1-b09a2e6765fe admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:48.794879 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f72bad-6f93-4e2d-b7d1-b09a2e6765fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:48.795148 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f72bad-6f93-4e2d-b7d1-b09a2e6765fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:48.795908 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f72bad-6f93-4e2d-b7d1-b09a2e6765fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:48.797502 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f72bad-6f93-4e2d-b7d1-b09a2e6765fe admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:48.809297 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1317/2612] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:11:48.813593 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd76cf6-bac6-4381-923f-2a3309af96b0 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:48.825069 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd76cf6-bac6-4381-923f-2a3309af96b0 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:48.829937 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb73280-5556-449a-b1f0-753f12237892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:48.830605 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb73280-5556-449a-b1f0-753f12237892 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:48.830886 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb73280-5556-449a-b1f0-753f12237892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:48.831190 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb73280-5556-449a-b1f0-753f12237892 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:48.831972 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb73280-5556-449a-b1f0-753f12237892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:48.833603 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb73280-5556-449a-b1f0-753f12237892 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:48.844287 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1296/2613] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:11:48.849573 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f72bad-6f93-4e2d-b7d1-b09a2e6765fe admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:48.860243 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f72bad-6f93-4e2d-b7d1-b09a2e6765fe admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:48.865632 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90aa62-3178-4b39-82d6-fe09f00491dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:48.866552 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90aa62-3178-4b39-82d6-fe09f00491dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:48.866839 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90aa62-3178-4b39-82d6-fe09f00491dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:48.867115 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90aa62-3178-4b39-82d6-fe09f00491dd admin admin] PATH_INFO: `/v3/projects/53cdeea0229e427d9b33face8d1e9d8c/users/376aeea26b9143bdb2aadd063d646043/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:48.883304 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b90aa62-3178-4b39-82d6-fe09f00491dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=53cdeea0229e427d9b33face8d1e9d8c, user_id=376aeea26b9143bdb2aadd063d646043, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:48.886173 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b90aa62-3178-4b39-82d6-fe09f00491dd admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:48.980268 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1318/2614] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:11:48 2022] PUT /identity/v3/projects/53cdeea0229e427d9b33face8d1e9d8c/users/376aeea26b9143bdb2aadd063d646043/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:11:48.991425 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b29b0-fa1d-41a2-8ed8-0b8ea5f7e848 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:48.991747 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b29b0-fa1d-41a2-8ed8-0b8ea5f7e848 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:48.992024 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b29b0-fa1d-41a2-8ed8-0b8ea5f7e848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:49.017830 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-478b29b0-fa1d-41a2-8ed8-0b8ea5f7e848 None None] MFA Rules not processed for user `376aeea26b9143bdb2aadd063d646043`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:11:49.019026 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-478b29b0-fa1d-41a2-8ed8-0b8ea5f7e848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:49.089112 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1297/2615] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:11:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:11:49.093758 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90aa62-3178-4b39-82d6-fe09f00491dd admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:49.160008 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90aa62-3178-4b39-82d6-fe09f00491dd admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:49.165580 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a3c9e-ce42-412b-900c-ef9cc9f2e4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:49.166261 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a3c9e-ce42-412b-900c-ef9cc9f2e4c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:49.166582 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a3c9e-ce42-412b-900c-ef9cc9f2e4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:49.166852 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a3c9e-ce42-412b-900c-ef9cc9f2e4c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:49.167636 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366a3c9e-ce42-412b-900c-ef9cc9f2e4c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:49.169619 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366a3c9e-ce42-412b-900c-ef9cc9f2e4c4 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:49.173089 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:11:49.318088 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1319/2616] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:11:49 2022] POST /identity/v3/projects => generated 385 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:11:49.322368 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b29b0-fa1d-41a2-8ed8-0b8ea5f7e848 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:49.333889 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b29b0-fa1d-41a2-8ed8-0b8ea5f7e848 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:49.394194 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b209b-b528-4c1b-a701-a49023492569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:49.395520 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b209b-b528-4c1b-a701-a49023492569 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:49.395804 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b209b-b528-4c1b-a701-a49023492569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:49.396083 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b209b-b528-4c1b-a701-a49023492569 admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:49.396784 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b209b-b528-4c1b-a701-a49023492569 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:49.398697 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b209b-b528-4c1b-a701-a49023492569 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:49.483118 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1298/2617] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:11:49 2022] POST /identity/v3/users => generated 299 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:11:49.487632 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a3c9e-ce42-412b-900c-ef9cc9f2e4c4 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:49.504839 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a3c9e-ce42-412b-900c-ef9cc9f2e4c4 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:49.509814 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705af68c-5753-4ff6-8e83-ce082b1cba11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:49.510489 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705af68c-5753-4ff6-8e83-ce082b1cba11 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:49.511079 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705af68c-5753-4ff6-8e83-ce082b1cba11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:49.511366 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705af68c-5753-4ff6-8e83-ce082b1cba11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:49.512171 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705af68c-5753-4ff6-8e83-ce082b1cba11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:49.513765 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705af68c-5753-4ff6-8e83-ce082b1cba11 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:49.527524 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1320/2618] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:11:49.532724 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b209b-b528-4c1b-a701-a49023492569 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:49.538888 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:11:49.544481 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b209b-b528-4c1b-a701-a49023492569 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:49.549489 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a66266-93ae-4aa8-a9ee-977e623d1557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:49.550386 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a66266-93ae-4aa8-a9ee-977e623d1557 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:49.550662 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a66266-93ae-4aa8-a9ee-977e623d1557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:49.554557 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a66266-93ae-4aa8-a9ee-977e623d1557 admin admin] PATH_INFO: `/v3/projects/758b524da02149c4b43b4bc355336078/users/9b7714fa1ab54a89b5feba977f84a5b8/roles/681755518698445fabd9a8accec13c0f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:49.568522 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a66266-93ae-4aa8-a9ee-977e623d1557 admin admin] RBAC: Authorizing `identity:create_grant(project_id=758b524da02149c4b43b4bc355336078, user_id=9b7714fa1ab54a89b5feba977f84a5b8, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:49.571970 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a66266-93ae-4aa8-a9ee-977e623d1557 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:49.649405 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1299/2619] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:11:49 2022] PUT /identity/v3/projects/758b524da02149c4b43b4bc355336078/users/9b7714fa1ab54a89b5feba977f84a5b8/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:11:49.653519 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705af68c-5753-4ff6-8e83-ce082b1cba11 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:49.664868 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705af68c-5753-4ff6-8e83-ce082b1cba11 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:49.725806 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b9238-25b8-40d6-b10e-5b639944f8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:49.726624 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b9238-25b8-40d6-b10e-5b639944f8c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:49.728483 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b9238-25b8-40d6-b10e-5b639944f8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:49.728483 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b9238-25b8-40d6-b10e-5b639944f8c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:49.728483 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b9238-25b8-40d6-b10e-5b639944f8c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:49.730111 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b9238-25b8-40d6-b10e-5b639944f8c0 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:49.741704 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1321/2620] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:11:49.745779 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a66266-93ae-4aa8-a9ee-977e623d1557 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:49.757452 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a66266-93ae-4aa8-a9ee-977e623d1557 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:49.762483 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f4d06-484a-4ad7-a02e-ec3f3a8f9a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:49.763425 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f4d06-484a-4ad7-a02e-ec3f3a8f9a03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:49.763738 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f4d06-484a-4ad7-a02e-ec3f3a8f9a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:49.764020 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f4d06-484a-4ad7-a02e-ec3f3a8f9a03 admin admin] PATH_INFO: `/v3/projects/758b524da02149c4b43b4bc355336078/users/9b7714fa1ab54a89b5feba977f84a5b8/roles/681755518698445fabd9a8accec13c0f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:49.766114 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2f4d06-484a-4ad7-a02e-ec3f3a8f9a03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=758b524da02149c4b43b4bc355336078, user_id=9b7714fa1ab54a89b5feba977f84a5b8, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:49.768866 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2f4d06-484a-4ad7-a02e-ec3f3a8f9a03 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:49.781114 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1300/2621] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:11:49 2022] PUT /identity/v3/projects/758b524da02149c4b43b4bc355336078/users/9b7714fa1ab54a89b5feba977f84a5b8/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:11:49.794176 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7598355-6573-4ecf-bc1a-e49394b374b4 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:49.794563 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7598355-6573-4ecf-bc1a-e49394b374b4 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:49.794928 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7598355-6573-4ecf-bc1a-e49394b374b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:49.825656 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-f7598355-6573-4ecf-bc1a-e49394b374b4 None None] MFA Rules not processed for user `9b7714fa1ab54a89b5feba977f84a5b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:11:49.826917 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f7598355-6573-4ecf-bc1a-e49394b374b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:49.906638 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1322/2622] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:11:49 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:11:49.918367 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f4d06-484a-4ad7-a02e-ec3f3a8f9a03 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:49.920149 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-9d2f4d06-484a-4ad7-a02e-ec3f3a8f9a03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:49.988899 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f4d06-484a-4ad7-a02e-ec3f3a8f9a03 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:49.992879 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f35e4b-4f66-4e25-a209-c1b6886172c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:49.993563 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f35e4b-4f66-4e25-a209-c1b6886172c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:49.993844 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f35e4b-4f66-4e25-a209-c1b6886172c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:49.994118 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f35e4b-4f66-4e25-a209-c1b6886172c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:50.061964 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f35e4b-4f66-4e25-a209-c1b6886172c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:50.063420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f35e4b-4f66-4e25-a209-c1b6886172c6 service cinder] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:50.074144 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1301/2623] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:11:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:11:52.151410 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7598355-6573-4ecf-bc1a-e49394b374b4 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:52.152870 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f7598355-6573-4ecf-bc1a-e49394b374b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:52.166170 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7598355-6573-4ecf-bc1a-e49394b374b4 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:52.169771 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c170bed-1da8-4cad-a837-677f3aa498ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:52.170427 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c170bed-1da8-4cad-a837-677f3aa498ec service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:52.170709 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c170bed-1da8-4cad-a837-677f3aa498ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:52.170983 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c170bed-1da8-4cad-a837-677f3aa498ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:52.231916 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:11:52.235651 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c170bed-1da8-4cad-a837-677f3aa498ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:52.237135 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c170bed-1da8-4cad-a837-677f3aa498ec service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:52.248390 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1323/2624] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:11:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:11:52.582973 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b6b86-399d-4959-b9d0-9812732d7093 None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:52.583600 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b6b86-399d-4959-b9d0-9812732d7093 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:52.583940 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b6b86-399d-4959-b9d0-9812732d7093 None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:52.586560 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1302/2625] 10.222.0.46 () {54 vars in 921 bytes} [Fri Jul 1 04:11:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 04:11:52.594617 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b467a8b-4c6b-4684-800d-67c5eec44bf8 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:52.595102 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b467a8b-4c6b-4684-800d-67c5eec44bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:52.595496 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b467a8b-4c6b-4684-800d-67c5eec44bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:52.616904 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-3b467a8b-4c6b-4684-800d-67c5eec44bf8 None None] MFA Rules not processed for user `2da466ad31d344898f5c838f77d45181`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:11:52.618218 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-3b467a8b-4c6b-4684-800d-67c5eec44bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:52.692071 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1324/2626] 10.222.0.46 () {58 vars in 1018 bytes} [Fri Jul 1 04:11:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:11:52.704781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b6b86-399d-4959-b9d0-9812732d7093 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:52.707654 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-613b6b86-399d-4959-b9d0-9812732d7093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:52.781124 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b6b86-399d-4959-b9d0-9812732d7093 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:52.784716 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec3b08-f579-466b-9b2a-f18fa95cdc3a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff2e6387d102445d963de072c55833d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:52.785888 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec3b08-f579-466b-9b2a-f18fa95cdc3a service glance] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:52.786167 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec3b08-f579-466b-9b2a-f18fa95cdc3a service glance] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:52.786441 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec3b08-f579-466b-9b2a-f18fa95cdc3a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:52.797443 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec3b08-f579-466b-9b2a-f18fa95cdc3a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:52.798885 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec3b08-f579-466b-9b2a-f18fa95cdc3a service glance] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:52.810744 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1303/2627] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:11:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:11:53.039116 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d56d3-375e-42ac-aed7-1077814689dd None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:53.039316 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d56d3-375e-42ac-aed7-1077814689dd None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:53.039642 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d56d3-375e-42ac-aed7-1077814689dd None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:53.041098 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1325/2628] 10.222.0.46 () {54 vars in 921 bytes} [Fri Jul 1 04:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 04:11:53.046379 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50707108-c12e-48ba-b8a1-70b904762254 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:53.046637 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50707108-c12e-48ba-b8a1-70b904762254 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:53.046918 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50707108-c12e-48ba-b8a1-70b904762254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:53.065116 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-50707108-c12e-48ba-b8a1-70b904762254 None None] MFA Rules not processed for user `93929b81a23c482ca7ce47e7a94682e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:11:53.066430 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-50707108-c12e-48ba-b8a1-70b904762254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:53.084390 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:11:53.120337 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1304/2629] 10.222.0.46 () {58 vars in 1018 bytes} [Fri Jul 1 04:11:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:11:53.135951 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d56d3-375e-42ac-aed7-1077814689dd None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:53.137765 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-686d56d3-375e-42ac-aed7-1077814689dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:53.151949 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d56d3-375e-42ac-aed7-1077814689dd None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:53.156022 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430023c5-fade-43bf-91fe-944b47eeaf11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:53.156711 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430023c5-fade-43bf-91fe-944b47eeaf11 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:53.157048 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430023c5-fade-43bf-91fe-944b47eeaf11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:53.157352 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430023c5-fade-43bf-91fe-944b47eeaf11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:53.166305 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430023c5-fade-43bf-91fe-944b47eeaf11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:53.167876 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430023c5-fade-43bf-91fe-944b47eeaf11 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:53.176136 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1326/2630] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:11:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:11:53.263142 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c064140-63df-4289-a9f1-2cf2ff7ce15b None None] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:53.263474 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c064140-63df-4289-a9f1-2cf2ff7ce15b None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:53.263715 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c064140-63df-4289-a9f1-2cf2ff7ce15b None None] PATH_INFO: `/` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:53.265118 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1305/2631] 10.222.0.46 () {54 vars in 921 bytes} [Fri Jul 1 04:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 04:11:53.273100 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062eee4-c22e-40f6-b062-8d305ba9d745 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:53.273389 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062eee4-c22e-40f6-b062-8d305ba9d745 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:53.273669 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062eee4-c22e-40f6-b062-8d305ba9d745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:53.293442 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-f062eee4-c22e-40f6-b062-8d305ba9d745 None None] MFA Rules not processed for user `2da466ad31d344898f5c838f77d45181`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:11:53.294573 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f062eee4-c22e-40f6-b062-8d305ba9d745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:53.304123 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1327/2632] 10.222.0.46 () {58 vars in 1018 bytes} [Fri Jul 1 04:11:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:11:53.315060 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c064140-63df-4289-a9f1-2cf2ff7ce15b None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:53.327611 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c064140-63df-4289-a9f1-2cf2ff7ce15b None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:53.331363 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d2ad5-101b-4982-84cd-ccd7031c3924 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:53.332633 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d2ad5-101b-4982-84cd-ccd7031c3924 service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:53.332940 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d2ad5-101b-4982-84cd-ccd7031c3924 service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:53.333217 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d2ad5-101b-4982-84cd-ccd7031c3924 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:53.347762 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d2ad5-101b-4982-84cd-ccd7031c3924 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:53.350553 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d2ad5-101b-4982-84cd-ccd7031c3924 service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:53.363409 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1306/2633] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:11:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 04:11:53.896511 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062eee4-c22e-40f6-b062-8d305ba9d745 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:53.908026 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062eee4-c22e-40f6-b062-8d305ba9d745 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:53.911876 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020b0d9-c564-4966-9cf3-1554223fa342 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:53.914948 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020b0d9-c564-4966-9cf3-1554223fa342 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:53.914948 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020b0d9-c564-4966-9cf3-1554223fa342 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:53.914948 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020b0d9-c564-4966-9cf3-1554223fa342 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:53.923393 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2020b0d9-c564-4966-9cf3-1554223fa342 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:53.925027 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2020b0d9-c564-4966-9cf3-1554223fa342 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:53.936826 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1328/2634] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:11:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:11:55.916336 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5ded1-97c5-4f34-a311-e0f70b5c6ff4 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:55.916840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5ded1-97c5-4f34-a311-e0f70b5c6ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:55.916956 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5ded1-97c5-4f34-a311-e0f70b5c6ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:55.935965 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-e1e5ded1-97c5-4f34-a311-e0f70b5c6ff4 None None] MFA Rules not processed for user `dd41221abea04808bed5ef4ac4528c62`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:11:55.937246 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-e1e5ded1-97c5-4f34-a311-e0f70b5c6ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:56.002145 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1307/2635] 10.222.0.46 () {58 vars in 1009 bytes} [Fri Jul 1 04:11:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:11:56.016481 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020b0d9-c564-4966-9cf3-1554223fa342 service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:56.018177 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2020b0d9-c564-4966-9cf3-1554223fa342 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:56.091157 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020b0d9-c564-4966-9cf3-1554223fa342 service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:56.096764 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9cc89c-7dfa-42f1-8ba4-b5be5c3d4b4b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83787880173b459c8975b834bd47a51a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:56.097484 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9cc89c-7dfa-42f1-8ba4-b5be5c3d4b4b service swift] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:56.097764 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9cc89c-7dfa-42f1-8ba4-b5be5c3d4b4b service swift] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:56.098041 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9cc89c-7dfa-42f1-8ba4-b5be5c3d4b4b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:56.106784 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9cc89c-7dfa-42f1-8ba4-b5be5c3d4b4b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:56.118260 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9cc89c-7dfa-42f1-8ba4-b5be5c3d4b4b service swift] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:56.118260 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1329/2636] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Jul 1 04:11:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 04:11:58.754528 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5ded1-97c5-4f34-a311-e0f70b5c6ff4 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:58.829935 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5ded1-97c5-4f34-a311-e0f70b5c6ff4 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:58.846555 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd379d6-8f06-4174-bf30-56b543a1cf97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:58.848281 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd379d6-8f06-4174-bf30-56b543a1cf97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:58.848636 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd379d6-8f06-4174-bf30-56b543a1cf97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:58.848980 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd379d6-8f06-4174-bf30-56b543a1cf97 admin admin] PATH_INFO: `/v3/users/7669bf6d742f4ceaa176a5b24c552bbb` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:58.850339 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd379d6-8f06-4174-bf30-56b543a1cf97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7669bf6d742f4ceaa176a5b24c552bbb)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:58.852391 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd379d6-8f06-4174-bf30-56b543a1cf97 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:59.063122 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-abd379d6-8f06-4174-bf30-56b543a1cf97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7669bf6d742f4ceaa176a5b24c552bbb'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:59.063839 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-abd379d6-8f06-4174-bf30-56b543a1cf97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7669bf6d742f4ceaa176a5b24c552bbb'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:59.173472 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-abd379d6-8f06-4174-bf30-56b543a1cf97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7669bf6d742f4ceaa176a5b24c552bbb'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:59.176487 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-abd379d6-8f06-4174-bf30-56b543a1cf97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7669bf6d742f4ceaa176a5b24c552bbb'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:59.184515 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-abd379d6-8f06-4174-bf30-56b543a1cf97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7669bf6d742f4ceaa176a5b24c552bbb'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:11:59.187011 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:11:59.203351 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1308/2637] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:11:58 2022] DELETE /identity/v3/users/7669bf6d742f4ceaa176a5b24c552bbb => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:11:59.209170 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02920d99-f44f-486a-a06c-85867fc70fa7 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:59.210949 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02920d99-f44f-486a-a06c-85867fc70fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:59.210949 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02920d99-f44f-486a-a06c-85867fc70fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:59.231572 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-02920d99-f44f-486a-a06c-85867fc70fa7 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:11:59.233171 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-02920d99-f44f-486a-a06c-85867fc70fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:59.285492 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:11:59.319647 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1330/2638] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:11:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:11:59.329647 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd379d6-8f06-4174-bf30-56b543a1cf97 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:59.331013 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-abd379d6-8f06-4174-bf30-56b543a1cf97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:59.399632 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd379d6-8f06-4174-bf30-56b543a1cf97 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:59.403630 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539e95b-78a0-4e35-93be-6e52bf02fa50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:59.405075 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539e95b-78a0-4e35-93be-6e52bf02fa50 service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:59.405075 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539e95b-78a0-4e35-93be-6e52bf02fa50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:59.405075 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539e95b-78a0-4e35-93be-6e52bf02fa50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:59.415488 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a539e95b-78a0-4e35-93be-6e52bf02fa50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:59.417149 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a539e95b-78a0-4e35-93be-6e52bf02fa50 service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:11:59.438636 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1309/2639] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:11:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:11:59.903927 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02920d99-f44f-486a-a06c-85867fc70fa7 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:11:59.906076 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-02920d99-f44f-486a-a06c-85867fc70fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:11:59.922075 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02920d99-f44f-486a-a06c-85867fc70fa7 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:11:59.933308 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95efe1e8-a42a-404a-ab5e-8845dbfbb826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:11:59.934218 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efe1e8-a42a-404a-ab5e-8845dbfbb826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:11:59.934566 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efe1e8-a42a-404a-ab5e-8845dbfbb826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:11:59.934763 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efe1e8-a42a-404a-ab5e-8845dbfbb826 admin admin] PATH_INFO: `/v3/projects/68d7deb38a254e4d829483d17da00d83` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:11:59.940236 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95efe1e8-a42a-404a-ab5e-8845dbfbb826 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68d7deb38a254e4d829483d17da00d83)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:11:59.952518 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95efe1e8-a42a-404a-ab5e-8845dbfbb826 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:12:00.093632 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-95efe1e8-a42a-404a-ab5e-8845dbfbb826 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68d7deb38a254e4d829483d17da00d83', 'request_id': 'req-95efe1e8-a42a-404a-ab5e-8845dbfbb826'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:12:00.162758 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-95efe1e8-a42a-404a-ab5e-8845dbfbb826 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68d7deb38a254e4d829483d17da00d83', 'request_id': 'req-95efe1e8-a42a-404a-ab5e-8845dbfbb826'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:12:00.170992 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-95efe1e8-a42a-404a-ab5e-8845dbfbb826 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68d7deb38a254e4d829483d17da00d83', 'request_id': 'req-95efe1e8-a42a-404a-ab5e-8845dbfbb826'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:12:00.183655 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-95efe1e8-a42a-404a-ab5e-8845dbfbb826 admin admin] The token cache is being invalidate because project 68d7deb38a254e4d829483d17da00d83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:12:00.183944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-95efe1e8-a42a-404a-ab5e-8845dbfbb826 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:12:00.184609 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-95efe1e8-a42a-404a-ab5e-8845dbfbb826 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:12:00.186243 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1331/2640] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:11:59 2022] DELETE /identity/v3/projects/68d7deb38a254e4d829483d17da00d83 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:12:00.190463 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539e95b-78a0-4e35-93be-6e52bf02fa50 service neutron] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:12:00.202256 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539e95b-78a0-4e35-93be-6e52bf02fa50 service neutron] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:12:00.274595 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec4950-a441-470e-a39c-8d94c44d4850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:12:00.275841 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec4950-a441-470e-a39c-8d94c44d4850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:12:00.276168 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec4950-a441-470e-a39c-8d94c44d4850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:12:00.276406 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec4950-a441-470e-a39c-8d94c44d4850 admin admin] PATH_INFO: `/v3/users/376aeea26b9143bdb2aadd063d646043` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:12:00.277675 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec4950-a441-470e-a39c-8d94c44d4850 admin admin] RBAC: Authorizing `identity:delete_user(user_id=376aeea26b9143bdb2aadd063d646043)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:12:00.279783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec4950-a441-470e-a39c-8d94c44d4850 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:12:00.522333 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-04ec4950-a441-470e-a39c-8d94c44d4850 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '376aeea26b9143bdb2aadd063d646043'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:12:00.529659 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-04ec4950-a441-470e-a39c-8d94c44d4850 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '376aeea26b9143bdb2aadd063d646043'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:12:00.609053 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-04ec4950-a441-470e-a39c-8d94c44d4850 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '376aeea26b9143bdb2aadd063d646043'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:12:00.609719 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-04ec4950-a441-470e-a39c-8d94c44d4850 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '376aeea26b9143bdb2aadd063d646043'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:12:00.617798 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-04ec4950-a441-470e-a39c-8d94c44d4850 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '376aeea26b9143bdb2aadd063d646043'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:12:00.642521 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1310/2641] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:12:00 2022] DELETE /identity/v3/users/376aeea26b9143bdb2aadd063d646043 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:12:01.152234 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95efe1e8-a42a-404a-ab5e-8845dbfbb826 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:12:01.153857 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-95efe1e8-a42a-404a-ab5e-8845dbfbb826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:12:01.192134 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95efe1e8-a42a-404a-ab5e-8845dbfbb826 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:12:01.294594 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b1773-fbe4-4d13-abea-a72072c16ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:12:01.295738 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b1773-fbe4-4d13-abea-a72072c16ec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:12:01.296237 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b1773-fbe4-4d13-abea-a72072c16ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:12:01.296514 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b1773-fbe4-4d13-abea-a72072c16ec3 admin admin] PATH_INFO: `/v3/projects/53cdeea0229e427d9b33face8d1e9d8c` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:12:01.298233 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b1773-fbe4-4d13-abea-a72072c16ec3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53cdeea0229e427d9b33face8d1e9d8c)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:12:01.301144 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b1773-fbe4-4d13-abea-a72072c16ec3 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:12:01.462736 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d60b1773-fbe4-4d13-abea-a72072c16ec3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53cdeea0229e427d9b33face8d1e9d8c', 'request_id': 'req-d60b1773-fbe4-4d13-abea-a72072c16ec3'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:12:01.550291 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d60b1773-fbe4-4d13-abea-a72072c16ec3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53cdeea0229e427d9b33face8d1e9d8c', 'request_id': 'req-d60b1773-fbe4-4d13-abea-a72072c16ec3'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:12:01.558894 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d60b1773-fbe4-4d13-abea-a72072c16ec3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53cdeea0229e427d9b33face8d1e9d8c', 'request_id': 'req-d60b1773-fbe4-4d13-abea-a72072c16ec3'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:12:01.561767 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:12:01.572994 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d60b1773-fbe4-4d13-abea-a72072c16ec3 admin admin] The token cache is being invalidate because project 53cdeea0229e427d9b33face8d1e9d8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:12:01.573453 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d60b1773-fbe4-4d13-abea-a72072c16ec3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:12:01.574254 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d60b1773-fbe4-4d13-abea-a72072c16ec3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:12:01.580487 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec4950-a441-470e-a39c-8d94c44d4850 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:12:01.582608 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-04ec4950-a441-470e-a39c-8d94c44d4850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:12:01.584647 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1332/2642] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:12:01 2022] DELETE /identity/v3/projects/53cdeea0229e427d9b33face8d1e9d8c => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:12:01.594874 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:12:01.599441 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec4950-a441-470e-a39c-8d94c44d4850 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:12:01.673594 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65402d43-849c-4a5e-996f-c97e4d8a21ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:12:01.674592 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65402d43-849c-4a5e-996f-c97e4d8a21ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:12:01.674837 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65402d43-849c-4a5e-996f-c97e4d8a21ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:12:01.675664 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65402d43-849c-4a5e-996f-c97e4d8a21ca admin admin] PATH_INFO: `/v3/users/9b7714fa1ab54a89b5feba977f84a5b8` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:12:01.678161 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65402d43-849c-4a5e-996f-c97e4d8a21ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b7714fa1ab54a89b5feba977f84a5b8)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:12:01.680415 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65402d43-849c-4a5e-996f-c97e4d8a21ca admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:12:01.860307 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-65402d43-849c-4a5e-996f-c97e4d8a21ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b7714fa1ab54a89b5feba977f84a5b8'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:12:01.860965 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-65402d43-849c-4a5e-996f-c97e4d8a21ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b7714fa1ab54a89b5feba977f84a5b8'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:12:01.944290 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-65402d43-849c-4a5e-996f-c97e4d8a21ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b7714fa1ab54a89b5feba977f84a5b8'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:12:01.945139 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-65402d43-849c-4a5e-996f-c97e4d8a21ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b7714fa1ab54a89b5feba977f84a5b8'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:12:01.953804 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-65402d43-849c-4a5e-996f-c97e4d8a21ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b7714fa1ab54a89b5feba977f84a5b8'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:12:01.984763 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1311/2643] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:12:01 2022] DELETE /identity/v3/users/9b7714fa1ab54a89b5feba977f84a5b8 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:12:02.549807 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b1773-fbe4-4d13-abea-a72072c16ec3 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:12:02.551380 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d60b1773-fbe4-4d13-abea-a72072c16ec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:12:02.576690 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b1773-fbe4-4d13-abea-a72072c16ec3 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:12:02.659081 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4c545-2387-46ef-b6f1-928f76480307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:12:02.661072 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4c545-2387-46ef-b6f1-928f76480307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:12:02.661626 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4c545-2387-46ef-b6f1-928f76480307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:12:02.662165 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4c545-2387-46ef-b6f1-928f76480307 admin admin] PATH_INFO: `/v3/projects/758b524da02149c4b43b4bc355336078` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:12:02.670519 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b4c545-2387-46ef-b6f1-928f76480307 admin admin] RBAC: Authorizing `identity:delete_project(project_id=758b524da02149c4b43b4bc355336078)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:12:02.672790 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b4c545-2387-46ef-b6f1-928f76480307 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:12:02.824244 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-11b4c545-2387-46ef-b6f1-928f76480307 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '758b524da02149c4b43b4bc355336078', 'request_id': 'req-11b4c545-2387-46ef-b6f1-928f76480307'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:12:02.904933 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-11b4c545-2387-46ef-b6f1-928f76480307 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '758b524da02149c4b43b4bc355336078', 'request_id': 'req-11b4c545-2387-46ef-b6f1-928f76480307'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:12:02.911755 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-11b4c545-2387-46ef-b6f1-928f76480307 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '758b524da02149c4b43b4bc355336078', 'request_id': 'req-11b4c545-2387-46ef-b6f1-928f76480307'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:12:02.926041 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-11b4c545-2387-46ef-b6f1-928f76480307 admin admin] The token cache is being invalidate because project 758b524da02149c4b43b4bc355336078 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:12:02.926327 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-11b4c545-2387-46ef-b6f1-928f76480307 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:12:02.927175 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-11b4c545-2387-46ef-b6f1-928f76480307 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:12:02.928647 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1333/2644] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:12:02 2022] DELETE /identity/v3/projects/758b524da02149c4b43b4bc355336078 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:12:02.934471 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f374e-b59a-49af-bd72-48292c605471 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:12:02.935088 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f374e-b59a-49af-bd72-48292c605471 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:12:02.935248 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f374e-b59a-49af-bd72-48292c605471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:12:02.976787 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-e96f374e-b59a-49af-bd72-48292c605471 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:12:02.978080 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-e96f374e-b59a-49af-bd72-48292c605471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:12:03.048035 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1312/2645] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:12:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 04:12:03.056386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3948c-25d3-437e-b61f-7e8580c6e006 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:12:03.056670 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3948c-25d3-437e-b61f-7e8580c6e006 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:12:03.056948 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3948c-25d3-437e-b61f-7e8580c6e006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:12:03.076710 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-7fc3948c-25d3-437e-b61f-7e8580c6e006 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:12:03.077850 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-7fc3948c-25d3-437e-b61f-7e8580c6e006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:12:03.088453 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1334/2646] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:12:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:12:03.091425 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f374e-b59a-49af-bd72-48292c605471 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:12:03.102438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f374e-b59a-49af-bd72-48292c605471 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:12:03.107241 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25d23c-fc80-4bea-9c1f-2efaae941b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:12:03.108065 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25d23c-fc80-4bea-9c1f-2efaae941b69 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:12:03.108348 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25d23c-fc80-4bea-9c1f-2efaae941b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:12:03.108691 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25d23c-fc80-4bea-9c1f-2efaae941b69 admin admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:12:03.109730 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b25d23c-fc80-4bea-9c1f-2efaae941b69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:12:03.110039 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b25d23c-fc80-4bea-9c1f-2efaae941b69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:12:03.111956 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b25d23c-fc80-4bea-9c1f-2efaae941b69 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:12:03.129190 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1313/2647] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:12:03.130686 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3948c-25d3-437e-b61f-7e8580c6e006 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:12:03.140556 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3948c-25d3-437e-b61f-7e8580c6e006 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:12:03.145641 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e9543-2632-4039-92d9-d3b3457c6878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:12:03.146352 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e9543-2632-4039-92d9-d3b3457c6878 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:12:03.146648 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e9543-2632-4039-92d9-d3b3457c6878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:12:03.146998 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e9543-2632-4039-92d9-d3b3457c6878 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:12:03.147694 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e9543-2632-4039-92d9-d3b3457c6878 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:12:03.149727 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e9543-2632-4039-92d9-d3b3457c6878 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:12:03.243099 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1335/2648] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:12:03 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:12:03.248039 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25d23c-fc80-4bea-9c1f-2efaae941b69 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:12:03.268804 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25d23c-fc80-4bea-9c1f-2efaae941b69 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:12:03.286093 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:12:03.349647 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af4d31-4407-4c00-ab6d-fa2611e92853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:12:03.350869 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af4d31-4407-4c00-ab6d-fa2611e92853 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:12:03.351316 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af4d31-4407-4c00-ab6d-fa2611e92853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:12:03.351794 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af4d31-4407-4c00-ab6d-fa2611e92853 admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:12:03.366164 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af4d31-4407-4c00-ab6d-fa2611e92853 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:12:03.366164 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af4d31-4407-4c00-ab6d-fa2611e92853 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:12:03.636830 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1314/2649] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:12:03 2022] POST /identity/v3/users => generated 292 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:12:03.638573 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e9543-2632-4039-92d9-d3b3457c6878 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:12:03.652930 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e9543-2632-4039-92d9-d3b3457c6878 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:12:03.669425 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e834a3a2-fa95-41b7-be43-edcf1ca99d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:12:03.670289 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834a3a2-fa95-41b7-be43-edcf1ca99d44 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:12:03.670707 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834a3a2-fa95-41b7-be43-edcf1ca99d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:12:03.670991 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834a3a2-fa95-41b7-be43-edcf1ca99d44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:12:03.671873 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e834a3a2-fa95-41b7-be43-edcf1ca99d44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:12:03.673960 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e834a3a2-fa95-41b7-be43-edcf1ca99d44 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:12:03.693655 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1336/2650] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:12:03.694167 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af4d31-4407-4c00-ab6d-fa2611e92853 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:12:03.712772 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af4d31-4407-4c00-ab6d-fa2611e92853 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:12:03.719124 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab31cc7-6241-43be-8361-8c809943ce5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:12:03.720546 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab31cc7-6241-43be-8361-8c809943ce5a admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:12:03.720546 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab31cc7-6241-43be-8361-8c809943ce5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:12:03.720546 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab31cc7-6241-43be-8361-8c809943ce5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:12:03.721721 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab31cc7-6241-43be-8361-8c809943ce5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:12:03.724078 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab31cc7-6241-43be-8361-8c809943ce5a admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:12:03.739730 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1315/2651] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:12:03.741662 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e834a3a2-fa95-41b7-be43-edcf1ca99d44 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:12:03.765161 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e834a3a2-fa95-41b7-be43-edcf1ca99d44 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:12:03.771315 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f2261c-8c1c-4cfa-9d78-911fdb3846e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:12:03.774468 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2261c-8c1c-4cfa-9d78-911fdb3846e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:12:03.774692 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2261c-8c1c-4cfa-9d78-911fdb3846e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:12:03.774905 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2261c-8c1c-4cfa-9d78-911fdb3846e6 admin admin] PATH_INFO: `/v3/projects/9f270eb2838e4968838fde17de4adf01/users/cc6337d8ba584d9c87f6d0a1404d60cd/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:12:03.799829 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f2261c-8c1c-4cfa-9d78-911fdb3846e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f270eb2838e4968838fde17de4adf01, user_id=cc6337d8ba584d9c87f6d0a1404d60cd, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:12:03.803183 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f2261c-8c1c-4cfa-9d78-911fdb3846e6 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:12:03.910702 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1337/2652] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:12:03 2022] PUT /identity/v3/projects/9f270eb2838e4968838fde17de4adf01/users/cc6337d8ba584d9c87f6d0a1404d60cd/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:12:03.921259 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd5c7e-5615-48dd-94e6-8b0f0098e648 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:12:03.921721 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd5c7e-5615-48dd-94e6-8b0f0098e648 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:12:03.922171 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd5c7e-5615-48dd-94e6-8b0f0098e648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:12:03.952524 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-c5dd5c7e-5615-48dd-94e6-8b0f0098e648 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:12:03.954903 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-c5dd5c7e-5615-48dd-94e6-8b0f0098e648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:12:04.044005 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1316/2653] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:12:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:12:04.060004 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f2261c-8c1c-4cfa-9d78-911fdb3846e6 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:12:04.062212 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-67f2261c-8c1c-4cfa-9d78-911fdb3846e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:12:04.097506 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:12:04.141993 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f2261c-8c1c-4cfa-9d78-911fdb3846e6 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:12:04.146408 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bab1ca-9b28-49bc-b2b9-bae7dd4a965b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:12:04.152840 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bab1ca-9b28-49bc-b2b9-bae7dd4a965b service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:12:04.152840 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bab1ca-9b28-49bc-b2b9-bae7dd4a965b service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:12:04.152840 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bab1ca-9b28-49bc-b2b9-bae7dd4a965b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:12:04.157390 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bab1ca-9b28-49bc-b2b9-bae7dd4a965b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:12:04.158855 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bab1ca-9b28-49bc-b2b9-bae7dd4a965b service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:12:04.171495 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1338/2654] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:12:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:12:11.375567 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3aba7-7941-4ea7-bbb4-f075cdc4fe50 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:12:11.376055 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3aba7-7941-4ea7-bbb4-f075cdc4fe50 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:12:11.376148 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3aba7-7941-4ea7-bbb4-f075cdc4fe50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:12:11.397167 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-02a3aba7-7941-4ea7-bbb4-f075cdc4fe50 None None] MFA Rules not processed for user `dd41221abea04808bed5ef4ac4528c62`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:12:11.399055 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-02a3aba7-7941-4ea7-bbb4-f075cdc4fe50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:12:11.479250 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1317/2655] 10.222.0.46 () {58 vars in 967 bytes} [Fri Jul 1 04:12:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:12:11.493744 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bab1ca-9b28-49bc-b2b9-bae7dd4a965b service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:12:11.496348 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-08bab1ca-9b28-49bc-b2b9-bae7dd4a965b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:12:11.655672 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bab1ca-9b28-49bc-b2b9-bae7dd4a965b service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:12:11.661768 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31142c-fe00-435a-bd87-0fe26f2fdec1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83787880173b459c8975b834bd47a51a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:12:11.662459 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31142c-fe00-435a-bd87-0fe26f2fdec1 service swift] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:12:11.664577 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31142c-fe00-435a-bd87-0fe26f2fdec1 service swift] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:12:11.664577 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31142c-fe00-435a-bd87-0fe26f2fdec1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:12:11.679515 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a31142c-fe00-435a-bd87-0fe26f2fdec1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:12:11.681572 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a31142c-fe00-435a-bd87-0fe26f2fdec1 service swift] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:12:11.731722 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1339/2656] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Jul 1 04:12:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 04:12:12.114308 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d8e9f-b9cb-4a14-b261-f67617d66291 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:12:12.114844 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d8e9f-b9cb-4a14-b261-f67617d66291 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:12:12.115318 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d8e9f-b9cb-4a14-b261-f67617d66291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:12:12.152295 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-321d8e9f-b9cb-4a14-b261-f67617d66291 None None] MFA Rules not processed for user `cc6337d8ba584d9c87f6d0a1404d60cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:12:12.153761 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-321d8e9f-b9cb-4a14-b261-f67617d66291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:12:12.193748 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:12:12.246908 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1318/2657] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:12:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:12:12.252181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31142c-fe00-435a-bd87-0fe26f2fdec1 service swift] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:12:12.265975 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31142c-fe00-435a-bd87-0fe26f2fdec1 service swift] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:12:12.271332 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03150b52-32d6-461c-9c99-7ee0482ef989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:12:12.272206 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03150b52-32d6-461c-9c99-7ee0482ef989 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:12:12.272500 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03150b52-32d6-461c-9c99-7ee0482ef989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:12:12.272779 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03150b52-32d6-461c-9c99-7ee0482ef989 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:12:12.273474 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03150b52-32d6-461c-9c99-7ee0482ef989 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:12:12.275616 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03150b52-32d6-461c-9c99-7ee0482ef989 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:12:12.436824 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1340/2658] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:12:12 2022] POST /identity/v3/projects => generated 385 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:12:12.441751 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d8e9f-b9cb-4a14-b261-f67617d66291 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:12:12.455079 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d8e9f-b9cb-4a14-b261-f67617d66291 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:12:12.523760 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048cad9e-cfb7-4213-a4b6-86e96384bdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:12:12.523760 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cad9e-cfb7-4213-a4b6-86e96384bdb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:12:12.523760 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cad9e-cfb7-4213-a4b6-86e96384bdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:12:12.523760 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cad9e-cfb7-4213-a4b6-86e96384bdb5 admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:12:12.524169 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048cad9e-cfb7-4213-a4b6-86e96384bdb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:12:12.525998 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048cad9e-cfb7-4213-a4b6-86e96384bdb5 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:12:12.634099 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1319/2659] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:12:12 2022] POST /identity/v3/users => generated 299 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:12:12.634662 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03150b52-32d6-461c-9c99-7ee0482ef989 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:12:12.653148 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03150b52-32d6-461c-9c99-7ee0482ef989 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:12:12.658680 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e82481c-ae66-49d3-a316-70b2e4ddade2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:12:12.659492 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82481c-ae66-49d3-a316-70b2e4ddade2 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:12:12.659786 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82481c-ae66-49d3-a316-70b2e4ddade2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:12:12.660064 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82481c-ae66-49d3-a316-70b2e4ddade2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:12:12.660821 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e82481c-ae66-49d3-a316-70b2e4ddade2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:12:12.662548 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e82481c-ae66-49d3-a316-70b2e4ddade2 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:12:12.676724 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1341/2660] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:12:12 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:12:12.681293 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048cad9e-cfb7-4213-a4b6-86e96384bdb5 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:12:12.693428 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048cad9e-cfb7-4213-a4b6-86e96384bdb5 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:12:12.700208 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e24363f-c71c-4d40-a5e1-77d4965995a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:12:12.701421 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24363f-c71c-4d40-a5e1-77d4965995a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:12:12.705269 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24363f-c71c-4d40-a5e1-77d4965995a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:12:12.705269 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24363f-c71c-4d40-a5e1-77d4965995a9 admin admin] PATH_INFO: `/v3/projects/29e12899446546c7ac5b54302d6ab012/users/af31dff14a754317b7185e63b06c88ac/roles/681755518698445fabd9a8accec13c0f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:12:12.727492 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e24363f-c71c-4d40-a5e1-77d4965995a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29e12899446546c7ac5b54302d6ab012, user_id=af31dff14a754317b7185e63b06c88ac, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:12:12.731915 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e24363f-c71c-4d40-a5e1-77d4965995a9 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:12:12.865554 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1320/2661] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:12:12 2022] PUT /identity/v3/projects/29e12899446546c7ac5b54302d6ab012/users/af31dff14a754317b7185e63b06c88ac/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:12:12.867494 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e82481c-ae66-49d3-a316-70b2e4ddade2 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:12:12.883956 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e82481c-ae66-49d3-a316-70b2e4ddade2 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:12:13.071675 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68028912-f14f-41ab-befc-dd20ce0f9270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:12:13.073365 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68028912-f14f-41ab-befc-dd20ce0f9270 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:12:13.073762 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68028912-f14f-41ab-befc-dd20ce0f9270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:12:13.074145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68028912-f14f-41ab-befc-dd20ce0f9270 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:12:13.075006 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68028912-f14f-41ab-befc-dd20ce0f9270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:12:13.077228 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68028912-f14f-41ab-befc-dd20ce0f9270 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:12:13.089825 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1342/2662] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:12:12 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 04:12:13.095606 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e24363f-c71c-4d40-a5e1-77d4965995a9 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:12:13.110311 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e24363f-c71c-4d40-a5e1-77d4965995a9 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:12:13.125570 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ececd-6131-4848-8b23-0d05f8e9c788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:12:13.125806 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ececd-6131-4848-8b23-0d05f8e9c788 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:12:13.125969 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ececd-6131-4848-8b23-0d05f8e9c788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:12:13.126247 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ececd-6131-4848-8b23-0d05f8e9c788 admin admin] PATH_INFO: `/v3/projects/29e12899446546c7ac5b54302d6ab012/users/af31dff14a754317b7185e63b06c88ac/roles/681755518698445fabd9a8accec13c0f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:12:13.130047 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ececd-6131-4848-8b23-0d05f8e9c788 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29e12899446546c7ac5b54302d6ab012, user_id=af31dff14a754317b7185e63b06c88ac, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:12:13.140574 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ececd-6131-4848-8b23-0d05f8e9c788 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:12:13.175895 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1321/2663] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:12:13 2022] PUT /identity/v3/projects/29e12899446546c7ac5b54302d6ab012/users/af31dff14a754317b7185e63b06c88ac/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:12:15.659725 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68028912-f14f-41ab-befc-dd20ce0f9270 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:12:15.662729 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-68028912-f14f-41ab-befc-dd20ce0f9270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:12:15.734374 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:12:15.832580 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68028912-f14f-41ab-befc-dd20ce0f9270 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:12:15.956218 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfebad4-3ee9-4622-97b8-0634ec4f2252 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2da466ad31d344898f5c838f77d45181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:12:15.957479 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfebad4-3ee9-4622-97b8-0634ec4f2252 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:12:15.957944 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfebad4-3ee9-4622-97b8-0634ec4f2252 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:12:15.958647 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfebad4-3ee9-4622-97b8-0634ec4f2252 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:12:15.962315 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-cdfebad4-3ee9-4622-97b8-0634ec4f2252 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:12:16.102490 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfebad4-3ee9-4622-97b8-0634ec4f2252 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:12:16.104525 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfebad4-3ee9-4622-97b8-0634ec4f2252 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:12:16.118040 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1343/2664] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:12:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:12:17.713855 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ececd-6131-4848-8b23-0d05f8e9c788 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:12:17.719237 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-c29ececd-6131-4848-8b23-0d05f8e9c788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:12:17.798824 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ececd-6131-4848-8b23-0d05f8e9c788 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:12:17.805699 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4037ad6b-4100-4269-8c7f-54fc851b1f53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:12:17.806377 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037ad6b-4100-4269-8c7f-54fc851b1f53 service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:12:17.806655 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037ad6b-4100-4269-8c7f-54fc851b1f53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:12:17.806932 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037ad6b-4100-4269-8c7f-54fc851b1f53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:12:17.808984 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-4037ad6b-4100-4269-8c7f-54fc851b1f53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:12:17.862726 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:12:17.911783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4037ad6b-4100-4269-8c7f-54fc851b1f53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:12:17.913958 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4037ad6b-4100-4269-8c7f-54fc851b1f53 service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:12:17.925946 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1322/2665] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:12:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:12:20.618761 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07728999-2ba0-4ae8-bb95-a483c00ba051 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:12:20.619331 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07728999-2ba0-4ae8-bb95-a483c00ba051 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:12:20.619331 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07728999-2ba0-4ae8-bb95-a483c00ba051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:12:20.654652 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-07728999-2ba0-4ae8-bb95-a483c00ba051 None None] MFA Rules not processed for user `af31dff14a754317b7185e63b06c88ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:12:20.656319 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-07728999-2ba0-4ae8-bb95-a483c00ba051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:12:20.727310 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:12:20.770858 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1344/2666] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:12:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:12:20.784610 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4037ad6b-4100-4269-8c7f-54fc851b1f53 service neutron] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:12:20.786101 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-4037ad6b-4100-4269-8c7f-54fc851b1f53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:12:20.865142 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4037ad6b-4100-4269-8c7f-54fc851b1f53 service neutron] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:12:20.872630 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807dfac-536e-4249-a152-730c1575a570 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff2e6387d102445d963de072c55833d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:12:20.879726 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807dfac-536e-4249-a152-730c1575a570 service glance] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:12:20.879726 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807dfac-536e-4249-a152-730c1575a570 service glance] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:12:20.879726 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807dfac-536e-4249-a152-730c1575a570 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:12:20.986194 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807dfac-536e-4249-a152-730c1575a570 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:12:20.987865 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807dfac-536e-4249-a152-730c1575a570 service glance] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:12:21.013910 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1323/2667] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:12:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:12:21.355476 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342ad0f-1391-4c2d-b5ac-272aa935239f None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:12:21.355775 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342ad0f-1391-4c2d-b5ac-272aa935239f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:12:21.356060 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342ad0f-1391-4c2d-b5ac-272aa935239f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:12:21.398746 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-4342ad0f-1391-4c2d-b5ac-272aa935239f None None] MFA Rules not processed for user `dd41221abea04808bed5ef4ac4528c62`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:12:21.398746 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-4342ad0f-1391-4c2d-b5ac-272aa935239f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:12:21.500786 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1345/2668] 10.222.0.46 () {58 vars in 1009 bytes} [Fri Jul 1 04:12:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:12:21.523438 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807dfac-536e-4249-a152-730c1575a570 service glance] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:12:21.647418 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807dfac-536e-4249-a152-730c1575a570 service glance] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:12:21.654331 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241a4a7-456a-4335-9f2c-0457d16eea85 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83787880173b459c8975b834bd47a51a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:12:21.654331 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241a4a7-456a-4335-9f2c-0457d16eea85 service swift] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:12:21.654703 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241a4a7-456a-4335-9f2c-0457d16eea85 service swift] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:12:21.654703 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241a4a7-456a-4335-9f2c-0457d16eea85 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:12:21.666061 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9241a4a7-456a-4335-9f2c-0457d16eea85 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:12:21.667745 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9241a4a7-456a-4335-9f2c-0457d16eea85 service swift] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:12:21.677236 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1324/2669] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Jul 1 04:12:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 04:12:28.893588 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342ad0f-1391-4c2d-b5ac-272aa935239f None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:12:28.895689 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-4342ad0f-1391-4c2d-b5ac-272aa935239f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:12:28.919948 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342ad0f-1391-4c2d-b5ac-272aa935239f None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:12:28.945357 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a59b16-de4e-4165-939e-575f4c42711c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:12:28.946168 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a59b16-de4e-4165-939e-575f4c42711c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:12:28.946455 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a59b16-de4e-4165-939e-575f4c42711c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:12:28.946735 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a59b16-de4e-4165-939e-575f4c42711c admin admin] PATH_INFO: `/v3/users/ea3be916625844d1b54f8550aef3317d` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:12:28.948250 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a59b16-de4e-4165-939e-575f4c42711c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea3be916625844d1b54f8550aef3317d)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:12:28.950206 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a59b16-de4e-4165-939e-575f4c42711c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:12:29.150671 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-75a59b16-de4e-4165-939e-575f4c42711c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea3be916625844d1b54f8550aef3317d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:12:29.151636 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-75a59b16-de4e-4165-939e-575f4c42711c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea3be916625844d1b54f8550aef3317d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:12:29.176552 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-75a59b16-de4e-4165-939e-575f4c42711c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea3be916625844d1b54f8550aef3317d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:12:29.184350 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-75a59b16-de4e-4165-939e-575f4c42711c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea3be916625844d1b54f8550aef3317d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:12:29.185143 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-75a59b16-de4e-4165-939e-575f4c42711c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea3be916625844d1b54f8550aef3317d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:12:29.264513 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1346/2670] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:12:28 2022] DELETE /identity/v3/users/ea3be916625844d1b54f8550aef3317d => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:12:29.569785 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241a4a7-456a-4335-9f2c-0457d16eea85 service swift] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:12:29.584295 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241a4a7-456a-4335-9f2c-0457d16eea85 service swift] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:12:29.599933 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=100 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:12:29.670688 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4519dd0-d77e-4ea2-b800-506c7f3b9ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:12:29.671877 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4519dd0-d77e-4ea2-b800-506c7f3b9ea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:12:29.672252 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4519dd0-d77e-4ea2-b800-506c7f3b9ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:12:29.672729 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4519dd0-d77e-4ea2-b800-506c7f3b9ea3 admin admin] PATH_INFO: `/v3/projects/fe3e4a4778534182afc7c220ca0f86a9` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:12:29.675239 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4519dd0-d77e-4ea2-b800-506c7f3b9ea3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe3e4a4778534182afc7c220ca0f86a9)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:12:29.677718 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4519dd0-d77e-4ea2-b800-506c7f3b9ea3 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:12:30.162188 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-b4519dd0-d77e-4ea2-b800-506c7f3b9ea3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe3e4a4778534182afc7c220ca0f86a9', 'request_id': 'req-b4519dd0-d77e-4ea2-b800-506c7f3b9ea3'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:12:30.168831 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-b4519dd0-d77e-4ea2-b800-506c7f3b9ea3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe3e4a4778534182afc7c220ca0f86a9', 'request_id': 'req-b4519dd0-d77e-4ea2-b800-506c7f3b9ea3'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:12:30.175223 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-b4519dd0-d77e-4ea2-b800-506c7f3b9ea3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe3e4a4778534182afc7c220ca0f86a9', 'request_id': 'req-b4519dd0-d77e-4ea2-b800-506c7f3b9ea3'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:12:30.271578 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-b4519dd0-d77e-4ea2-b800-506c7f3b9ea3 admin admin] The token cache is being invalidate because project fe3e4a4778534182afc7c220ca0f86a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:12:30.271931 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-b4519dd0-d77e-4ea2-b800-506c7f3b9ea3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:12:30.272544 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-b4519dd0-d77e-4ea2-b800-506c7f3b9ea3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:12:30.274487 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1325/2671] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:12:29 2022] DELETE /identity/v3/projects/fe3e4a4778534182afc7c220ca0f86a9 => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:12:30.278442 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a59b16-de4e-4165-939e-575f4c42711c admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:12:30.280444 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-75a59b16-de4e-4165-939e-575f4c42711c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:12:30.299981 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a59b16-de4e-4165-939e-575f4c42711c admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:12:30.373215 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:12:30.382149 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b5f28-bf35-4cf2-8192-772173cd9960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:12:30.383136 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b5f28-bf35-4cf2-8192-772173cd9960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:12:30.383503 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b5f28-bf35-4cf2-8192-772173cd9960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:12:30.384061 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b5f28-bf35-4cf2-8192-772173cd9960 admin admin] PATH_INFO: `/v3/users/4478d02971764fd8b9d9d98bec144245` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:12:30.385835 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1b5f28-bf35-4cf2-8192-772173cd9960 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4478d02971764fd8b9d9d98bec144245)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:12:30.391156 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1b5f28-bf35-4cf2-8192-772173cd9960 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:12:30.624240 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-3f1b5f28-bf35-4cf2-8192-772173cd9960 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4478d02971764fd8b9d9d98bec144245'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:12:30.624945 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-3f1b5f28-bf35-4cf2-8192-772173cd9960 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4478d02971764fd8b9d9d98bec144245'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:12:30.640054 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-3f1b5f28-bf35-4cf2-8192-772173cd9960 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4478d02971764fd8b9d9d98bec144245'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:12:30.648026 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-3f1b5f28-bf35-4cf2-8192-772173cd9960 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4478d02971764fd8b9d9d98bec144245'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:12:30.648756 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-3f1b5f28-bf35-4cf2-8192-772173cd9960 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4478d02971764fd8b9d9d98bec144245'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:12:30.743054 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1347/2672] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:12:30 2022] DELETE /identity/v3/users/4478d02971764fd8b9d9d98bec144245 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:12:30.998348 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4519dd0-d77e-4ea2-b800-506c7f3b9ea3 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:12:30.999954 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-b4519dd0-d77e-4ea2-b800-506c7f3b9ea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:12:31.033375 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4519dd0-d77e-4ea2-b800-506c7f3b9ea3 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:12:31.106943 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285da54-57a8-4153-9303-0779e0dd63b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:12:31.107847 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285da54-57a8-4153-9303-0779e0dd63b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:12:31.108166 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285da54-57a8-4153-9303-0779e0dd63b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:12:31.108406 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285da54-57a8-4153-9303-0779e0dd63b8 admin admin] PATH_INFO: `/v3/projects/21fd5470a29f4a8a86b1928510b621e0` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:12:31.112571 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4285da54-57a8-4153-9303-0779e0dd63b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21fd5470a29f4a8a86b1928510b621e0)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:12:31.114426 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4285da54-57a8-4153-9303-0779e0dd63b8 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:12:31.243881 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:12:31.254545 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-4285da54-57a8-4153-9303-0779e0dd63b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21fd5470a29f4a8a86b1928510b621e0', 'request_id': 'req-4285da54-57a8-4153-9303-0779e0dd63b8'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:12:31.268517 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-4285da54-57a8-4153-9303-0779e0dd63b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21fd5470a29f4a8a86b1928510b621e0', 'request_id': 'req-4285da54-57a8-4153-9303-0779e0dd63b8'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:12:31.276388 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-4285da54-57a8-4153-9303-0779e0dd63b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21fd5470a29f4a8a86b1928510b621e0', 'request_id': 'req-4285da54-57a8-4153-9303-0779e0dd63b8'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:12:31.327342 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-4285da54-57a8-4153-9303-0779e0dd63b8 admin admin] The token cache is being invalidate because project 21fd5470a29f4a8a86b1928510b621e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:12:31.327342 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-4285da54-57a8-4153-9303-0779e0dd63b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:12:31.329142 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-4285da54-57a8-4153-9303-0779e0dd63b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:12:31.347571 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1326/2673] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:12:30 2022] DELETE /identity/v3/projects/21fd5470a29f4a8a86b1928510b621e0 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:12:35.428863 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1d39a-e5e2-4966-b527-562da804d7e2 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:12:35.429459 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1d39a-e5e2-4966-b527-562da804d7e2 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:12:35.429459 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1d39a-e5e2-4966-b527-562da804d7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:12:35.447616 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-b4e1d39a-e5e2-4966-b527-562da804d7e2 None None] MFA Rules not processed for user `cc6337d8ba584d9c87f6d0a1404d60cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:12:35.448800 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b4e1d39a-e5e2-4966-b527-562da804d7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:12:35.511628 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1348/2674] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:12:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:12:35.768692 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285da54-57a8-4153-9303-0779e0dd63b8 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:12:35.772665 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-4285da54-57a8-4153-9303-0779e0dd63b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:12:35.838167 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285da54-57a8-4153-9303-0779e0dd63b8 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:12:35.842249 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23244d-7c62-4da5-b76f-e489acb8ad9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:12:35.845350 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23244d-7c62-4da5-b76f-e489acb8ad9d service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:12:35.845350 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23244d-7c62-4da5-b76f-e489acb8ad9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:12:35.845350 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23244d-7c62-4da5-b76f-e489acb8ad9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:12:35.845680 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-ea23244d-7c62-4da5-b76f-e489acb8ad9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:12:35.855974 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea23244d-7c62-4da5-b76f-e489acb8ad9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:12:35.857479 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea23244d-7c62-4da5-b76f-e489acb8ad9d service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:12:35.867141 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1327/2675] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:12:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 04:12:39.006792 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7e5a9-2837-40f6-8536-1de2f23046f1 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:12:39.008657 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7e5a9-2837-40f6-8536-1de2f23046f1 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:12:39.008657 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7e5a9-2837-40f6-8536-1de2f23046f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:12:39.025810 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-1bf7e5a9-2837-40f6-8536-1de2f23046f1 None None] MFA Rules not processed for user `dd41221abea04808bed5ef4ac4528c62`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:12:39.027014 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1bf7e5a9-2837-40f6-8536-1de2f23046f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:12:39.085087 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1349/2676] 10.222.0.46 () {58 vars in 1009 bytes} [Fri Jul 1 04:12:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:12:39.097833 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23244d-7c62-4da5-b76f-e489acb8ad9d service neutron] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:12:39.099812 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-ea23244d-7c62-4da5-b76f-e489acb8ad9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:12:39.177177 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23244d-7c62-4da5-b76f-e489acb8ad9d service neutron] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:12:39.182154 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf1aa4-50c5-4b3a-8e9b-3416f538f48e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83787880173b459c8975b834bd47a51a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:12:39.182808 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf1aa4-50c5-4b3a-8e9b-3416f538f48e service swift] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:12:39.183091 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf1aa4-50c5-4b3a-8e9b-3416f538f48e service swift] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:12:39.183368 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf1aa4-50c5-4b3a-8e9b-3416f538f48e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:12:39.191732 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf1aa4-50c5-4b3a-8e9b-3416f538f48e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:12:39.193311 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf1aa4-50c5-4b3a-8e9b-3416f538f48e service swift] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:12:39.201294 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1328/2677] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Jul 1 04:12:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 04:12:49.078300 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=78,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:12:49.200364 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=66,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:12:51.866703 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7e5a9-2837-40f6-8536-1de2f23046f1 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:12:51.868141 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1bf7e5a9-2837-40f6-8536-1de2f23046f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:12:51.949384 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7e5a9-2837-40f6-8536-1de2f23046f1 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:12:51.954838 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f27c3-1f2f-47b9-b668-bfcba8e10ad2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efe4a6dd11047688892641a936e2914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:12:51.956103 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f27c3-1f2f-47b9-b668-bfcba8e10ad2 service placement] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:12:51.956382 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f27c3-1f2f-47b9-b668-bfcba8e10ad2 service placement] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:12:51.956655 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f27c3-1f2f-47b9-b668-bfcba8e10ad2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:12:51.958461 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-fe3f27c3-1f2f-47b9-b668-bfcba8e10ad2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:12:51.971106 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f27c3-1f2f-47b9-b668-bfcba8e10ad2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:12:51.972771 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f27c3-1f2f-47b9-b668-bfcba8e10ad2 service placement] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:12:51.983467 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1350/2678] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:12:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:12:56.982260 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf1aa4-50c5-4b3a-8e9b-3416f538f48e service swift] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:12:56.992363 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf1aa4-50c5-4b3a-8e9b-3416f538f48e service swift] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:12:56.996128 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc446be0-de41-429e-87e8-ef37f1fef66f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:12:56.996769 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc446be0-de41-429e-87e8-ef37f1fef66f service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:12:56.997053 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc446be0-de41-429e-87e8-ef37f1fef66f service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:12:56.997330 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc446be0-de41-429e-87e8-ef37f1fef66f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:12:56.999091 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-fc446be0-de41-429e-87e8-ef37f1fef66f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:12:57.072710 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc446be0-de41-429e-87e8-ef37f1fef66f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:12:57.074163 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc446be0-de41-429e-87e8-ef37f1fef66f service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:12:57.085147 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1329/2679] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:12:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:13:01.173025 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f27c3-1f2f-47b9-b668-bfcba8e10ad2 service placement] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:01.175920 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-fe3f27c3-1f2f-47b9-b668-bfcba8e10ad2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:01.191436 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f27c3-1f2f-47b9-b668-bfcba8e10ad2 service placement] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:01.196531 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e8401-5d2f-42f0-bea2-d28b78d65618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:01.197439 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e8401-5d2f-42f0-bea2-d28b78d65618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:01.197719 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e8401-5d2f-42f0-bea2-d28b78d65618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:01.198277 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e8401-5d2f-42f0-bea2-d28b78d65618 admin admin] PATH_INFO: `/v3/users/9afe0c6c75c44f7e98d2e5d19b45912c` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:01.199494 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e8401-5d2f-42f0-bea2-d28b78d65618 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9afe0c6c75c44f7e98d2e5d19b45912c)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:01.201455 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e8401-5d2f-42f0-bea2-d28b78d65618 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:01.456063 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-127e8401-5d2f-42f0-bea2-d28b78d65618 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9afe0c6c75c44f7e98d2e5d19b45912c'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:01.456726 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-127e8401-5d2f-42f0-bea2-d28b78d65618 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9afe0c6c75c44f7e98d2e5d19b45912c'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:01.469898 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-127e8401-5d2f-42f0-bea2-d28b78d65618 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9afe0c6c75c44f7e98d2e5d19b45912c'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:01.478726 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-127e8401-5d2f-42f0-bea2-d28b78d65618 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9afe0c6c75c44f7e98d2e5d19b45912c'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:01.479495 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-127e8401-5d2f-42f0-bea2-d28b78d65618 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9afe0c6c75c44f7e98d2e5d19b45912c'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:01.630327 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1351/2680] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:13:01 2022] DELETE /identity/v3/users/9afe0c6c75c44f7e98d2e5d19b45912c => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:13:01.953138 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc446be0-de41-429e-87e8-ef37f1fef66f service neutron] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:01.976791 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc446be0-de41-429e-87e8-ef37f1fef66f service neutron] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:02.046012 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2428bd22-fbae-480d-a17a-129c375ad2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:02.046922 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428bd22-fbae-480d-a17a-129c375ad2c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:02.047220 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428bd22-fbae-480d-a17a-129c375ad2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:02.047509 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428bd22-fbae-480d-a17a-129c375ad2c0 admin admin] PATH_INFO: `/v3/projects/69dda41721014571baa82cfc8899d2e9` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:02.048752 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2428bd22-fbae-480d-a17a-129c375ad2c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69dda41721014571baa82cfc8899d2e9)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:02.051305 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2428bd22-fbae-480d-a17a-129c375ad2c0 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:02.191098 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-2428bd22-fbae-480d-a17a-129c375ad2c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69dda41721014571baa82cfc8899d2e9', 'request_id': 'req-2428bd22-fbae-480d-a17a-129c375ad2c0'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:02.197367 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-2428bd22-fbae-480d-a17a-129c375ad2c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69dda41721014571baa82cfc8899d2e9', 'request_id': 'req-2428bd22-fbae-480d-a17a-129c375ad2c0'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:02.202809 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-2428bd22-fbae-480d-a17a-129c375ad2c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69dda41721014571baa82cfc8899d2e9', 'request_id': 'req-2428bd22-fbae-480d-a17a-129c375ad2c0'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:02.252606 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-2428bd22-fbae-480d-a17a-129c375ad2c0 admin admin] The token cache is being invalidate because project 69dda41721014571baa82cfc8899d2e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:13:02.252856 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-2428bd22-fbae-480d-a17a-129c375ad2c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:02.253581 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-2428bd22-fbae-480d-a17a-129c375ad2c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:02.255265 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1330/2681] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:13:01 2022] DELETE /identity/v3/projects/69dda41721014571baa82cfc8899d2e9 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:13:02.260565 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b3afe-9021-4c6a-8e98-34625ba1a6cb None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:02.261088 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b3afe-9021-4c6a-8e98-34625ba1a6cb None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:02.261212 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b3afe-9021-4c6a-8e98-34625ba1a6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:02.279371 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-230b3afe-9021-4c6a-8e98-34625ba1a6cb None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:13:02.280651 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-230b3afe-9021-4c6a-8e98-34625ba1a6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:02.345758 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1352/2682] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:13:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:13:02.354399 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107905d-c93f-422f-a38d-df1a0348e38d None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:02.354686 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107905d-c93f-422f-a38d-df1a0348e38d None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:02.354971 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107905d-c93f-422f-a38d-df1a0348e38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:02.375054 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-1107905d-c93f-422f-a38d-df1a0348e38d None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:13:02.376351 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-1107905d-c93f-422f-a38d-df1a0348e38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:02.385659 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1331/2683] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:13:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 04:13:02.390645 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b3afe-9021-4c6a-8e98-34625ba1a6cb None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:02.395577 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:13:02.400885 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b3afe-9021-4c6a-8e98-34625ba1a6cb None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:02.405711 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e856c2-387d-4fe4-a6f4-66ab6cb740c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:02.409334 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e856c2-387d-4fe4-a6f4-66ab6cb740c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:02.409334 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e856c2-387d-4fe4-a6f4-66ab6cb740c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:02.409334 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e856c2-387d-4fe4-a6f4-66ab6cb740c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:02.409334 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e856c2-387d-4fe4-a6f4-66ab6cb740c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:13:02.409334 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e856c2-387d-4fe4-a6f4-66ab6cb740c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:02.410163 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e856c2-387d-4fe4-a6f4-66ab6cb740c7 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:02.422450 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1353/2684] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:13:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:13:02.427544 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107905d-c93f-422f-a38d-df1a0348e38d None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:02.436679 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107905d-c93f-422f-a38d-df1a0348e38d None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:02.442518 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d48b71-bddc-4a15-bb3d-541c97e08b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:02.443164 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d48b71-bddc-4a15-bb3d-541c97e08b61 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:02.443489 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d48b71-bddc-4a15-bb3d-541c97e08b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:02.443767 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d48b71-bddc-4a15-bb3d-541c97e08b61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:02.444457 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d48b71-bddc-4a15-bb3d-541c97e08b61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:02.446397 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d48b71-bddc-4a15-bb3d-541c97e08b61 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:02.460479 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:13:02.540558 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1332/2685] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:13:02 2022] POST /identity/v3/projects => generated 401 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:13:02.544979 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e856c2-387d-4fe4-a6f4-66ab6cb740c7 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:02.556649 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e856c2-387d-4fe4-a6f4-66ab6cb740c7 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:02.618570 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220da07-3d4e-44b6-a5c5-0db0e8dd1556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:02.619908 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220da07-3d4e-44b6-a5c5-0db0e8dd1556 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:02.620193 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220da07-3d4e-44b6-a5c5-0db0e8dd1556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:02.620472 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220da07-3d4e-44b6-a5c5-0db0e8dd1556 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:02.621169 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1220da07-3d4e-44b6-a5c5-0db0e8dd1556 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:02.623239 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1220da07-3d4e-44b6-a5c5-0db0e8dd1556 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:02.744439 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1354/2686] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:13:02 2022] POST /identity/v3/users => generated 301 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:13:02.748464 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d48b71-bddc-4a15-bb3d-541c97e08b61 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:02.759910 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d48b71-bddc-4a15-bb3d-541c97e08b61 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:02.764643 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54e922-cec3-49a9-a0d2-484d2c9eac86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:02.765290 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54e922-cec3-49a9-a0d2-484d2c9eac86 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:02.765574 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54e922-cec3-49a9-a0d2-484d2c9eac86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:02.765848 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54e922-cec3-49a9-a0d2-484d2c9eac86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:02.766575 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd54e922-cec3-49a9-a0d2-484d2c9eac86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:02.769311 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd54e922-cec3-49a9-a0d2-484d2c9eac86 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:02.780279 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1333/2687] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:13:02.784822 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220da07-3d4e-44b6-a5c5-0db0e8dd1556 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:02.795597 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220da07-3d4e-44b6-a5c5-0db0e8dd1556 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:02.800561 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101923dd-8d32-4309-a02d-6a408e7f2786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:02.801245 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101923dd-8d32-4309-a02d-6a408e7f2786 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:02.801542 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101923dd-8d32-4309-a02d-6a408e7f2786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:02.801820 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101923dd-8d32-4309-a02d-6a408e7f2786 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:02.802555 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101923dd-8d32-4309-a02d-6a408e7f2786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:02.804206 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101923dd-8d32-4309-a02d-6a408e7f2786 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:02.814651 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1355/2688] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:13:02.820334 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54e922-cec3-49a9-a0d2-484d2c9eac86 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:02.832345 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54e922-cec3-49a9-a0d2-484d2c9eac86 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:02.837051 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b5ebf6-4503-4ec9-9b64-931e6ce15d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:02.838033 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5ebf6-4503-4ec9-9b64-931e6ce15d00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:02.838333 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5ebf6-4503-4ec9-9b64-931e6ce15d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:02.838611 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5ebf6-4503-4ec9-9b64-931e6ce15d00 admin admin] PATH_INFO: `/v3/projects/dc92aa4a3f504484bbaed78a07f8aaaf/users/4494409228ce4f08ab2e6aa651597cc8/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:02.857498 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b5ebf6-4503-4ec9-9b64-931e6ce15d00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc92aa4a3f504484bbaed78a07f8aaaf, user_id=4494409228ce4f08ab2e6aa651597cc8, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:02.860464 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b5ebf6-4503-4ec9-9b64-931e6ce15d00 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:02.945057 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1334/2689] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:13:02 2022] PUT /identity/v3/projects/dc92aa4a3f504484bbaed78a07f8aaaf/users/4494409228ce4f08ab2e6aa651597cc8/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:13:02.956700 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860378dd-740a-4f5b-87e9-fb45024dccc6 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:02.956981 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860378dd-740a-4f5b-87e9-fb45024dccc6 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:02.957262 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860378dd-740a-4f5b-87e9-fb45024dccc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:02.985101 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-860378dd-740a-4f5b-87e9-fb45024dccc6 None None] MFA Rules not processed for user `4494409228ce4f08ab2e6aa651597cc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:13:02.986312 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-860378dd-740a-4f5b-87e9-fb45024dccc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:03.051257 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1356/2690] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:13:02 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:13:03.055820 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b5ebf6-4503-4ec9-9b64-931e6ce15d00 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:03.119569 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b5ebf6-4503-4ec9-9b64-931e6ce15d00 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:03.124331 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eaf0af-5e32-4bbe-9d17-89e81ec8cab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:03.124991 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eaf0af-5e32-4bbe-9d17-89e81ec8cab6 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:03.125274 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eaf0af-5e32-4bbe-9d17-89e81ec8cab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:03.125548 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eaf0af-5e32-4bbe-9d17-89e81ec8cab6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:03.126232 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eaf0af-5e32-4bbe-9d17-89e81ec8cab6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:03.128666 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eaf0af-5e32-4bbe-9d17-89e81ec8cab6 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:03.219621 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1335/2691] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:13:03 2022] POST /identity/v3/projects => generated 399 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:13:03.223771 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860378dd-740a-4f5b-87e9-fb45024dccc6 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:03.234657 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860378dd-740a-4f5b-87e9-fb45024dccc6 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:03.285460 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:13:03.292460 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5ef87-a44f-41ea-9443-c5a0b3d74c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:03.293142 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5ef87-a44f-41ea-9443-c5a0b3d74c07 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:03.293454 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5ef87-a44f-41ea-9443-c5a0b3d74c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:03.293724 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5ef87-a44f-41ea-9443-c5a0b3d74c07 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:03.294411 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5ef87-a44f-41ea-9443-c5a0b3d74c07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:03.296360 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5ef87-a44f-41ea-9443-c5a0b3d74c07 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:03.424638 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1357/2692] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:13:03 2022] POST /identity/v3/users => generated 306 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:13:03.428392 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eaf0af-5e32-4bbe-9d17-89e81ec8cab6 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:03.438622 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eaf0af-5e32-4bbe-9d17-89e81ec8cab6 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:03.443902 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c418e-9f28-4ab4-ab1a-2c4449d38574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:03.444561 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c418e-9f28-4ab4-ab1a-2c4449d38574 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:03.444875 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c418e-9f28-4ab4-ab1a-2c4449d38574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:03.445141 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c418e-9f28-4ab4-ab1a-2c4449d38574 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:03.445867 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c418e-9f28-4ab4-ab1a-2c4449d38574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:03.447473 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c418e-9f28-4ab4-ab1a-2c4449d38574 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:03.458714 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1336/2693] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:13:03.462936 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5ef87-a44f-41ea-9443-c5a0b3d74c07 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:03.473269 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5ef87-a44f-41ea-9443-c5a0b3d74c07 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:03.477967 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99fc1b-b29e-487d-bbb5-c3a1ac39d340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:03.478857 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99fc1b-b29e-487d-bbb5-c3a1ac39d340 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:03.479142 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99fc1b-b29e-487d-bbb5-c3a1ac39d340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:03.479424 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99fc1b-b29e-487d-bbb5-c3a1ac39d340 admin admin] PATH_INFO: `/v3/projects/6c3fa52b84fe4e1581480e1bb7632d37/users/4024aedf1ff4424087ba72cb7568382e/roles/681755518698445fabd9a8accec13c0f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:03.495830 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f99fc1b-b29e-487d-bbb5-c3a1ac39d340 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c3fa52b84fe4e1581480e1bb7632d37, user_id=4024aedf1ff4424087ba72cb7568382e, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:03.498557 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f99fc1b-b29e-487d-bbb5-c3a1ac39d340 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:03.573516 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1358/2694] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:13:03 2022] PUT /identity/v3/projects/6c3fa52b84fe4e1581480e1bb7632d37/users/4024aedf1ff4424087ba72cb7568382e/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:13:03.577454 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c418e-9f28-4ab4-ab1a-2c4449d38574 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:03.587384 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c418e-9f28-4ab4-ab1a-2c4449d38574 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:03.652632 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6dfd8-c2d3-43c4-aa25-cf4d6caca469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:03.653312 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6dfd8-c2d3-43c4-aa25-cf4d6caca469 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:03.653593 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6dfd8-c2d3-43c4-aa25-cf4d6caca469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:03.653873 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6dfd8-c2d3-43c4-aa25-cf4d6caca469 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:03.654602 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc6dfd8-c2d3-43c4-aa25-cf4d6caca469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:03.656279 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc6dfd8-c2d3-43c4-aa25-cf4d6caca469 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:03.667807 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1337/2695] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:13:03.672242 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99fc1b-b29e-487d-bbb5-c3a1ac39d340 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:03.684479 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99fc1b-b29e-487d-bbb5-c3a1ac39d340 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:03.689865 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb046b3-230a-4d15-a1f0-024033080408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:03.691501 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb046b3-230a-4d15-a1f0-024033080408 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:03.691793 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb046b3-230a-4d15-a1f0-024033080408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:03.692103 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb046b3-230a-4d15-a1f0-024033080408 admin admin] PATH_INFO: `/v3/projects/6c3fa52b84fe4e1581480e1bb7632d37/users/4024aedf1ff4424087ba72cb7568382e/roles/681755518698445fabd9a8accec13c0f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:03.699023 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb046b3-230a-4d15-a1f0-024033080408 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c3fa52b84fe4e1581480e1bb7632d37, user_id=4024aedf1ff4424087ba72cb7568382e, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:03.701767 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb046b3-230a-4d15-a1f0-024033080408 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:03.713240 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1359/2696] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:13:03 2022] PUT /identity/v3/projects/6c3fa52b84fe4e1581480e1bb7632d37/users/4024aedf1ff4424087ba72cb7568382e/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:13:03.724004 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c90d9f-5070-40e9-b189-8ffa05662156 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:03.724302 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c90d9f-5070-40e9-b189-8ffa05662156 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:03.724585 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c90d9f-5070-40e9-b189-8ffa05662156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:03.752396 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-d1c90d9f-5070-40e9-b189-8ffa05662156 None None] MFA Rules not processed for user `4024aedf1ff4424087ba72cb7568382e`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:13:03.754208 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-d1c90d9f-5070-40e9-b189-8ffa05662156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:03.772902 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:13:03.824170 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1338/2697] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:13:03 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:13:03.835474 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb046b3-230a-4d15-a1f0-024033080408 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:03.837173 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-4eb046b3-230a-4d15-a1f0-024033080408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:03.902170 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb046b3-230a-4d15-a1f0-024033080408 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:03.905666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88efba82-a41c-487b-8d03-e3587f1c47f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:03.906310 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efba82-a41c-487b-8d03-e3587f1c47f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:03.906596 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efba82-a41c-487b-8d03-e3587f1c47f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:03.906875 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efba82-a41c-487b-8d03-e3587f1c47f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:03.917093 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88efba82-a41c-487b-8d03-e3587f1c47f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:03.918545 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88efba82-a41c-487b-8d03-e3587f1c47f3 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:03.929254 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1360/2698] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:13:03 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 04:13:04.129748 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c90d9f-5070-40e9-b189-8ffa05662156 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:04.131615 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-d1c90d9f-5070-40e9-b189-8ffa05662156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:04.144517 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c90d9f-5070-40e9-b189-8ffa05662156 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:04.148252 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b12648-df17-46d3-9ebb-2881b53e2394 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:04.148959 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b12648-df17-46d3-9ebb-2881b53e2394 service cinder] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:04.152044 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b12648-df17-46d3-9ebb-2881b53e2394 service cinder] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:04.152044 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b12648-df17-46d3-9ebb-2881b53e2394 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:04.216030 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b12648-df17-46d3-9ebb-2881b53e2394 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:04.217515 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b12648-df17-46d3-9ebb-2881b53e2394 service cinder] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:04.222648 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88efba82-a41c-487b-8d03-e3587f1c47f3 service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:04.224273 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-88efba82-a41c-487b-8d03-e3587f1c47f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:04.227940 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1339/2699] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:13:04 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:13:04.283762 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88efba82-a41c-487b-8d03-e3587f1c47f3 service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:04.287936 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542300ed-6d40-42cb-aa5e-e0b371f78816 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:04.288941 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542300ed-6d40-42cb-aa5e-e0b371f78816 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:04.289103 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542300ed-6d40-42cb-aa5e-e0b371f78816 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:04.289373 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542300ed-6d40-42cb-aa5e-e0b371f78816 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:04.291123 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-542300ed-6d40-42cb-aa5e-e0b371f78816 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:04.357317 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542300ed-6d40-42cb-aa5e-e0b371f78816 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:04.358753 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542300ed-6d40-42cb-aa5e-e0b371f78816 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:04.369648 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1361/2700] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:13:04 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 04:13:09.483933 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b12648-df17-46d3-9ebb-2881b53e2394 service cinder] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:09.553310 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b12648-df17-46d3-9ebb-2881b53e2394 service cinder] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:09.558066 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42712e0c-89f7-413d-aafd-bd3d48351d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:09.558810 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42712e0c-89f7-413d-aafd-bd3d48351d55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:09.559273 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42712e0c-89f7-413d-aafd-bd3d48351d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:09.559785 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42712e0c-89f7-413d-aafd-bd3d48351d55 admin admin] PATH_INFO: `/v3/users/4494409228ce4f08ab2e6aa651597cc8` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:09.566630 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42712e0c-89f7-413d-aafd-bd3d48351d55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4494409228ce4f08ab2e6aa651597cc8)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:09.566630 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42712e0c-89f7-413d-aafd-bd3d48351d55 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:09.775017 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-42712e0c-89f7-413d-aafd-bd3d48351d55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4494409228ce4f08ab2e6aa651597cc8'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:09.776368 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-42712e0c-89f7-413d-aafd-bd3d48351d55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4494409228ce4f08ab2e6aa651597cc8'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:09.871320 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-42712e0c-89f7-413d-aafd-bd3d48351d55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4494409228ce4f08ab2e6aa651597cc8'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:09.872063 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-42712e0c-89f7-413d-aafd-bd3d48351d55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4494409228ce4f08ab2e6aa651597cc8'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:09.876071 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:13:09.886496 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-42712e0c-89f7-413d-aafd-bd3d48351d55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4494409228ce4f08ab2e6aa651597cc8'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:09.914723 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1340/2701] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:13:09 2022] DELETE /identity/v3/users/4494409228ce4f08ab2e6aa651597cc8 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:13:09.916790 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae38aeb-999b-4c74-b0be-1d96fc07e67d None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:09.916790 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae38aeb-999b-4c74-b0be-1d96fc07e67d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:09.917942 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae38aeb-999b-4c74-b0be-1d96fc07e67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:09.923711 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:13:09.938057 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-cae38aeb-999b-4c74-b0be-1d96fc07e67d None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:13:09.939595 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-cae38aeb-999b-4c74-b0be-1d96fc07e67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:10.015348 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1362/2702] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:13:10.026635 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42712e0c-89f7-413d-aafd-bd3d48351d55 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:10.028164 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-42712e0c-89f7-413d-aafd-bd3d48351d55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:10.095857 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42712e0c-89f7-413d-aafd-bd3d48351d55 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:10.103315 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a0d66-d414-43de-bad8-35ab10fda83a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:10.104081 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a0d66-d414-43de-bad8-35ab10fda83a service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:10.104370 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a0d66-d414-43de-bad8-35ab10fda83a service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:10.104647 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a0d66-d414-43de-bad8-35ab10fda83a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:10.115558 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a0d66-d414-43de-bad8-35ab10fda83a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:10.117055 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a0d66-d414-43de-bad8-35ab10fda83a service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:10.134637 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1341/2703] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:13:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:13:10.671630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae38aeb-999b-4c74-b0be-1d96fc07e67d None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:10.673999 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-cae38aeb-999b-4c74-b0be-1d96fc07e67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:10.687900 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae38aeb-999b-4c74-b0be-1d96fc07e67d None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:10.693351 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03350c0e-7b21-4e85-849d-c0affcb022b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:10.694226 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03350c0e-7b21-4e85-849d-c0affcb022b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:10.694676 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03350c0e-7b21-4e85-849d-c0affcb022b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:10.695133 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03350c0e-7b21-4e85-849d-c0affcb022b6 admin admin] PATH_INFO: `/v3/projects/dc92aa4a3f504484bbaed78a07f8aaaf` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:10.696561 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03350c0e-7b21-4e85-849d-c0affcb022b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc92aa4a3f504484bbaed78a07f8aaaf)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:10.698594 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03350c0e-7b21-4e85-849d-c0affcb022b6 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:10.860602 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-03350c0e-7b21-4e85-849d-c0affcb022b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc92aa4a3f504484bbaed78a07f8aaaf', 'request_id': 'req-03350c0e-7b21-4e85-849d-c0affcb022b6'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:10.938267 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-03350c0e-7b21-4e85-849d-c0affcb022b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc92aa4a3f504484bbaed78a07f8aaaf', 'request_id': 'req-03350c0e-7b21-4e85-849d-c0affcb022b6'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:10.945226 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-03350c0e-7b21-4e85-849d-c0affcb022b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc92aa4a3f504484bbaed78a07f8aaaf', 'request_id': 'req-03350c0e-7b21-4e85-849d-c0affcb022b6'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:10.958271 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-03350c0e-7b21-4e85-849d-c0affcb022b6 admin admin] The token cache is being invalidate because project dc92aa4a3f504484bbaed78a07f8aaaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:13:10.959895 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-03350c0e-7b21-4e85-849d-c0affcb022b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:10.959895 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-03350c0e-7b21-4e85-849d-c0affcb022b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:10.960947 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1363/2704] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:13:10 2022] DELETE /identity/v3/projects/dc92aa4a3f504484bbaed78a07f8aaaf => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:13:10.965136 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a0d66-d414-43de-bad8-35ab10fda83a service neutron] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:10.976137 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a0d66-d414-43de-bad8-35ab10fda83a service neutron] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:11.038959 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c99a5c-ba67-4715-aa94-f1ecc1c7c55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:11.040128 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c99a5c-ba67-4715-aa94-f1ecc1c7c55d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:11.040418 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c99a5c-ba67-4715-aa94-f1ecc1c7c55d admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:11.040699 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c99a5c-ba67-4715-aa94-f1ecc1c7c55d admin admin] PATH_INFO: `/v3/users/4024aedf1ff4424087ba72cb7568382e` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:11.041957 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c99a5c-ba67-4715-aa94-f1ecc1c7c55d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4024aedf1ff4424087ba72cb7568382e)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:11.045746 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c99a5c-ba67-4715-aa94-f1ecc1c7c55d admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:11.237727 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-d0c99a5c-ba67-4715-aa94-f1ecc1c7c55d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4024aedf1ff4424087ba72cb7568382e'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:11.238359 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-d0c99a5c-ba67-4715-aa94-f1ecc1c7c55d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4024aedf1ff4424087ba72cb7568382e'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:11.326249 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-d0c99a5c-ba67-4715-aa94-f1ecc1c7c55d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4024aedf1ff4424087ba72cb7568382e'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:11.327165 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-d0c99a5c-ba67-4715-aa94-f1ecc1c7c55d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4024aedf1ff4424087ba72cb7568382e'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:11.336512 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-d0c99a5c-ba67-4715-aa94-f1ecc1c7c55d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4024aedf1ff4424087ba72cb7568382e'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:11.348134 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:13:11.354512 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1342/2705] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:13:10 2022] DELETE /identity/v3/users/4024aedf1ff4424087ba72cb7568382e => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:13:11.745265 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03350c0e-7b21-4e85-849d-c0affcb022b6 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:11.746731 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-03350c0e-7b21-4e85-849d-c0affcb022b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:11.760512 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03350c0e-7b21-4e85-849d-c0affcb022b6 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:11.828099 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc282511-839c-4fa3-8d68-5ba4346df167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:11.828977 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc282511-839c-4fa3-8d68-5ba4346df167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:11.829254 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc282511-839c-4fa3-8d68-5ba4346df167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:11.829528 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc282511-839c-4fa3-8d68-5ba4346df167 admin admin] PATH_INFO: `/v3/projects/6c3fa52b84fe4e1581480e1bb7632d37` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:11.830739 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc282511-839c-4fa3-8d68-5ba4346df167 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c3fa52b84fe4e1581480e1bb7632d37)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:11.833371 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc282511-839c-4fa3-8d68-5ba4346df167 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:11.923612 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:13:11.940352 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-dc282511-839c-4fa3-8d68-5ba4346df167 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c3fa52b84fe4e1581480e1bb7632d37', 'request_id': 'req-dc282511-839c-4fa3-8d68-5ba4346df167'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:11.989602 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-dc282511-839c-4fa3-8d68-5ba4346df167 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c3fa52b84fe4e1581480e1bb7632d37', 'request_id': 'req-dc282511-839c-4fa3-8d68-5ba4346df167'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:11.996043 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-dc282511-839c-4fa3-8d68-5ba4346df167 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c3fa52b84fe4e1581480e1bb7632d37', 'request_id': 'req-dc282511-839c-4fa3-8d68-5ba4346df167'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:12.009787 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-dc282511-839c-4fa3-8d68-5ba4346df167 admin admin] The token cache is being invalidate because project 6c3fa52b84fe4e1581480e1bb7632d37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:13:12.010078 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-dc282511-839c-4fa3-8d68-5ba4346df167 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:12.010745 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-dc282511-839c-4fa3-8d68-5ba4346df167 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:12.012369 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1364/2706] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:13:11 2022] DELETE /identity/v3/projects/6c3fa52b84fe4e1581480e1bb7632d37 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:13:12.017586 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0da34a-3ad4-44eb-bbe1-8ad98f1fe8db None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:12.018177 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0da34a-3ad4-44eb-bbe1-8ad98f1fe8db None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:12.018177 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0da34a-3ad4-44eb-bbe1-8ad98f1fe8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:12.037421 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-de0da34a-3ad4-44eb-bbe1-8ad98f1fe8db None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:13:12.038673 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-de0da34a-3ad4-44eb-bbe1-8ad98f1fe8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:12.103543 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1343/2707] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:13:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 04:13:12.111393 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d12201-64cc-46fd-96bb-98a04f35abd4 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:12.112288 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d12201-64cc-46fd-96bb-98a04f35abd4 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:12.112494 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d12201-64cc-46fd-96bb-98a04f35abd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:12.133972 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-a9d12201-64cc-46fd-96bb-98a04f35abd4 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:13:12.135186 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a9d12201-64cc-46fd-96bb-98a04f35abd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:12.143199 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1365/2708] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:13:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:13:12.147654 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0da34a-3ad4-44eb-bbe1-8ad98f1fe8db None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:12.157693 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0da34a-3ad4-44eb-bbe1-8ad98f1fe8db None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:12.162510 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c95df1f-5430-4089-8454-ba345eddb5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:12.163239 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95df1f-5430-4089-8454-ba345eddb5b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:12.163553 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95df1f-5430-4089-8454-ba345eddb5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:12.164116 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95df1f-5430-4089-8454-ba345eddb5b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:12.164884 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c95df1f-5430-4089-8454-ba345eddb5b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:13:12.165193 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c95df1f-5430-4089-8454-ba345eddb5b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:12.166797 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c95df1f-5430-4089-8454-ba345eddb5b7 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:12.179964 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1344/2709] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:13:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:13:12.184631 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d12201-64cc-46fd-96bb-98a04f35abd4 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:12.194938 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d12201-64cc-46fd-96bb-98a04f35abd4 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:12.199690 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b7602-1d8b-412b-97d7-cb6315f35001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:12.200352 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b7602-1d8b-412b-97d7-cb6315f35001 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:12.200634 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b7602-1d8b-412b-97d7-cb6315f35001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:12.200912 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b7602-1d8b-412b-97d7-cb6315f35001 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:12.201609 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b7602-1d8b-412b-97d7-cb6315f35001 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:12.203559 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b7602-1d8b-412b-97d7-cb6315f35001 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:12.322553 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1366/2710] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:13:12 2022] POST /identity/v3/projects => generated 379 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:13:12.326647 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c95df1f-5430-4089-8454-ba345eddb5b7 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:12.336917 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c95df1f-5430-4089-8454-ba345eddb5b7 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:12.395436 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6287a-8639-45df-85c2-ff6c5319230a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:12.396136 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6287a-8639-45df-85c2-ff6c5319230a admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:12.396416 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6287a-8639-45df-85c2-ff6c5319230a admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:12.396690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6287a-8639-45df-85c2-ff6c5319230a admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:12.397391 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c6287a-8639-45df-85c2-ff6c5319230a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:12.399311 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c6287a-8639-45df-85c2-ff6c5319230a admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:12.476127 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1345/2711] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:13:12 2022] POST /identity/v3/users => generated 290 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:13:12.480303 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b7602-1d8b-412b-97d7-cb6315f35001 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:12.491961 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b7602-1d8b-412b-97d7-cb6315f35001 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:12.496807 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3779f7f-7945-4aa8-bcd4-ac995cca1284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:12.497505 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3779f7f-7945-4aa8-bcd4-ac995cca1284 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:12.497786 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3779f7f-7945-4aa8-bcd4-ac995cca1284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:12.498061 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3779f7f-7945-4aa8-bcd4-ac995cca1284 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:12.498825 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3779f7f-7945-4aa8-bcd4-ac995cca1284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:12.500481 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3779f7f-7945-4aa8-bcd4-ac995cca1284 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:12.513859 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1367/2712] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:13:12.515184 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6287a-8639-45df-85c2-ff6c5319230a admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:12.525425 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6287a-8639-45df-85c2-ff6c5319230a admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:12.530064 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56f39a-a9c7-488e-8d2a-478bf872a770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:12.530697 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56f39a-a9c7-488e-8d2a-478bf872a770 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:12.530976 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56f39a-a9c7-488e-8d2a-478bf872a770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:12.531249 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56f39a-a9c7-488e-8d2a-478bf872a770 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:12.532014 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d56f39a-a9c7-488e-8d2a-478bf872a770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:12.533599 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d56f39a-a9c7-488e-8d2a-478bf872a770 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:12.544196 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1346/2713] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:13:12.548286 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3779f7f-7945-4aa8-bcd4-ac995cca1284 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:12.558936 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3779f7f-7945-4aa8-bcd4-ac995cca1284 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:12.563542 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a51633-9d43-405d-b6c7-8841d6ad6ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:12.564445 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a51633-9d43-405d-b6c7-8841d6ad6ba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:12.564726 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a51633-9d43-405d-b6c7-8841d6ad6ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:12.565001 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a51633-9d43-405d-b6c7-8841d6ad6ba4 admin admin] PATH_INFO: `/v3/projects/adcf5ecde55d4adfac0ff73244ea6a3a/users/4917cf80b1f0455baadb80da5154948c/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:12.579366 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a51633-9d43-405d-b6c7-8841d6ad6ba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adcf5ecde55d4adfac0ff73244ea6a3a, user_id=4917cf80b1f0455baadb80da5154948c, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:12.582105 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a51633-9d43-405d-b6c7-8841d6ad6ba4 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:12.675183 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1368/2714] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:13:12 2022] PUT /identity/v3/projects/adcf5ecde55d4adfac0ff73244ea6a3a/users/4917cf80b1f0455baadb80da5154948c/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:13:12.687792 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf8624-d34b-4a69-8a57-805edc35d67a None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:12.688088 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf8624-d34b-4a69-8a57-805edc35d67a None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:12.688375 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf8624-d34b-4a69-8a57-805edc35d67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:12.716872 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-afdf8624-d34b-4a69-8a57-805edc35d67a None None] MFA Rules not processed for user `4917cf80b1f0455baadb80da5154948c`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:13:12.718111 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-afdf8624-d34b-4a69-8a57-805edc35d67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:12.767818 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:13:12.789770 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1347/2715] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:13:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:13:12.794129 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a51633-9d43-405d-b6c7-8841d6ad6ba4 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:12.859796 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a51633-9d43-405d-b6c7-8841d6ad6ba4 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:12.864624 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e23b6-277f-4a62-9e9a-a1754a67be3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:12.865298 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e23b6-277f-4a62-9e9a-a1754a67be3a admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:12.865581 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e23b6-277f-4a62-9e9a-a1754a67be3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:12.865861 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e23b6-277f-4a62-9e9a-a1754a67be3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:12.866547 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e23b6-277f-4a62-9e9a-a1754a67be3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:12.872117 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e23b6-277f-4a62-9e9a-a1754a67be3a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:12.967996 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1369/2716] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:13:12 2022] POST /identity/v3/projects => generated 379 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:13:12.971895 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf8624-d34b-4a69-8a57-805edc35d67a None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:12.983366 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf8624-d34b-4a69-8a57-805edc35d67a None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:13.041448 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a2fd0-5012-4cff-9b71-a2d1f33c1d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:13.042107 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a2fd0-5012-4cff-9b71-a2d1f33c1d47 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:13.042386 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a2fd0-5012-4cff-9b71-a2d1f33c1d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:13.042665 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a2fd0-5012-4cff-9b71-a2d1f33c1d47 admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:13.043366 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a2fd0-5012-4cff-9b71-a2d1f33c1d47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:13.045410 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a2fd0-5012-4cff-9b71-a2d1f33c1d47 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:13.133767 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1348/2717] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:13:12 2022] POST /identity/v3/users => generated 290 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:13:13.137117 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e23b6-277f-4a62-9e9a-a1754a67be3a admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:13.149755 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e23b6-277f-4a62-9e9a-a1754a67be3a admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:13.154665 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63bf0e-c0da-48f6-8830-9ba78b4a516c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:13.155352 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63bf0e-c0da-48f6-8830-9ba78b4a516c admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:13.155683 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63bf0e-c0da-48f6-8830-9ba78b4a516c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:13.155969 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63bf0e-c0da-48f6-8830-9ba78b4a516c admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:13.156710 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa63bf0e-c0da-48f6-8830-9ba78b4a516c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:13.158389 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa63bf0e-c0da-48f6-8830-9ba78b4a516c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:13.170367 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1370/2718] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:13:13.174763 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a2fd0-5012-4cff-9b71-a2d1f33c1d47 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:13.185294 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a2fd0-5012-4cff-9b71-a2d1f33c1d47 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:13.189920 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5d592-ef99-4727-b7e1-7f4f7a06b985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:13.190584 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5d592-ef99-4727-b7e1-7f4f7a06b985 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:13.190865 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5d592-ef99-4727-b7e1-7f4f7a06b985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:13.191671 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5d592-ef99-4727-b7e1-7f4f7a06b985 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:13.192395 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc5d592-ef99-4727-b7e1-7f4f7a06b985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:13.194056 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc5d592-ef99-4727-b7e1-7f4f7a06b985 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:13.204655 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1349/2719] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:13:13.209457 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63bf0e-c0da-48f6-8830-9ba78b4a516c admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:13.219911 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63bf0e-c0da-48f6-8830-9ba78b4a516c admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:13.224582 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e14b7-a853-4df5-9406-6c5665535a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:13.225472 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e14b7-a853-4df5-9406-6c5665535a2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:13.225749 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e14b7-a853-4df5-9406-6c5665535a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:13.226017 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e14b7-a853-4df5-9406-6c5665535a2c admin admin] PATH_INFO: `/v3/projects/9e039aedf4c647ce8036caa988df2957/users/060cdd0d96bc4320a5addfeae9743f7c/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:13.244731 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e14b7-a853-4df5-9406-6c5665535a2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e039aedf4c647ce8036caa988df2957, user_id=060cdd0d96bc4320a5addfeae9743f7c, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:13.247440 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e14b7-a853-4df5-9406-6c5665535a2c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:13.355321 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1371/2720] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:13:13 2022] PUT /identity/v3/projects/9e039aedf4c647ce8036caa988df2957/users/060cdd0d96bc4320a5addfeae9743f7c/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:13:13.366468 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674b20c-e0f2-4268-88d0-05004fe154bd None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:13.366875 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674b20c-e0f2-4268-88d0-05004fe154bd None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:13.367158 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674b20c-e0f2-4268-88d0-05004fe154bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:13.395731 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-7674b20c-e0f2-4268-88d0-05004fe154bd None None] MFA Rules not processed for user `060cdd0d96bc4320a5addfeae9743f7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:13:13.396869 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-7674b20c-e0f2-4268-88d0-05004fe154bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:13.464145 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1350/2721] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:13:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:13:13.469157 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e14b7-a853-4df5-9406-6c5665535a2c admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:13.473876 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:13:13.540639 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e14b7-a853-4df5-9406-6c5665535a2c admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:13.545610 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cafa2c1-97ca-4741-827d-3e9c7759f318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:13.546311 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafa2c1-97ca-4741-827d-3e9c7759f318 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:13.546561 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafa2c1-97ca-4741-827d-3e9c7759f318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:13.546840 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafa2c1-97ca-4741-827d-3e9c7759f318 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:13.547660 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cafa2c1-97ca-4741-827d-3e9c7759f318 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:13.550167 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cafa2c1-97ca-4741-827d-3e9c7759f318 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:13.653499 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1372/2722] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:13:13 2022] POST /identity/v3/projects => generated 379 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 04:13:13.657599 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674b20c-e0f2-4268-88d0-05004fe154bd None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:13.669950 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674b20c-e0f2-4268-88d0-05004fe154bd None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:13.740238 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2989201-ca5c-4e61-b5d8-192da859f7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:13.740909 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2989201-ca5c-4e61-b5d8-192da859f7b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:13.741186 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2989201-ca5c-4e61-b5d8-192da859f7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:13.741457 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2989201-ca5c-4e61-b5d8-192da859f7b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:13.742175 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2989201-ca5c-4e61-b5d8-192da859f7b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:13.744384 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2989201-ca5c-4e61-b5d8-192da859f7b0 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:13.751067 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:13:13.846572 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1351/2723] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:13:13 2022] POST /identity/v3/users => generated 296 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:13:13.850885 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cafa2c1-97ca-4741-827d-3e9c7759f318 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:13.861251 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cafa2c1-97ca-4741-827d-3e9c7759f318 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:13.866478 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd62d5e-77ad-4e6c-9cd5-bb6feb622752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:13.867148 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd62d5e-77ad-4e6c-9cd5-bb6feb622752 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:13.867429 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd62d5e-77ad-4e6c-9cd5-bb6feb622752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:13.867770 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd62d5e-77ad-4e6c-9cd5-bb6feb622752 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:13.868499 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd62d5e-77ad-4e6c-9cd5-bb6feb622752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:13.870169 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd62d5e-77ad-4e6c-9cd5-bb6feb622752 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:13.881542 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1373/2724] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:13:13.885909 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2989201-ca5c-4e61-b5d8-192da859f7b0 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:13.896562 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2989201-ca5c-4e61-b5d8-192da859f7b0 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:13.901426 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69578556-6a42-4c97-bc08-52951421f602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:13.902330 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69578556-6a42-4c97-bc08-52951421f602 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:13.902612 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69578556-6a42-4c97-bc08-52951421f602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:13.902887 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69578556-6a42-4c97-bc08-52951421f602 admin admin] PATH_INFO: `/v3/projects/e092baf0a21c4ee0b9a1bc08032b7bfc/users/21bc02ea38e64d2f91c8d85ecf0f10a7/roles/681755518698445fabd9a8accec13c0f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:13.918673 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69578556-6a42-4c97-bc08-52951421f602 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e092baf0a21c4ee0b9a1bc08032b7bfc, user_id=21bc02ea38e64d2f91c8d85ecf0f10a7, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:13.921314 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69578556-6a42-4c97-bc08-52951421f602 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:13.996578 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1352/2725] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:13:13 2022] PUT /identity/v3/projects/e092baf0a21c4ee0b9a1bc08032b7bfc/users/21bc02ea38e64d2f91c8d85ecf0f10a7/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:13:14.000735 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd62d5e-77ad-4e6c-9cd5-bb6feb622752 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:14.011838 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd62d5e-77ad-4e6c-9cd5-bb6feb622752 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:14.076190 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12058418-c015-41de-8493-bcf18dd1d568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:14.076872 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12058418-c015-41de-8493-bcf18dd1d568 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:14.077152 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12058418-c015-41de-8493-bcf18dd1d568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:14.077575 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12058418-c015-41de-8493-bcf18dd1d568 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:14.078304 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12058418-c015-41de-8493-bcf18dd1d568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:14.079998 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12058418-c015-41de-8493-bcf18dd1d568 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:14.090839 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1374/2726] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 04:13:14.095339 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69578556-6a42-4c97-bc08-52951421f602 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:14.105999 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69578556-6a42-4c97-bc08-52951421f602 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:14.110777 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d22c2-cd52-46dc-bb0c-478138d1c00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:14.111640 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d22c2-cd52-46dc-bb0c-478138d1c00d admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:14.111930 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d22c2-cd52-46dc-bb0c-478138d1c00d admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:14.112209 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d22c2-cd52-46dc-bb0c-478138d1c00d admin admin] PATH_INFO: `/v3/projects/e092baf0a21c4ee0b9a1bc08032b7bfc/users/21bc02ea38e64d2f91c8d85ecf0f10a7/roles/681755518698445fabd9a8accec13c0f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:14.114790 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d22c2-cd52-46dc-bb0c-478138d1c00d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e092baf0a21c4ee0b9a1bc08032b7bfc, user_id=21bc02ea38e64d2f91c8d85ecf0f10a7, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:14.117473 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d22c2-cd52-46dc-bb0c-478138d1c00d admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:14.128413 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1353/2727] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:13:14 2022] PUT /identity/v3/projects/e092baf0a21c4ee0b9a1bc08032b7bfc/users/21bc02ea38e64d2f91c8d85ecf0f10a7/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:13:14.139852 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0d5f3-3832-4bc8-9b34-63f73884a7c5 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:14.140140 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0d5f3-3832-4bc8-9b34-63f73884a7c5 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:14.140416 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0d5f3-3832-4bc8-9b34-63f73884a7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:14.168989 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-8bf0d5f3-3832-4bc8-9b34-63f73884a7c5 None None] MFA Rules not processed for user `21bc02ea38e64d2f91c8d85ecf0f10a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:13:14.170179 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8bf0d5f3-3832-4bc8-9b34-63f73884a7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:14.234475 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:13:14.243728 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1375/2728] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:13:14 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:13:14.251071 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d22c2-cd52-46dc-bb0c-478138d1c00d admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:14.252751 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-f04d22c2-cd52-46dc-bb0c-478138d1c00d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:14.341608 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d22c2-cd52-46dc-bb0c-478138d1c00d admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:14.346108 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da11dc2-3a09-4773-9df7-0e7f1db050e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:14.346896 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da11dc2-3a09-4773-9df7-0e7f1db050e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:14.347184 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da11dc2-3a09-4773-9df7-0e7f1db050e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:14.348221 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da11dc2-3a09-4773-9df7-0e7f1db050e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:14.359903 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da11dc2-3a09-4773-9df7-0e7f1db050e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:14.361698 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da11dc2-3a09-4773-9df7-0e7f1db050e8 service cinder] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:14.376098 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1354/2729] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:13:14 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:13:14.567103 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0d5f3-3832-4bc8-9b34-63f73884a7c5 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:14.569103 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8bf0d5f3-3832-4bc8-9b34-63f73884a7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:14.583051 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0d5f3-3832-4bc8-9b34-63f73884a7c5 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:14.586820 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf4958f-28db-47f8-8dab-00e068d6c046 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:14.587507 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4958f-28db-47f8-8dab-00e068d6c046 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:14.587797 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4958f-28db-47f8-8dab-00e068d6c046 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:14.588079 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4958f-28db-47f8-8dab-00e068d6c046 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:14.651501 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf4958f-28db-47f8-8dab-00e068d6c046 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:14.652962 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf4958f-28db-47f8-8dab-00e068d6c046 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:14.665411 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1376/2730] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:13:14 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:13:19.268469 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da11dc2-3a09-4773-9df7-0e7f1db050e8 service cinder] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:19.334870 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da11dc2-3a09-4773-9df7-0e7f1db050e8 service cinder] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:19.339394 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0500b416-a43d-4b6e-8d47-13703d014c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:19.340312 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500b416-a43d-4b6e-8d47-13703d014c12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:19.340597 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500b416-a43d-4b6e-8d47-13703d014c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:19.340872 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500b416-a43d-4b6e-8d47-13703d014c12 admin admin] PATH_INFO: `/v3/users/4917cf80b1f0455baadb80da5154948c` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:19.342069 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0500b416-a43d-4b6e-8d47-13703d014c12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4917cf80b1f0455baadb80da5154948c)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:19.344051 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0500b416-a43d-4b6e-8d47-13703d014c12 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:19.540673 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-0500b416-a43d-4b6e-8d47-13703d014c12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4917cf80b1f0455baadb80da5154948c'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:19.541327 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-0500b416-a43d-4b6e-8d47-13703d014c12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4917cf80b1f0455baadb80da5154948c'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:19.568272 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d64a64-9495-42b7-b535-738e0161e12d None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:19.568777 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d64a64-9495-42b7-b535-738e0161e12d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:19.568901 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d64a64-9495-42b7-b535-738e0161e12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:19.586103 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-81d64a64-9495-42b7-b535-738e0161e12d None None] MFA Rules not processed for user `474e8177791448b89962ade62816cb5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:13:19.587331 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-81d64a64-9495-42b7-b535-738e0161e12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:19.589209 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-0500b416-a43d-4b6e-8d47-13703d014c12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4917cf80b1f0455baadb80da5154948c'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:19.589833 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-0500b416-a43d-4b6e-8d47-13703d014c12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4917cf80b1f0455baadb80da5154948c'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:19.593156 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:INSERT=6,keystone:SELECT=86,keystone:DELETE=8 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:13:19.598921 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-0500b416-a43d-4b6e-8d47-13703d014c12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4917cf80b1f0455baadb80da5154948c'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:19.617053 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1355/2731] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:13:19 2022] DELETE /identity/v3/users/4917cf80b1f0455baadb80da5154948c => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:13:19.621639 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce8104-1dff-401c-ae77-4d391e9a9a00 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:19.622091 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce8104-1dff-401c-ae77-4d391e9a9a00 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:19.622236 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce8104-1dff-401c-ae77-4d391e9a9a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:19.640452 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-3fce8104-1dff-401c-ae77-4d391e9a9a00 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:13:19.641650 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-3fce8104-1dff-401c-ae77-4d391e9a9a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:19.649123 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1377/2732] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:13:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 04:13:19.709501 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1356/2733] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:13:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 04:13:19.718285 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d64a64-9495-42b7-b535-738e0161e12d None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:19.719706 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-81d64a64-9495-42b7-b535-738e0161e12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:19.783032 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d64a64-9495-42b7-b535-738e0161e12d None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:19.835735 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01dfea4-f2e8-4983-8bf3-c73010442954 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:19.836397 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01dfea4-f2e8-4983-8bf3-c73010442954 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:19.836702 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01dfea4-f2e8-4983-8bf3-c73010442954 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:19.836970 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01dfea4-f2e8-4983-8bf3-c73010442954 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:19.846456 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01dfea4-f2e8-4983-8bf3-c73010442954 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:19.848723 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01dfea4-f2e8-4983-8bf3-c73010442954 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:19.854446 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:13:19.859651 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1378/2734] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:13:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:13:20.328002 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce8104-1dff-401c-ae77-4d391e9a9a00 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:20.329506 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-3fce8104-1dff-401c-ae77-4d391e9a9a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:20.342534 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce8104-1dff-401c-ae77-4d391e9a9a00 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:20.347933 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331f4e1-d495-4849-9fb8-eb78d1b7a8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:20.348811 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331f4e1-d495-4849-9fb8-eb78d1b7a8df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:20.349093 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331f4e1-d495-4849-9fb8-eb78d1b7a8df admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:20.349450 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331f4e1-d495-4849-9fb8-eb78d1b7a8df admin admin] PATH_INFO: `/v3/projects/adcf5ecde55d4adfac0ff73244ea6a3a` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:20.350555 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3331f4e1-d495-4849-9fb8-eb78d1b7a8df admin admin] RBAC: Authorizing `identity:delete_project(project_id=adcf5ecde55d4adfac0ff73244ea6a3a)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:20.352542 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3331f4e1-d495-4849-9fb8-eb78d1b7a8df admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:20.462101 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-3331f4e1-d495-4849-9fb8-eb78d1b7a8df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adcf5ecde55d4adfac0ff73244ea6a3a', 'request_id': 'req-3331f4e1-d495-4849-9fb8-eb78d1b7a8df'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:20.468034 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-3331f4e1-d495-4849-9fb8-eb78d1b7a8df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adcf5ecde55d4adfac0ff73244ea6a3a', 'request_id': 'req-3331f4e1-d495-4849-9fb8-eb78d1b7a8df'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:20.474578 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-3331f4e1-d495-4849-9fb8-eb78d1b7a8df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adcf5ecde55d4adfac0ff73244ea6a3a', 'request_id': 'req-3331f4e1-d495-4849-9fb8-eb78d1b7a8df'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:20.560267 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-3331f4e1-d495-4849-9fb8-eb78d1b7a8df admin admin] The token cache is being invalidate because project adcf5ecde55d4adfac0ff73244ea6a3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:13:20.560510 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-3331f4e1-d495-4849-9fb8-eb78d1b7a8df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:20.561184 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-3331f4e1-d495-4849-9fb8-eb78d1b7a8df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:20.562727 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1357/2735] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:13:20 2022] DELETE /identity/v3/projects/adcf5ecde55d4adfac0ff73244ea6a3a => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:13:20.567253 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01dfea4-f2e8-4983-8bf3-c73010442954 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:20.577361 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01dfea4-f2e8-4983-8bf3-c73010442954 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:20.635966 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b510f98-e180-4c05-b1cb-ff72c0fd7da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:20.636996 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b510f98-e180-4c05-b1cb-ff72c0fd7da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:20.637272 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b510f98-e180-4c05-b1cb-ff72c0fd7da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:20.637548 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b510f98-e180-4c05-b1cb-ff72c0fd7da5 admin admin] PATH_INFO: `/v3/users/060cdd0d96bc4320a5addfeae9743f7c` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:20.638739 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b510f98-e180-4c05-b1cb-ff72c0fd7da5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=060cdd0d96bc4320a5addfeae9743f7c)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:20.640734 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b510f98-e180-4c05-b1cb-ff72c0fd7da5 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:20.876920 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-8b510f98-e180-4c05-b1cb-ff72c0fd7da5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '060cdd0d96bc4320a5addfeae9743f7c'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:20.877477 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-8b510f98-e180-4c05-b1cb-ff72c0fd7da5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '060cdd0d96bc4320a5addfeae9743f7c'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:20.890886 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-8b510f98-e180-4c05-b1cb-ff72c0fd7da5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '060cdd0d96bc4320a5addfeae9743f7c'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:20.899286 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-8b510f98-e180-4c05-b1cb-ff72c0fd7da5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '060cdd0d96bc4320a5addfeae9743f7c'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:20.900051 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-8b510f98-e180-4c05-b1cb-ff72c0fd7da5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '060cdd0d96bc4320a5addfeae9743f7c'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:20.971274 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1379/2736] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:13:20 2022] DELETE /identity/v3/users/060cdd0d96bc4320a5addfeae9743f7c => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:13:21.351019 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331f4e1-d495-4849-9fb8-eb78d1b7a8df admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:21.355374 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-3331f4e1-d495-4849-9fb8-eb78d1b7a8df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:21.366894 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331f4e1-d495-4849-9fb8-eb78d1b7a8df admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:21.422041 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:13:21.428700 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b16322-5c47-4182-9cdb-6b058eaa6a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:21.429851 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b16322-5c47-4182-9cdb-6b058eaa6a45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:21.430130 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b16322-5c47-4182-9cdb-6b058eaa6a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:21.430404 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b16322-5c47-4182-9cdb-6b058eaa6a45 admin admin] PATH_INFO: `/v3/projects/9e039aedf4c647ce8036caa988df2957` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:21.431663 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b16322-5c47-4182-9cdb-6b058eaa6a45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e039aedf4c647ce8036caa988df2957)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:21.433565 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b16322-5c47-4182-9cdb-6b058eaa6a45 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:21.541233 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-e7b16322-5c47-4182-9cdb-6b058eaa6a45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e039aedf4c647ce8036caa988df2957', 'request_id': 'req-e7b16322-5c47-4182-9cdb-6b058eaa6a45'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:21.547732 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-e7b16322-5c47-4182-9cdb-6b058eaa6a45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e039aedf4c647ce8036caa988df2957', 'request_id': 'req-e7b16322-5c47-4182-9cdb-6b058eaa6a45'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:21.554827 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-e7b16322-5c47-4182-9cdb-6b058eaa6a45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e039aedf4c647ce8036caa988df2957', 'request_id': 'req-e7b16322-5c47-4182-9cdb-6b058eaa6a45'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:21.618101 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-e7b16322-5c47-4182-9cdb-6b058eaa6a45 admin admin] The token cache is being invalidate because project 9e039aedf4c647ce8036caa988df2957 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:13:21.618554 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-e7b16322-5c47-4182-9cdb-6b058eaa6a45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:21.619218 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-e7b16322-5c47-4182-9cdb-6b058eaa6a45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:21.621053 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1358/2737] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:13:21 2022] DELETE /identity/v3/projects/9e039aedf4c647ce8036caa988df2957 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:13:21.625220 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b510f98-e180-4c05-b1cb-ff72c0fd7da5 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:21.626691 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8b510f98-e180-4c05-b1cb-ff72c0fd7da5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:21.639583 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b510f98-e180-4c05-b1cb-ff72c0fd7da5 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:21.704610 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b16f0-3048-48bc-a740-b288eb3948ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:21.705408 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b16f0-3048-48bc-a740-b288eb3948ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:21.705688 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b16f0-3048-48bc-a740-b288eb3948ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:21.706028 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b16f0-3048-48bc-a740-b288eb3948ab admin admin] PATH_INFO: `/v3/users/21bc02ea38e64d2f91c8d85ecf0f10a7` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:21.707885 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b16f0-3048-48bc-a740-b288eb3948ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=21bc02ea38e64d2f91c8d85ecf0f10a7)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:21.709836 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b16f0-3048-48bc-a740-b288eb3948ab admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:21.734478 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:13:21.906418 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0d3b16f0-3048-48bc-a740-b288eb3948ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21bc02ea38e64d2f91c8d85ecf0f10a7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:21.907111 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0d3b16f0-3048-48bc-a740-b288eb3948ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21bc02ea38e64d2f91c8d85ecf0f10a7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:21.919816 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0d3b16f0-3048-48bc-a740-b288eb3948ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21bc02ea38e64d2f91c8d85ecf0f10a7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:21.926670 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0d3b16f0-3048-48bc-a740-b288eb3948ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21bc02ea38e64d2f91c8d85ecf0f10a7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:21.927330 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0d3b16f0-3048-48bc-a740-b288eb3948ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21bc02ea38e64d2f91c8d85ecf0f10a7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:22.042174 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1380/2738] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:13:21 2022] DELETE /identity/v3/users/21bc02ea38e64d2f91c8d85ecf0f10a7 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:13:22.464634 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b16322-5c47-4182-9cdb-6b058eaa6a45 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:22.466264 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-e7b16322-5c47-4182-9cdb-6b058eaa6a45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:22.496327 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b16322-5c47-4182-9cdb-6b058eaa6a45 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:22.558271 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8623ff5-71ae-4293-aca4-ecd8d256de8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:22.559172 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8623ff5-71ae-4293-aca4-ecd8d256de8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:22.559432 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8623ff5-71ae-4293-aca4-ecd8d256de8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:22.559736 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8623ff5-71ae-4293-aca4-ecd8d256de8e admin admin] PATH_INFO: `/v3/projects/e092baf0a21c4ee0b9a1bc08032b7bfc` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:22.560940 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8623ff5-71ae-4293-aca4-ecd8d256de8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e092baf0a21c4ee0b9a1bc08032b7bfc)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:22.562849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8623ff5-71ae-4293-aca4-ecd8d256de8e admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:22.756938 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-d8623ff5-71ae-4293-aca4-ecd8d256de8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e092baf0a21c4ee0b9a1bc08032b7bfc', 'request_id': 'req-d8623ff5-71ae-4293-aca4-ecd8d256de8e'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:22.769465 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-d8623ff5-71ae-4293-aca4-ecd8d256de8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e092baf0a21c4ee0b9a1bc08032b7bfc', 'request_id': 'req-d8623ff5-71ae-4293-aca4-ecd8d256de8e'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:22.780236 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-d8623ff5-71ae-4293-aca4-ecd8d256de8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e092baf0a21c4ee0b9a1bc08032b7bfc', 'request_id': 'req-d8623ff5-71ae-4293-aca4-ecd8d256de8e'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:22.870537 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-d8623ff5-71ae-4293-aca4-ecd8d256de8e admin admin] The token cache is being invalidate because project e092baf0a21c4ee0b9a1bc08032b7bfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:13:22.870839 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-d8623ff5-71ae-4293-aca4-ecd8d256de8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:22.871538 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-d8623ff5-71ae-4293-aca4-ecd8d256de8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:22.873163 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1359/2739] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:13:22 2022] DELETE /identity/v3/projects/e092baf0a21c4ee0b9a1bc08032b7bfc => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:13:22.879819 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3acb3-d7d8-4f87-a439-79debed38b4f None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:22.880351 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3acb3-d7d8-4f87-a439-79debed38b4f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:22.880793 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3acb3-d7d8-4f87-a439-79debed38b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:22.905985 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-a5a3acb3-d7d8-4f87-a439-79debed38b4f None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:13:22.907252 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a5a3acb3-d7d8-4f87-a439-79debed38b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:22.971413 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1381/2740] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:13:22.980468 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3c1e7-74ad-4de4-b6e5-8275a1aa03a9 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:22.980939 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3c1e7-74ad-4de4-b6e5-8275a1aa03a9 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:22.981257 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3c1e7-74ad-4de4-b6e5-8275a1aa03a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:23.001785 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-bdd3c1e7-74ad-4de4-b6e5-8275a1aa03a9 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:13:23.002577 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-bdd3c1e7-74ad-4de4-b6e5-8275a1aa03a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:23.012327 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1360/2741] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:13:23.016727 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3acb3-d7d8-4f87-a439-79debed38b4f None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:23.026897 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3acb3-d7d8-4f87-a439-79debed38b4f None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:23.031816 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687178e5-6429-48f6-ba2a-d2ec0b4f1640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:23.032495 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687178e5-6429-48f6-ba2a-d2ec0b4f1640 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:23.032783 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687178e5-6429-48f6-ba2a-d2ec0b4f1640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:23.033056 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687178e5-6429-48f6-ba2a-d2ec0b4f1640 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:23.033783 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687178e5-6429-48f6-ba2a-d2ec0b4f1640 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:13:23.034169 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687178e5-6429-48f6-ba2a-d2ec0b4f1640 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:23.036343 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687178e5-6429-48f6-ba2a-d2ec0b4f1640 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:23.048693 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1382/2742] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:13:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:13:23.053710 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd3c1e7-74ad-4de4-b6e5-8275a1aa03a9 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:23.063033 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd3c1e7-74ad-4de4-b6e5-8275a1aa03a9 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:23.067603 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c0f26-0753-426a-8296-a3052ddcd078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:23.068251 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c0f26-0753-426a-8296-a3052ddcd078 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:23.070510 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c0f26-0753-426a-8296-a3052ddcd078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:23.070510 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c0f26-0753-426a-8296-a3052ddcd078 admin admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:23.070510 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4c0f26-0753-426a-8296-a3052ddcd078 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:23.071337 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4c0f26-0753-426a-8296-a3052ddcd078 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:23.079472 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:13:23.193248 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1361/2743] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:13:23 2022] POST /identity/v3/projects => generated 387 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:13:23.197780 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687178e5-6429-48f6-ba2a-d2ec0b4f1640 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:23.216853 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687178e5-6429-48f6-ba2a-d2ec0b4f1640 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:23.299373 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c155bb-9d24-44c0-b415-d6f425b9b5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:23.300530 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c155bb-9d24-44c0-b415-d6f425b9b5b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:23.300868 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c155bb-9d24-44c0-b415-d6f425b9b5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:23.301180 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c155bb-9d24-44c0-b415-d6f425b9b5b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:23.302031 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c155bb-9d24-44c0-b415-d6f425b9b5b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:23.307750 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c155bb-9d24-44c0-b415-d6f425b9b5b8 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:23.431177 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1383/2744] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:13:23 2022] POST /identity/v3/users => generated 294 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:13:23.435215 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c0f26-0753-426a-8296-a3052ddcd078 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:23.446652 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c0f26-0753-426a-8296-a3052ddcd078 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:23.454539 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43044371-571e-421b-ba6c-ab7ec5435516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:23.456138 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43044371-571e-421b-ba6c-ab7ec5435516 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:23.456684 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43044371-571e-421b-ba6c-ab7ec5435516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:23.457897 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43044371-571e-421b-ba6c-ab7ec5435516 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:23.458510 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43044371-571e-421b-ba6c-ab7ec5435516 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:23.460972 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43044371-571e-421b-ba6c-ab7ec5435516 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:23.471421 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1362/2745] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:13:23.476055 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c155bb-9d24-44c0-b415-d6f425b9b5b8 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:23.487120 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c155bb-9d24-44c0-b415-d6f425b9b5b8 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:23.491846 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc933552-ab3a-4525-941a-7ba327125cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:23.492534 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc933552-ab3a-4525-941a-7ba327125cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:23.492804 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc933552-ab3a-4525-941a-7ba327125cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:23.493107 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc933552-ab3a-4525-941a-7ba327125cb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:23.493831 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc933552-ab3a-4525-941a-7ba327125cb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:23.495508 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc933552-ab3a-4525-941a-7ba327125cb1 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:23.508228 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1384/2746] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:13:23.513570 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43044371-571e-421b-ba6c-ab7ec5435516 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:23.524653 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43044371-571e-421b-ba6c-ab7ec5435516 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:23.530658 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a1235-d9f6-43f2-b239-c50c05666b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:23.531598 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a1235-d9f6-43f2-b239-c50c05666b30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:23.532084 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a1235-d9f6-43f2-b239-c50c05666b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:23.532219 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a1235-d9f6-43f2-b239-c50c05666b30 admin admin] PATH_INFO: `/v3/projects/fbf0e2d5918f45b6a51f6a1aab7f2a0f/users/30423ae136334d28ba5182e70b46f094/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:23.549677 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a1235-d9f6-43f2-b239-c50c05666b30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbf0e2d5918f45b6a51f6a1aab7f2a0f, user_id=30423ae136334d28ba5182e70b46f094, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:23.552463 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a1235-d9f6-43f2-b239-c50c05666b30 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:23.693130 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1363/2747] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:13:23 2022] PUT /identity/v3/projects/fbf0e2d5918f45b6a51f6a1aab7f2a0f/users/30423ae136334d28ba5182e70b46f094/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:13:23.708751 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae2c43-a9a3-49e1-af99-d46567f34c02 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:23.708751 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae2c43-a9a3-49e1-af99-d46567f34c02 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:23.708751 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae2c43-a9a3-49e1-af99-d46567f34c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:23.713790 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:13:23.737038 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-65ae2c43-a9a3-49e1-af99-d46567f34c02 None None] MFA Rules not processed for user `30423ae136334d28ba5182e70b46f094`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:13:23.738280 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-65ae2c43-a9a3-49e1-af99-d46567f34c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:23.805549 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1385/2748] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:13:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 04:13:23.809752 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a1235-d9f6-43f2-b239-c50c05666b30 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:23.874173 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a1235-d9f6-43f2-b239-c50c05666b30 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:23.878865 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b4bace-0ac5-425e-9f47-7ebd964db6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:23.880069 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4bace-0ac5-425e-9f47-7ebd964db6e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:23.880335 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4bace-0ac5-425e-9f47-7ebd964db6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:23.880690 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4bace-0ac5-425e-9f47-7ebd964db6e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:23.881277 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b4bace-0ac5-425e-9f47-7ebd964db6e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:23.883234 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b4bace-0ac5-425e-9f47-7ebd964db6e0 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:24.010989 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1364/2749] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:13:23 2022] POST /identity/v3/projects => generated 385 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:13:24.014638 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae2c43-a9a3-49e1-af99-d46567f34c02 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:24.025719 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae2c43-a9a3-49e1-af99-d46567f34c02 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:24.092910 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743d22d-b396-434e-bf66-82482cd99214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:24.093298 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743d22d-b396-434e-bf66-82482cd99214 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:24.093632 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743d22d-b396-434e-bf66-82482cd99214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:24.093910 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743d22d-b396-434e-bf66-82482cd99214 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:24.094942 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3743d22d-b396-434e-bf66-82482cd99214 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:24.096732 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3743d22d-b396-434e-bf66-82482cd99214 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:24.168813 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1386/2750] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:13:24 2022] POST /identity/v3/users => generated 299 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 04:13:24.173630 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b4bace-0ac5-425e-9f47-7ebd964db6e0 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:24.188398 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b4bace-0ac5-425e-9f47-7ebd964db6e0 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:24.193854 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8f8de-7c82-4cde-8ee9-73c05c7a77ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:24.194532 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8f8de-7c82-4cde-8ee9-73c05c7a77ed admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:24.194817 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8f8de-7c82-4cde-8ee9-73c05c7a77ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:24.195091 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8f8de-7c82-4cde-8ee9-73c05c7a77ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:24.195861 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b8f8de-7c82-4cde-8ee9-73c05c7a77ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:24.197473 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b8f8de-7c82-4cde-8ee9-73c05c7a77ed admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:24.210092 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1365/2751] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:13:24.213656 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743d22d-b396-434e-bf66-82482cd99214 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:24.227706 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743d22d-b396-434e-bf66-82482cd99214 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:24.233854 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b56143-2a0f-4146-8f7d-0d1b27689d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:24.234841 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b56143-2a0f-4146-8f7d-0d1b27689d59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:24.237277 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b56143-2a0f-4146-8f7d-0d1b27689d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:24.237277 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b56143-2a0f-4146-8f7d-0d1b27689d59 admin admin] PATH_INFO: `/v3/projects/4e35fbcf6fc6483b98bedd5a0ca979ea/users/f06f317e49b547b19f071b567e69d5ba/roles/681755518698445fabd9a8accec13c0f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:24.258762 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b56143-2a0f-4146-8f7d-0d1b27689d59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e35fbcf6fc6483b98bedd5a0ca979ea, user_id=f06f317e49b547b19f071b567e69d5ba, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:24.261989 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b56143-2a0f-4146-8f7d-0d1b27689d59 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:24.375129 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1387/2752] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:13:24 2022] PUT /identity/v3/projects/4e35fbcf6fc6483b98bedd5a0ca979ea/users/f06f317e49b547b19f071b567e69d5ba/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:13:24.379929 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8f8de-7c82-4cde-8ee9-73c05c7a77ed admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:24.396515 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8f8de-7c82-4cde-8ee9-73c05c7a77ed admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:24.465946 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf26670-0e54-4028-92bf-b737e83a638a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:24.466626 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf26670-0e54-4028-92bf-b737e83a638a admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:24.466913 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf26670-0e54-4028-92bf-b737e83a638a admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:24.467258 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf26670-0e54-4028-92bf-b737e83a638a admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:24.468027 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf26670-0e54-4028-92bf-b737e83a638a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:24.469753 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf26670-0e54-4028-92bf-b737e83a638a admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:24.482617 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1366/2753] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 04:13:24.486529 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b56143-2a0f-4146-8f7d-0d1b27689d59 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:24.498114 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b56143-2a0f-4146-8f7d-0d1b27689d59 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:24.505937 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c7ac2-6fff-469e-8895-561ac4729518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:24.506860 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c7ac2-6fff-469e-8895-561ac4729518 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:24.507141 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c7ac2-6fff-469e-8895-561ac4729518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:24.507419 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c7ac2-6fff-469e-8895-561ac4729518 admin admin] PATH_INFO: `/v3/projects/4e35fbcf6fc6483b98bedd5a0ca979ea/users/f06f317e49b547b19f071b567e69d5ba/roles/681755518698445fabd9a8accec13c0f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:24.509541 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1c7ac2-6fff-469e-8895-561ac4729518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e35fbcf6fc6483b98bedd5a0ca979ea, user_id=f06f317e49b547b19f071b567e69d5ba, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:24.512338 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1c7ac2-6fff-469e-8895-561ac4729518 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:24.525450 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1388/2754] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:13:24 2022] PUT /identity/v3/projects/4e35fbcf6fc6483b98bedd5a0ca979ea/users/f06f317e49b547b19f071b567e69d5ba/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:13:24.537396 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6556021-921f-4490-bdf2-1bad8cdf9726 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:24.537785 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6556021-921f-4490-bdf2-1bad8cdf9726 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:24.538137 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6556021-921f-4490-bdf2-1bad8cdf9726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:24.567950 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-f6556021-921f-4490-bdf2-1bad8cdf9726 None None] MFA Rules not processed for user `f06f317e49b547b19f071b567e69d5ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:13:24.569180 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-f6556021-921f-4490-bdf2-1bad8cdf9726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:24.583349 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:13:24.645323 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1367/2755] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:13:24 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:13:24.656993 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c7ac2-6fff-469e-8895-561ac4729518 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:24.658707 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-4f1c7ac2-6fff-469e-8895-561ac4729518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:24.721878 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:13:24.727802 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c7ac2-6fff-469e-8895-561ac4729518 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:24.731581 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1450f72-baec-447b-8b3c-e40b2af5a165 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:24.732267 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1450f72-baec-447b-8b3c-e40b2af5a165 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:24.732554 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1450f72-baec-447b-8b3c-e40b2af5a165 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:24.732835 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1450f72-baec-447b-8b3c-e40b2af5a165 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:24.743073 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1450f72-baec-447b-8b3c-e40b2af5a165 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:24.744570 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1450f72-baec-447b-8b3c-e40b2af5a165 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:24.755297 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1389/2756] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:13:24 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:13:25.888732 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6556021-921f-4490-bdf2-1bad8cdf9726 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:25.949555 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6556021-921f-4490-bdf2-1bad8cdf9726 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:25.954138 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc40098-81a5-49a8-a56d-0f14b7ddfe0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:25.955018 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc40098-81a5-49a8-a56d-0f14b7ddfe0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:25.955300 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc40098-81a5-49a8-a56d-0f14b7ddfe0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:25.955612 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc40098-81a5-49a8-a56d-0f14b7ddfe0b admin admin] PATH_INFO: `/v3/users/30423ae136334d28ba5182e70b46f094` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:25.956804 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc40098-81a5-49a8-a56d-0f14b7ddfe0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=30423ae136334d28ba5182e70b46f094)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:25.958726 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc40098-81a5-49a8-a56d-0f14b7ddfe0b admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:26.204378 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-cdc40098-81a5-49a8-a56d-0f14b7ddfe0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30423ae136334d28ba5182e70b46f094'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:26.205034 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-cdc40098-81a5-49a8-a56d-0f14b7ddfe0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30423ae136334d28ba5182e70b46f094'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:26.297744 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-cdc40098-81a5-49a8-a56d-0f14b7ddfe0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30423ae136334d28ba5182e70b46f094'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:26.298353 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-cdc40098-81a5-49a8-a56d-0f14b7ddfe0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30423ae136334d28ba5182e70b46f094'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:26.311599 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-cdc40098-81a5-49a8-a56d-0f14b7ddfe0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30423ae136334d28ba5182e70b46f094'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:26.324618 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1368/2757] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:13:25 2022] DELETE /identity/v3/users/30423ae136334d28ba5182e70b46f094 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:13:26.329215 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111f431-625c-4aa4-89fc-ef8a9a178683 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:26.329686 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111f431-625c-4aa4-89fc-ef8a9a178683 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:26.329799 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111f431-625c-4aa4-89fc-ef8a9a178683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:26.347356 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-b111f431-625c-4aa4-89fc-ef8a9a178683 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:13:26.348572 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b111f431-625c-4aa4-89fc-ef8a9a178683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:26.407537 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1390/2758] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:13:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:13:26.419193 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc40098-81a5-49a8-a56d-0f14b7ddfe0b admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:26.420653 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-cdc40098-81a5-49a8-a56d-0f14b7ddfe0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:26.454393 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:13:26.479433 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc40098-81a5-49a8-a56d-0f14b7ddfe0b admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:26.483087 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d39b022-8eaf-471e-9877-e4ee9c63d08a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:26.483793 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d39b022-8eaf-471e-9877-e4ee9c63d08a service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:26.484065 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d39b022-8eaf-471e-9877-e4ee9c63d08a service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:26.484373 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d39b022-8eaf-471e-9877-e4ee9c63d08a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:26.495740 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d39b022-8eaf-471e-9877-e4ee9c63d08a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:26.497677 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d39b022-8eaf-471e-9877-e4ee9c63d08a service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:26.507335 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1369/2759] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:13:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:13:26.949485 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111f431-625c-4aa4-89fc-ef8a9a178683 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:26.949485 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b111f431-625c-4aa4-89fc-ef8a9a178683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:26.965228 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111f431-625c-4aa4-89fc-ef8a9a178683 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:26.970344 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1dabc-e0e8-4d6c-a83e-a8273e70d911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:26.972474 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1dabc-e0e8-4d6c-a83e-a8273e70d911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:26.972474 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1dabc-e0e8-4d6c-a83e-a8273e70d911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:26.972474 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1dabc-e0e8-4d6c-a83e-a8273e70d911 admin admin] PATH_INFO: `/v3/projects/fbf0e2d5918f45b6a51f6a1aab7f2a0f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:26.973710 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad1dabc-e0e8-4d6c-a83e-a8273e70d911 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbf0e2d5918f45b6a51f6a1aab7f2a0f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:26.975815 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad1dabc-e0e8-4d6c-a83e-a8273e70d911 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:27.100020 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-aad1dabc-e0e8-4d6c-a83e-a8273e70d911 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbf0e2d5918f45b6a51f6a1aab7f2a0f', 'request_id': 'req-aad1dabc-e0e8-4d6c-a83e-a8273e70d911'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:27.154741 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-aad1dabc-e0e8-4d6c-a83e-a8273e70d911 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbf0e2d5918f45b6a51f6a1aab7f2a0f', 'request_id': 'req-aad1dabc-e0e8-4d6c-a83e-a8273e70d911'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:27.161654 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-aad1dabc-e0e8-4d6c-a83e-a8273e70d911 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbf0e2d5918f45b6a51f6a1aab7f2a0f', 'request_id': 'req-aad1dabc-e0e8-4d6c-a83e-a8273e70d911'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:27.173500 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-aad1dabc-e0e8-4d6c-a83e-a8273e70d911 admin admin] The token cache is being invalidate because project fbf0e2d5918f45b6a51f6a1aab7f2a0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:13:27.173818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-aad1dabc-e0e8-4d6c-a83e-a8273e70d911 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:27.174470 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-aad1dabc-e0e8-4d6c-a83e-a8273e70d911 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:27.176140 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1391/2760] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:13:26 2022] DELETE /identity/v3/projects/fbf0e2d5918f45b6a51f6a1aab7f2a0f => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:13:27.180194 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d39b022-8eaf-471e-9877-e4ee9c63d08a service neutron] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:27.190113 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d39b022-8eaf-471e-9877-e4ee9c63d08a service neutron] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:27.249095 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031f4e3-13e8-4094-8c2f-e808c6bf58c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:27.250612 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031f4e3-13e8-4094-8c2f-e808c6bf58c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:27.250612 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031f4e3-13e8-4094-8c2f-e808c6bf58c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:27.250844 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031f4e3-13e8-4094-8c2f-e808c6bf58c0 admin admin] PATH_INFO: `/v3/users/f06f317e49b547b19f071b567e69d5ba` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:27.252011 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8031f4e3-13e8-4094-8c2f-e808c6bf58c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f06f317e49b547b19f071b567e69d5ba)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:27.254020 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8031f4e3-13e8-4094-8c2f-e808c6bf58c0 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:27.415159 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-8031f4e3-13e8-4094-8c2f-e808c6bf58c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f06f317e49b547b19f071b567e69d5ba'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:27.415891 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-8031f4e3-13e8-4094-8c2f-e808c6bf58c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f06f317e49b547b19f071b567e69d5ba'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:27.459112 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-8031f4e3-13e8-4094-8c2f-e808c6bf58c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f06f317e49b547b19f071b567e69d5ba'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:27.459800 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-8031f4e3-13e8-4094-8c2f-e808c6bf58c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f06f317e49b547b19f071b567e69d5ba'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:27.468481 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-8031f4e3-13e8-4094-8c2f-e808c6bf58c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f06f317e49b547b19f071b567e69d5ba'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:27.503967 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1370/2761] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:13:27 2022] DELETE /identity/v3/users/f06f317e49b547b19f071b567e69d5ba => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:13:27.951338 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1dabc-e0e8-4d6c-a83e-a8273e70d911 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:27.953070 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-aad1dabc-e0e8-4d6c-a83e-a8273e70d911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:27.967208 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1dabc-e0e8-4d6c-a83e-a8273e70d911 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:28.070142 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7d202-e62b-46b9-82b0-d76714d36b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:28.070937 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7d202-e62b-46b9-82b0-d76714d36b87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:28.071226 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7d202-e62b-46b9-82b0-d76714d36b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:28.071532 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7d202-e62b-46b9-82b0-d76714d36b87 admin admin] PATH_INFO: `/v3/projects/4e35fbcf6fc6483b98bedd5a0ca979ea` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:28.072779 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da7d202-e62b-46b9-82b0-d76714d36b87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e35fbcf6fc6483b98bedd5a0ca979ea)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:28.074759 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da7d202-e62b-46b9-82b0-d76714d36b87 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:28.091367 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:13:28.184983 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-7da7d202-e62b-46b9-82b0-d76714d36b87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e35fbcf6fc6483b98bedd5a0ca979ea', 'request_id': 'req-7da7d202-e62b-46b9-82b0-d76714d36b87'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:28.257664 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-7da7d202-e62b-46b9-82b0-d76714d36b87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e35fbcf6fc6483b98bedd5a0ca979ea', 'request_id': 'req-7da7d202-e62b-46b9-82b0-d76714d36b87'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:28.264036 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-7da7d202-e62b-46b9-82b0-d76714d36b87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e35fbcf6fc6483b98bedd5a0ca979ea', 'request_id': 'req-7da7d202-e62b-46b9-82b0-d76714d36b87'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:28.276830 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-7da7d202-e62b-46b9-82b0-d76714d36b87 admin admin] The token cache is being invalidate because project 4e35fbcf6fc6483b98bedd5a0ca979ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:13:28.277258 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-7da7d202-e62b-46b9-82b0-d76714d36b87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:28.278028 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-7da7d202-e62b-46b9-82b0-d76714d36b87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:28.279744 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1392/2762] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:13:27 2022] DELETE /identity/v3/projects/4e35fbcf6fc6483b98bedd5a0ca979ea => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:13:28.284672 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ee0bb-a6d9-4677-b98c-aba06ffaa43a None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:28.285202 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ee0bb-a6d9-4677-b98c-aba06ffaa43a None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:28.285202 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ee0bb-a6d9-4677-b98c-aba06ffaa43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:28.304040 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-1c5ee0bb-a6d9-4677-b98c-aba06ffaa43a None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:13:28.305230 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-1c5ee0bb-a6d9-4677-b98c-aba06ffaa43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:28.351909 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:13:28.366380 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1371/2763] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 04:13:28.374387 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc556a-15b2-4c83-98ed-f16949897c36 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:28.374785 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc556a-15b2-4c83-98ed-f16949897c36 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:28.375180 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc556a-15b2-4c83-98ed-f16949897c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:28.395196 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-32fc556a-15b2-4c83-98ed-f16949897c36 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:13:28.396629 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-32fc556a-15b2-4c83-98ed-f16949897c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:28.405058 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1393/2764] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:13:28.409231 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ee0bb-a6d9-4677-b98c-aba06ffaa43a None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:28.420272 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ee0bb-a6d9-4677-b98c-aba06ffaa43a None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:28.425039 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1160fa-08b5-4b55-9446-a361850f7410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:28.425794 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1160fa-08b5-4b55-9446-a361850f7410 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:28.426157 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1160fa-08b5-4b55-9446-a361850f7410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:28.426440 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1160fa-08b5-4b55-9446-a361850f7410 admin admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:28.427204 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1160fa-08b5-4b55-9446-a361850f7410 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:13:28.427587 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1160fa-08b5-4b55-9446-a361850f7410 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:28.429241 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1160fa-08b5-4b55-9446-a361850f7410 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:28.443138 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1372/2765] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:13:28.447745 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc556a-15b2-4c83-98ed-f16949897c36 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:28.458005 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc556a-15b2-4c83-98ed-f16949897c36 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:28.462917 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f56f9-04f9-4e88-adab-d278219e3942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:28.463726 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f56f9-04f9-4e88-adab-d278219e3942 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:28.464077 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f56f9-04f9-4e88-adab-d278219e3942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:28.464422 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f56f9-04f9-4e88-adab-d278219e3942 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:28.465193 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f56f9-04f9-4e88-adab-d278219e3942 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:28.467215 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f56f9-04f9-4e88-adab-d278219e3942 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:28.586166 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1394/2766] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:13:28 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:13:28.591731 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1160fa-08b5-4b55-9446-a361850f7410 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:28.604064 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1160fa-08b5-4b55-9446-a361850f7410 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:28.668966 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccb92b-72e3-4cb6-b89a-af8fabab7d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:28.669744 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccb92b-72e3-4cb6-b89a-af8fabab7d96 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:28.669915 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccb92b-72e3-4cb6-b89a-af8fabab7d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:28.670236 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccb92b-72e3-4cb6-b89a-af8fabab7d96 admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:28.671202 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ccb92b-72e3-4cb6-b89a-af8fabab7d96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:28.673159 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ccb92b-72e3-4cb6-b89a-af8fabab7d96 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:28.783602 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1373/2767] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:13:28 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:13:28.788466 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f56f9-04f9-4e88-adab-d278219e3942 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:28.798973 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f56f9-04f9-4e88-adab-d278219e3942 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:28.804236 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40126a0c-a6e3-41b3-8c4e-d792559d0fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:28.804893 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40126a0c-a6e3-41b3-8c4e-d792559d0fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:28.805174 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40126a0c-a6e3-41b3-8c4e-d792559d0fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:28.805455 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40126a0c-a6e3-41b3-8c4e-d792559d0fd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:28.806257 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40126a0c-a6e3-41b3-8c4e-d792559d0fd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:28.807823 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40126a0c-a6e3-41b3-8c4e-d792559d0fd7 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:28.818209 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1395/2768] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:13:28.822112 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccb92b-72e3-4cb6-b89a-af8fabab7d96 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:28.831934 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccb92b-72e3-4cb6-b89a-af8fabab7d96 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:28.836435 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1c612-7436-42f4-8f37-4fc9afd3f355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:28.837076 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1c612-7436-42f4-8f37-4fc9afd3f355 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:28.837356 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1c612-7436-42f4-8f37-4fc9afd3f355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:28.837628 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1c612-7436-42f4-8f37-4fc9afd3f355 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:28.838344 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1c612-7436-42f4-8f37-4fc9afd3f355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:28.839960 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1c612-7436-42f4-8f37-4fc9afd3f355 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:28.850394 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1374/2769] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:13:28.854332 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40126a0c-a6e3-41b3-8c4e-d792559d0fd7 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:28.864669 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40126a0c-a6e3-41b3-8c4e-d792559d0fd7 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:28.869955 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d30485d-8da6-4440-9b24-21e88a0cd7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:28.870911 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30485d-8da6-4440-9b24-21e88a0cd7f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:28.871194 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30485d-8da6-4440-9b24-21e88a0cd7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:28.871499 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30485d-8da6-4440-9b24-21e88a0cd7f9 admin admin] PATH_INFO: `/v3/projects/d7ac2e358d2a4119ad059df96ebcb763/users/321e6276456a4103885b83d444ba5764/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:28.886033 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d30485d-8da6-4440-9b24-21e88a0cd7f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7ac2e358d2a4119ad059df96ebcb763, user_id=321e6276456a4103885b83d444ba5764, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:28.888785 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d30485d-8da6-4440-9b24-21e88a0cd7f9 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:28.954889 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1396/2770] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:13:28 2022] PUT /identity/v3/projects/d7ac2e358d2a4119ad059df96ebcb763/users/321e6276456a4103885b83d444ba5764/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:13:28.965281 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd3321-7e01-45b1-9a40-f3b8c7a356e6 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:28.965575 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd3321-7e01-45b1-9a40-f3b8c7a356e6 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:28.965855 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd3321-7e01-45b1-9a40-f3b8c7a356e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:28.993751 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-ccbd3321-7e01-45b1-9a40-f3b8c7a356e6 None None] MFA Rules not processed for user `321e6276456a4103885b83d444ba5764`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:13:28.997354 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-ccbd3321-7e01-45b1-9a40-f3b8c7a356e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:29.059404 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1375/2771] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:13:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:13:29.070719 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d30485d-8da6-4440-9b24-21e88a0cd7f9 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:29.072441 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9d30485d-8da6-4440-9b24-21e88a0cd7f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:29.140078 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d30485d-8da6-4440-9b24-21e88a0cd7f9 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:29.143861 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01802d7b-d718-4ca8-abc6-2a1a20f4a827 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:29.144525 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01802d7b-d718-4ca8-abc6-2a1a20f4a827 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:29.145299 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01802d7b-d718-4ca8-abc6-2a1a20f4a827 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:29.145575 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01802d7b-d718-4ca8-abc6-2a1a20f4a827 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:29.154832 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01802d7b-d718-4ca8-abc6-2a1a20f4a827 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:29.156386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01802d7b-d718-4ca8-abc6-2a1a20f4a827 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:29.167428 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1397/2772] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:13:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:13:29.190651 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd3321-7e01-45b1-9a40-f3b8c7a356e6 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:29.252905 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:13:29.269564 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd3321-7e01-45b1-9a40-f3b8c7a356e6 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:29.275355 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e066b7-0d67-44e4-b08b-eae2f9c93f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:29.276269 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e066b7-0d67-44e4-b08b-eae2f9c93f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:29.276555 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e066b7-0d67-44e4-b08b-eae2f9c93f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:29.276835 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e066b7-0d67-44e4-b08b-eae2f9c93f2e admin admin] PATH_INFO: `/v3/users/321e6276456a4103885b83d444ba5764` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:29.278028 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e066b7-0d67-44e4-b08b-eae2f9c93f2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=321e6276456a4103885b83d444ba5764)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:29.279997 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e066b7-0d67-44e4-b08b-eae2f9c93f2e admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:29.471982 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-15e066b7-0d67-44e4-b08b-eae2f9c93f2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '321e6276456a4103885b83d444ba5764'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:29.472656 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-15e066b7-0d67-44e4-b08b-eae2f9c93f2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '321e6276456a4103885b83d444ba5764'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:29.525708 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-15e066b7-0d67-44e4-b08b-eae2f9c93f2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '321e6276456a4103885b83d444ba5764'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:29.526330 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-15e066b7-0d67-44e4-b08b-eae2f9c93f2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '321e6276456a4103885b83d444ba5764'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:29.533886 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-15e066b7-0d67-44e4-b08b-eae2f9c93f2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '321e6276456a4103885b83d444ba5764'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:29.551967 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1376/2773] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:13:29 2022] DELETE /identity/v3/users/321e6276456a4103885b83d444ba5764 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:13:29.556548 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b0108-3048-49cd-835f-3535fa21a2be None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:29.556738 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b0108-3048-49cd-835f-3535fa21a2be None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:29.557010 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b0108-3048-49cd-835f-3535fa21a2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:29.574919 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-b78b0108-3048-49cd-835f-3535fa21a2be None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:13:29.576237 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b78b0108-3048-49cd-835f-3535fa21a2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:29.614058 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:13:29.635004 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1398/2774] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:13:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:13:29.645523 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e066b7-0d67-44e4-b08b-eae2f9c93f2e admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:29.647018 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-15e066b7-0d67-44e4-b08b-eae2f9c93f2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:29.706539 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e066b7-0d67-44e4-b08b-eae2f9c93f2e admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:29.711267 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e77c08d-b422-43b0-8db2-4281ed58dc62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:29.711971 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77c08d-b422-43b0-8db2-4281ed58dc62 service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:29.712254 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77c08d-b422-43b0-8db2-4281ed58dc62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:29.715927 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77c08d-b422-43b0-8db2-4281ed58dc62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:29.722536 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e77c08d-b422-43b0-8db2-4281ed58dc62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:29.723977 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e77c08d-b422-43b0-8db2-4281ed58dc62 service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:29.734185 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1377/2775] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:13:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:13:30.213179 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b0108-3048-49cd-835f-3535fa21a2be None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:30.214650 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b78b0108-3048-49cd-835f-3535fa21a2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:30.228525 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b0108-3048-49cd-835f-3535fa21a2be None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:30.242978 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c33c6d-5578-41dd-a656-ccc6b828acc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:30.242978 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c33c6d-5578-41dd-a656-ccc6b828acc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:30.242978 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c33c6d-5578-41dd-a656-ccc6b828acc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:30.242978 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c33c6d-5578-41dd-a656-ccc6b828acc8 admin admin] PATH_INFO: `/v3/projects/d7ac2e358d2a4119ad059df96ebcb763` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:30.243967 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c33c6d-5578-41dd-a656-ccc6b828acc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7ac2e358d2a4119ad059df96ebcb763)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:30.243967 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c33c6d-5578-41dd-a656-ccc6b828acc8 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:30.380189 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-93c33c6d-5578-41dd-a656-ccc6b828acc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7ac2e358d2a4119ad059df96ebcb763', 'request_id': 'req-93c33c6d-5578-41dd-a656-ccc6b828acc8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:30.463170 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-93c33c6d-5578-41dd-a656-ccc6b828acc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7ac2e358d2a4119ad059df96ebcb763', 'request_id': 'req-93c33c6d-5578-41dd-a656-ccc6b828acc8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:30.470578 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-93c33c6d-5578-41dd-a656-ccc6b828acc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7ac2e358d2a4119ad059df96ebcb763', 'request_id': 'req-93c33c6d-5578-41dd-a656-ccc6b828acc8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:30.483248 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-93c33c6d-5578-41dd-a656-ccc6b828acc8 admin admin] The token cache is being invalidate because project d7ac2e358d2a4119ad059df96ebcb763 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:13:30.483576 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-93c33c6d-5578-41dd-a656-ccc6b828acc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:30.484213 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-93c33c6d-5578-41dd-a656-ccc6b828acc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:30.485815 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1399/2776] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:13:30 2022] DELETE /identity/v3/projects/d7ac2e358d2a4119ad059df96ebcb763 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:13:30.491586 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a1fc0-7dd4-49a4-bf1b-d220235cae78 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:30.492192 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a1fc0-7dd4-49a4-bf1b-d220235cae78 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:30.492192 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a1fc0-7dd4-49a4-bf1b-d220235cae78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:30.509990 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-f51a1fc0-7dd4-49a4-bf1b-d220235cae78 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:13:30.511264 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-f51a1fc0-7dd4-49a4-bf1b-d220235cae78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:30.572600 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1378/2777] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:13:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:13:30.635246 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efaad7f-23b0-4164-ba95-c8c2e6ffdba1 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:30.635565 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efaad7f-23b0-4164-ba95-c8c2e6ffdba1 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:30.635850 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efaad7f-23b0-4164-ba95-c8c2e6ffdba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:30.654512 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-8efaad7f-23b0-4164-ba95-c8c2e6ffdba1 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:13:30.655756 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8efaad7f-23b0-4164-ba95-c8c2e6ffdba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:30.664556 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1400/2778] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:13:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:13:30.668909 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a1fc0-7dd4-49a4-bf1b-d220235cae78 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:30.678944 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a1fc0-7dd4-49a4-bf1b-d220235cae78 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:30.684202 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7faa3a-3d53-4a86-8f3c-c0e8b9a21e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:30.684992 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7faa3a-3d53-4a86-8f3c-c0e8b9a21e2c admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:30.685382 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7faa3a-3d53-4a86-8f3c-c0e8b9a21e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:30.685762 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7faa3a-3d53-4a86-8f3c-c0e8b9a21e2c admin admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:30.686611 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7faa3a-3d53-4a86-8f3c-c0e8b9a21e2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:13:30.687023 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7faa3a-3d53-4a86-8f3c-c0e8b9a21e2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:30.688979 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7faa3a-3d53-4a86-8f3c-c0e8b9a21e2c admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:30.691696 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:13:30.701080 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1379/2779] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:13:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:13:30.705634 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efaad7f-23b0-4164-ba95-c8c2e6ffdba1 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:30.715386 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efaad7f-23b0-4164-ba95-c8c2e6ffdba1 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:30.720178 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a656d20b-2e32-4cfe-b444-ac0b58ae8e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:30.720830 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656d20b-2e32-4cfe-b444-ac0b58ae8e00 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:30.721114 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656d20b-2e32-4cfe-b444-ac0b58ae8e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:30.721394 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656d20b-2e32-4cfe-b444-ac0b58ae8e00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:30.722554 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a656d20b-2e32-4cfe-b444-ac0b58ae8e00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:30.724668 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a656d20b-2e32-4cfe-b444-ac0b58ae8e00 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:30.825250 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1401/2780] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:13:30 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:13:30.829366 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7faa3a-3d53-4a86-8f3c-c0e8b9a21e2c admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:30.840084 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7faa3a-3d53-4a86-8f3c-c0e8b9a21e2c admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:30.896592 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f0667-63e3-41e5-93dc-1c03a922bb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:30.897255 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f0667-63e3-41e5-93dc-1c03a922bb24 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:30.897529 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f0667-63e3-41e5-93dc-1c03a922bb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:30.897803 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f0667-63e3-41e5-93dc-1c03a922bb24 admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:30.898482 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823f0667-63e3-41e5-93dc-1c03a922bb24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:30.902148 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823f0667-63e3-41e5-93dc-1c03a922bb24 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:31.000996 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1380/2781] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:13:30 2022] POST /identity/v3/users => generated 287 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:13:31.005353 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a656d20b-2e32-4cfe-b444-ac0b58ae8e00 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:31.015895 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a656d20b-2e32-4cfe-b444-ac0b58ae8e00 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:31.021626 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91074b7-b0f0-438f-b7ee-ca4a7351b91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:31.022299 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91074b7-b0f0-438f-b7ee-ca4a7351b91a admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:31.022583 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91074b7-b0f0-438f-b7ee-ca4a7351b91a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:31.022855 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91074b7-b0f0-438f-b7ee-ca4a7351b91a admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:31.023614 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91074b7-b0f0-438f-b7ee-ca4a7351b91a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:31.026232 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91074b7-b0f0-438f-b7ee-ca4a7351b91a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:31.037139 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1402/2782] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:13:31.041098 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f0667-63e3-41e5-93dc-1c03a922bb24 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:31.051786 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f0667-63e3-41e5-93dc-1c03a922bb24 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:31.057110 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d5d7f9-af12-42f8-b322-cbf16c3a5afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:31.058013 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5d7f9-af12-42f8-b322-cbf16c3a5afa admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:31.058612 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5d7f9-af12-42f8-b322-cbf16c3a5afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:31.058967 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5d7f9-af12-42f8-b322-cbf16c3a5afa admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:31.059874 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d5d7f9-af12-42f8-b322-cbf16c3a5afa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:31.061782 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d5d7f9-af12-42f8-b322-cbf16c3a5afa admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:31.075545 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1381/2783] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 04:13:31.077080 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91074b7-b0f0-438f-b7ee-ca4a7351b91a admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:31.087983 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91074b7-b0f0-438f-b7ee-ca4a7351b91a admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:31.092750 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de3204-3a5f-417e-9d7c-a0516ede2fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:31.093648 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de3204-3a5f-417e-9d7c-a0516ede2fd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:31.093927 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de3204-3a5f-417e-9d7c-a0516ede2fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:31.094202 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de3204-3a5f-417e-9d7c-a0516ede2fd7 admin admin] PATH_INFO: `/v3/projects/af4910ded8eb4b169b4015cd514a8769/users/d4b77a7f9a4849e3803a72d9f2298c6a/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:31.108936 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7de3204-3a5f-417e-9d7c-a0516ede2fd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af4910ded8eb4b169b4015cd514a8769, user_id=d4b77a7f9a4849e3803a72d9f2298c6a, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:31.111651 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7de3204-3a5f-417e-9d7c-a0516ede2fd7 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:31.177487 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1403/2784] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:13:31 2022] PUT /identity/v3/projects/af4910ded8eb4b169b4015cd514a8769/users/d4b77a7f9a4849e3803a72d9f2298c6a/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:13:31.187499 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c88b95-392a-4bca-87a9-45c3ca2c5716 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:31.187799 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c88b95-392a-4bca-87a9-45c3ca2c5716 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:31.188081 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c88b95-392a-4bca-87a9-45c3ca2c5716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:31.215849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-75c88b95-392a-4bca-87a9-45c3ca2c5716 None None] MFA Rules not processed for user `d4b77a7f9a4849e3803a72d9f2298c6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:13:31.217048 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-75c88b95-392a-4bca-87a9-45c3ca2c5716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:31.286074 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1382/2785] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:13:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:13:31.290917 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de3204-3a5f-417e-9d7c-a0516ede2fd7 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:31.355527 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de3204-3a5f-417e-9d7c-a0516ede2fd7 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:31.360740 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e2002-5fe6-457e-aa3c-db1ebd36cc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:31.363573 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e2002-5fe6-457e-aa3c-db1ebd36cc70 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:31.363573 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e2002-5fe6-457e-aa3c-db1ebd36cc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:31.363573 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e2002-5fe6-457e-aa3c-db1ebd36cc70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:31.363573 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e2002-5fe6-457e-aa3c-db1ebd36cc70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:31.364779 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e2002-5fe6-457e-aa3c-db1ebd36cc70 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:31.369398 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:13:31.465455 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1404/2786] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:13:31 2022] POST /identity/v3/projects => generated 373 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 04:13:31.469602 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c88b95-392a-4bca-87a9-45c3ca2c5716 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:31.481014 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c88b95-392a-4bca-87a9-45c3ca2c5716 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:31.543889 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd57754-45b0-47ce-a876-3572e8ee37f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:31.544627 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd57754-45b0-47ce-a876-3572e8ee37f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:31.544844 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd57754-45b0-47ce-a876-3572e8ee37f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:31.545119 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd57754-45b0-47ce-a876-3572e8ee37f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:31.545824 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd57754-45b0-47ce-a876-3572e8ee37f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:31.547814 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd57754-45b0-47ce-a876-3572e8ee37f3 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:31.558048 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:13:31.635510 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1383/2787] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:13:31 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:13:31.639541 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e2002-5fe6-457e-aa3c-db1ebd36cc70 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:31.650821 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e2002-5fe6-457e-aa3c-db1ebd36cc70 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:31.655483 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b801a33b-31c9-4ff1-b211-1a5d09b1f1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:31.656224 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801a33b-31c9-4ff1-b211-1a5d09b1f1b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:31.656555 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801a33b-31c9-4ff1-b211-1a5d09b1f1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:31.656851 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801a33b-31c9-4ff1-b211-1a5d09b1f1b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:31.657557 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b801a33b-31c9-4ff1-b211-1a5d09b1f1b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:31.659163 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b801a33b-31c9-4ff1-b211-1a5d09b1f1b5 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:31.672194 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1405/2788] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:13:31.677084 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd57754-45b0-47ce-a876-3572e8ee37f3 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:31.687840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd57754-45b0-47ce-a876-3572e8ee37f3 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:31.693066 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0673ee-81cf-4786-a155-62e2932cb8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:31.693969 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0673ee-81cf-4786-a155-62e2932cb8c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:31.694249 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0673ee-81cf-4786-a155-62e2932cb8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:31.694523 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0673ee-81cf-4786-a155-62e2932cb8c2 admin admin] PATH_INFO: `/v3/projects/06447f822ede4317a294f456f7961df6/users/fc9a7220b9af4c6aa5a1730f87a37db8/roles/681755518698445fabd9a8accec13c0f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:31.711358 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0673ee-81cf-4786-a155-62e2932cb8c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06447f822ede4317a294f456f7961df6, user_id=fc9a7220b9af4c6aa5a1730f87a37db8, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:31.714060 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0673ee-81cf-4786-a155-62e2932cb8c2 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:31.808205 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1384/2789] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:13:31 2022] PUT /identity/v3/projects/06447f822ede4317a294f456f7961df6/users/fc9a7220b9af4c6aa5a1730f87a37db8/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:13:31.812476 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b801a33b-31c9-4ff1-b211-1a5d09b1f1b5 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:31.823517 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b801a33b-31c9-4ff1-b211-1a5d09b1f1b5 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:31.885690 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039715f-c60f-4695-bd03-b0f7ad976b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:31.886281 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039715f-c60f-4695-bd03-b0f7ad976b0c admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:31.886562 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039715f-c60f-4695-bd03-b0f7ad976b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:31.886838 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039715f-c60f-4695-bd03-b0f7ad976b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:31.887602 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039715f-c60f-4695-bd03-b0f7ad976b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:31.889241 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039715f-c60f-4695-bd03-b0f7ad976b0c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:31.899770 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1406/2790] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:13:31.903889 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0673ee-81cf-4786-a155-62e2932cb8c2 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:31.915027 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0673ee-81cf-4786-a155-62e2932cb8c2 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:31.919815 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defddcbb-c852-4b60-9ca7-c4e695578566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:31.920691 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defddcbb-c852-4b60-9ca7-c4e695578566 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:31.920974 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defddcbb-c852-4b60-9ca7-c4e695578566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:31.921255 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defddcbb-c852-4b60-9ca7-c4e695578566 admin admin] PATH_INFO: `/v3/projects/06447f822ede4317a294f456f7961df6/users/fc9a7220b9af4c6aa5a1730f87a37db8/roles/681755518698445fabd9a8accec13c0f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:31.923251 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defddcbb-c852-4b60-9ca7-c4e695578566 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06447f822ede4317a294f456f7961df6, user_id=fc9a7220b9af4c6aa5a1730f87a37db8, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:31.926529 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defddcbb-c852-4b60-9ca7-c4e695578566 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:31.937285 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1385/2791] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:13:31 2022] PUT /identity/v3/projects/06447f822ede4317a294f456f7961df6/users/fc9a7220b9af4c6aa5a1730f87a37db8/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:13:31.948429 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d027d-76ee-487b-acb8-ebdc3bfaf235 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:31.948714 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d027d-76ee-487b-acb8-ebdc3bfaf235 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:31.948993 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d027d-76ee-487b-acb8-ebdc3bfaf235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:31.977541 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-147d027d-76ee-487b-acb8-ebdc3bfaf235 None None] MFA Rules not processed for user `fc9a7220b9af4c6aa5a1730f87a37db8`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:13:31.978797 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-147d027d-76ee-487b-acb8-ebdc3bfaf235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:32.049372 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1407/2792] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:13:31 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:13:32.061285 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defddcbb-c852-4b60-9ca7-c4e695578566 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:32.063048 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-defddcbb-c852-4b60-9ca7-c4e695578566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:32.123312 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defddcbb-c852-4b60-9ca7-c4e695578566 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:32.127096 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48009b9d-cbea-48ca-84fe-24370e8b60cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:32.127781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48009b9d-cbea-48ca-84fe-24370e8b60cb service cinder] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:32.128069 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48009b9d-cbea-48ca-84fe-24370e8b60cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:32.128346 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48009b9d-cbea-48ca-84fe-24370e8b60cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:32.187754 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48009b9d-cbea-48ca-84fe-24370e8b60cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:32.189297 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48009b9d-cbea-48ca-84fe-24370e8b60cb service cinder] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:32.198815 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1386/2793] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:13:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:13:35.350842 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d027d-76ee-487b-acb8-ebdc3bfaf235 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:35.421629 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:13:35.427977 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d027d-76ee-487b-acb8-ebdc3bfaf235 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:35.433929 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79269b0c-ab13-47fd-9e25-0b4a2dba5520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:35.434934 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79269b0c-ab13-47fd-9e25-0b4a2dba5520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:35.435222 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79269b0c-ab13-47fd-9e25-0b4a2dba5520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:35.438329 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79269b0c-ab13-47fd-9e25-0b4a2dba5520 admin admin] PATH_INFO: `/v3/users/d4b77a7f9a4849e3803a72d9f2298c6a` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:35.438329 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79269b0c-ab13-47fd-9e25-0b4a2dba5520 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4b77a7f9a4849e3803a72d9f2298c6a)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:35.438975 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79269b0c-ab13-47fd-9e25-0b4a2dba5520 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:35.688005 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-79269b0c-ab13-47fd-9e25-0b4a2dba5520 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4b77a7f9a4849e3803a72d9f2298c6a'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:35.688791 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-79269b0c-ab13-47fd-9e25-0b4a2dba5520 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4b77a7f9a4849e3803a72d9f2298c6a'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:35.703737 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-79269b0c-ab13-47fd-9e25-0b4a2dba5520 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4b77a7f9a4849e3803a72d9f2298c6a'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:35.711657 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-79269b0c-ab13-47fd-9e25-0b4a2dba5520 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4b77a7f9a4849e3803a72d9f2298c6a'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:35.712460 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-79269b0c-ab13-47fd-9e25-0b4a2dba5520 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4b77a7f9a4849e3803a72d9f2298c6a'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:35.800903 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1408/2794] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:13:35 2022] DELETE /identity/v3/users/d4b77a7f9a4849e3803a72d9f2298c6a => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:13:35.806410 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df41402-4aac-4c90-aa54-0cd107329637 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:35.808174 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df41402-4aac-4c90-aa54-0cd107329637 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:35.809099 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df41402-4aac-4c90-aa54-0cd107329637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:35.839132 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-6df41402-4aac-4c90-aa54-0cd107329637 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:13:35.840540 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-6df41402-4aac-4c90-aa54-0cd107329637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:35.929164 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1387/2795] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:13:35.939183 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79269b0c-ab13-47fd-9e25-0b4a2dba5520 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:35.940639 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-79269b0c-ab13-47fd-9e25-0b4a2dba5520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:36.034078 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79269b0c-ab13-47fd-9e25-0b4a2dba5520 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:36.037911 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a9e7b-dad9-4e57-b5e4-03f70a911508 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:36.038673 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a9e7b-dad9-4e57-b5e4-03f70a911508 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:36.039180 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a9e7b-dad9-4e57-b5e4-03f70a911508 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:36.039479 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a9e7b-dad9-4e57-b5e4-03f70a911508 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:36.050562 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a9e7b-dad9-4e57-b5e4-03f70a911508 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:36.052718 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a9e7b-dad9-4e57-b5e4-03f70a911508 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:36.064035 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1409/2796] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:13:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:13:36.575305 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df41402-4aac-4c90-aa54-0cd107329637 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:36.576801 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-6df41402-4aac-4c90-aa54-0cd107329637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:36.590693 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df41402-4aac-4c90-aa54-0cd107329637 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:36.595592 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34481b9-f703-4aa8-a2b8-c6bbdd504f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:36.596549 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34481b9-f703-4aa8-a2b8-c6bbdd504f7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:36.596830 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34481b9-f703-4aa8-a2b8-c6bbdd504f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:36.597156 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34481b9-f703-4aa8-a2b8-c6bbdd504f7a admin admin] PATH_INFO: `/v3/projects/af4910ded8eb4b169b4015cd514a8769` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:36.598909 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34481b9-f703-4aa8-a2b8-c6bbdd504f7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=af4910ded8eb4b169b4015cd514a8769)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:36.600880 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34481b9-f703-4aa8-a2b8-c6bbdd504f7a admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:36.617594 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:13:36.766057 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-b34481b9-f703-4aa8-a2b8-c6bbdd504f7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af4910ded8eb4b169b4015cd514a8769', 'request_id': 'req-b34481b9-f703-4aa8-a2b8-c6bbdd504f7a'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:36.773291 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-b34481b9-f703-4aa8-a2b8-c6bbdd504f7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af4910ded8eb4b169b4015cd514a8769', 'request_id': 'req-b34481b9-f703-4aa8-a2b8-c6bbdd504f7a'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:36.779578 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-b34481b9-f703-4aa8-a2b8-c6bbdd504f7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af4910ded8eb4b169b4015cd514a8769', 'request_id': 'req-b34481b9-f703-4aa8-a2b8-c6bbdd504f7a'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:36.873558 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-b34481b9-f703-4aa8-a2b8-c6bbdd504f7a admin admin] The token cache is being invalidate because project af4910ded8eb4b169b4015cd514a8769 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:13:36.874234 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-b34481b9-f703-4aa8-a2b8-c6bbdd504f7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:36.874471 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-b34481b9-f703-4aa8-a2b8-c6bbdd504f7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:36.876120 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1388/2797] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:13:36 2022] DELETE /identity/v3/projects/af4910ded8eb4b169b4015cd514a8769 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:13:36.880467 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a9e7b-dad9-4e57-b5e4-03f70a911508 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:36.890741 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a9e7b-dad9-4e57-b5e4-03f70a911508 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:36.951420 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e386f-3b5d-4528-9e7c-90f24c2e1495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:36.952429 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e386f-3b5d-4528-9e7c-90f24c2e1495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:36.952718 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e386f-3b5d-4528-9e7c-90f24c2e1495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:36.952995 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e386f-3b5d-4528-9e7c-90f24c2e1495 admin admin] PATH_INFO: `/v3/users/fc9a7220b9af4c6aa5a1730f87a37db8` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:36.954214 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e386f-3b5d-4528-9e7c-90f24c2e1495 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc9a7220b9af4c6aa5a1730f87a37db8)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:36.956205 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e386f-3b5d-4528-9e7c-90f24c2e1495 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:36.980723 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:13:37.209530 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b18e386f-3b5d-4528-9e7c-90f24c2e1495 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc9a7220b9af4c6aa5a1730f87a37db8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:37.210185 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b18e386f-3b5d-4528-9e7c-90f24c2e1495 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc9a7220b9af4c6aa5a1730f87a37db8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:37.222692 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b18e386f-3b5d-4528-9e7c-90f24c2e1495 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc9a7220b9af4c6aa5a1730f87a37db8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:37.229747 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b18e386f-3b5d-4528-9e7c-90f24c2e1495 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc9a7220b9af4c6aa5a1730f87a37db8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:37.230483 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b18e386f-3b5d-4528-9e7c-90f24c2e1495 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc9a7220b9af4c6aa5a1730f87a37db8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:37.372124 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1410/2798] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:13:36 2022] DELETE /identity/v3/users/fc9a7220b9af4c6aa5a1730f87a37db8 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:13:37.818752 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34481b9-f703-4aa8-a2b8-c6bbdd504f7a admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:37.820280 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-b34481b9-f703-4aa8-a2b8-c6bbdd504f7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:37.835018 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34481b9-f703-4aa8-a2b8-c6bbdd504f7a admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:37.893970 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d794aa-e3d1-4f0b-8949-69345ae1e754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:37.894759 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d794aa-e3d1-4f0b-8949-69345ae1e754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:37.895038 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d794aa-e3d1-4f0b-8949-69345ae1e754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:37.895316 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d794aa-e3d1-4f0b-8949-69345ae1e754 admin admin] PATH_INFO: `/v3/projects/06447f822ede4317a294f456f7961df6` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:37.896703 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d794aa-e3d1-4f0b-8949-69345ae1e754 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06447f822ede4317a294f456f7961df6)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:37.898632 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d794aa-e3d1-4f0b-8949-69345ae1e754 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:38.011273 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-f7d794aa-e3d1-4f0b-8949-69345ae1e754 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06447f822ede4317a294f456f7961df6', 'request_id': 'req-f7d794aa-e3d1-4f0b-8949-69345ae1e754'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:38.017391 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-f7d794aa-e3d1-4f0b-8949-69345ae1e754 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06447f822ede4317a294f456f7961df6', 'request_id': 'req-f7d794aa-e3d1-4f0b-8949-69345ae1e754'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:38.022877 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-f7d794aa-e3d1-4f0b-8949-69345ae1e754 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06447f822ede4317a294f456f7961df6', 'request_id': 'req-f7d794aa-e3d1-4f0b-8949-69345ae1e754'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:38.125004 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-f7d794aa-e3d1-4f0b-8949-69345ae1e754 admin admin] The token cache is being invalidate because project 06447f822ede4317a294f456f7961df6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:13:38.125292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-f7d794aa-e3d1-4f0b-8949-69345ae1e754 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:38.125923 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-f7d794aa-e3d1-4f0b-8949-69345ae1e754 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:13:38.127478 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1389/2799] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:13:37 2022] DELETE /identity/v3/projects/06447f822ede4317a294f456f7961df6 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:13:38.133441 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c730465-1ed6-4b83-937e-f7f6a5678f82 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:38.134740 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c730465-1ed6-4b83-937e-f7f6a5678f82 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:38.134740 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c730465-1ed6-4b83-937e-f7f6a5678f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:38.153155 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-5c730465-1ed6-4b83-937e-f7f6a5678f82 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:13:38.154270 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-5c730465-1ed6-4b83-937e-f7f6a5678f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:38.216149 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1411/2800] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:13:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:13:38.225127 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3f681-847f-4dfc-9f14-94b0133965f2 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:38.225414 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3f681-847f-4dfc-9f14-94b0133965f2 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:38.225688 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3f681-847f-4dfc-9f14-94b0133965f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:38.244982 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-e9d3f681-847f-4dfc-9f14-94b0133965f2 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:13:38.246224 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-e9d3f681-847f-4dfc-9f14-94b0133965f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:38.255118 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1390/2801] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:13:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:13:38.260313 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c730465-1ed6-4b83-937e-f7f6a5678f82 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:38.272219 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c730465-1ed6-4b83-937e-f7f6a5678f82 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:38.276990 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc27f7-5472-4397-961f-157b69eadae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:38.277673 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc27f7-5472-4397-961f-157b69eadae6 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:38.277963 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc27f7-5472-4397-961f-157b69eadae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:38.278242 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc27f7-5472-4397-961f-157b69eadae6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:38.278979 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc27f7-5472-4397-961f-157b69eadae6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:13:38.279353 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc27f7-5472-4397-961f-157b69eadae6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:38.281036 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc27f7-5472-4397-961f-157b69eadae6 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:38.294873 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1412/2802] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:13:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 04:13:38.299902 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d3f681-847f-4dfc-9f14-94b0133965f2 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:38.309504 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d3f681-847f-4dfc-9f14-94b0133965f2 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:38.314369 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f84cc6-1183-4752-a104-39ac47bbc829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:38.315040 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f84cc6-1183-4752-a104-39ac47bbc829 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:38.315324 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f84cc6-1183-4752-a104-39ac47bbc829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:38.315647 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f84cc6-1183-4752-a104-39ac47bbc829 admin admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:38.316387 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f84cc6-1183-4752-a104-39ac47bbc829 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:38.318356 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f84cc6-1183-4752-a104-39ac47bbc829 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:38.333714 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:13:38.471169 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1391/2803] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:13:38 2022] POST /identity/v3/projects => generated 375 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:13:38.476238 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc27f7-5472-4397-961f-157b69eadae6 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:38.490313 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc27f7-5472-4397-961f-157b69eadae6 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:38.547486 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01d45bf-037b-4fb6-8749-83863944eb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:38.548174 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d45bf-037b-4fb6-8749-83863944eb30 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:38.548518 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d45bf-037b-4fb6-8749-83863944eb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:38.548802 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d45bf-037b-4fb6-8749-83863944eb30 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:38.549513 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01d45bf-037b-4fb6-8749-83863944eb30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:38.551572 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01d45bf-037b-4fb6-8749-83863944eb30 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:38.618313 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1413/2804] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:13:38 2022] POST /identity/v3/users => generated 288 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 04:13:38.622524 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f84cc6-1183-4752-a104-39ac47bbc829 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:38.633504 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f84cc6-1183-4752-a104-39ac47bbc829 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:38.638232 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e841d4c-0317-4065-afe4-6801a34a1760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:38.638904 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e841d4c-0317-4065-afe4-6801a34a1760 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:38.639190 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e841d4c-0317-4065-afe4-6801a34a1760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:38.639509 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e841d4c-0317-4065-afe4-6801a34a1760 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:38.640232 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e841d4c-0317-4065-afe4-6801a34a1760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:38.641849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e841d4c-0317-4065-afe4-6801a34a1760 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:38.653720 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1392/2805] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:13:38.658064 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01d45bf-037b-4fb6-8749-83863944eb30 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:38.668926 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01d45bf-037b-4fb6-8749-83863944eb30 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:38.673666 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46063970-9597-4490-9d49-fde29bc26f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:38.674342 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46063970-9597-4490-9d49-fde29bc26f8a admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:38.674630 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46063970-9597-4490-9d49-fde29bc26f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:38.674909 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46063970-9597-4490-9d49-fde29bc26f8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:38.675708 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46063970-9597-4490-9d49-fde29bc26f8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:38.677404 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46063970-9597-4490-9d49-fde29bc26f8a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:38.691999 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1414/2806] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:13:38.697744 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e841d4c-0317-4065-afe4-6801a34a1760 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:38.708474 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e841d4c-0317-4065-afe4-6801a34a1760 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:38.713482 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c6902-2e37-4812-8ddf-ad84457a7310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:38.714377 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c6902-2e37-4812-8ddf-ad84457a7310 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:38.714656 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c6902-2e37-4812-8ddf-ad84457a7310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:38.714929 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c6902-2e37-4812-8ddf-ad84457a7310 admin admin] PATH_INFO: `/v3/projects/50c91aedf9744849b62fecd0af97428b/users/98e4a6d9ea424f72be44f27dde2d198c/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:38.730360 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c6902-2e37-4812-8ddf-ad84457a7310 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50c91aedf9744849b62fecd0af97428b, user_id=98e4a6d9ea424f72be44f27dde2d198c, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:38.733038 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c6902-2e37-4812-8ddf-ad84457a7310 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:38.835402 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1393/2807] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:13:38 2022] PUT /identity/v3/projects/50c91aedf9744849b62fecd0af97428b/users/98e4a6d9ea424f72be44f27dde2d198c/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:13:38.845685 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f14b40-574d-401d-8c15-2676c47dca0c None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:38.845978 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f14b40-574d-401d-8c15-2676c47dca0c None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:38.846262 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f14b40-574d-401d-8c15-2676c47dca0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:38.853063 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:13:38.872761 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-f6f14b40-574d-401d-8c15-2676c47dca0c None None] MFA Rules not processed for user `98e4a6d9ea424f72be44f27dde2d198c`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:13:38.874063 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f6f14b40-574d-401d-8c15-2676c47dca0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:38.939796 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1415/2808] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:13:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:13:38.950893 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c6902-2e37-4812-8ddf-ad84457a7310 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:38.952734 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-785c6902-2e37-4812-8ddf-ad84457a7310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:39.008432 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c6902-2e37-4812-8ddf-ad84457a7310 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:39.012187 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bab4ff-039f-4af1-91c1-6b49bb78f2c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:39.012973 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bab4ff-039f-4af1-91c1-6b49bb78f2c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:39.013237 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bab4ff-039f-4af1-91c1-6b49bb78f2c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:39.013511 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bab4ff-039f-4af1-91c1-6b49bb78f2c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:39.021880 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bab4ff-039f-4af1-91c1-6b49bb78f2c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:39.023310 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bab4ff-039f-4af1-91c1-6b49bb78f2c3 service cinder] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:39.031964 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1394/2809] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:13:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:13:40.681623 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf3bca-6af0-469e-9816-6287accaa13c None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:40.682210 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf3bca-6af0-469e-9816-6287accaa13c None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:40.682366 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf3bca-6af0-469e-9816-6287accaa13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:40.700315 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-8ecf3bca-6af0-469e-9816-6287accaa13c None None] MFA Rules not processed for user `98e4a6d9ea424f72be44f27dde2d198c`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:13:40.701531 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8ecf3bca-6af0-469e-9816-6287accaa13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:40.709029 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1416/2810] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:13:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:13:49.028056 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=43,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:13:50.694775 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=33 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:13:57.237971 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa5c26-9b3e-474e-9288-abce45e199e8 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:57.238943 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa5c26-9b3e-474e-9288-abce45e199e8 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:57.239053 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa5c26-9b3e-474e-9288-abce45e199e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:57.256521 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-5bfa5c26-9b3e-474e-9288-abce45e199e8 None None] MFA Rules not processed for user `dd41221abea04808bed5ef4ac4528c62`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:13:57.259521 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-5bfa5c26-9b3e-474e-9288-abce45e199e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:57.316653 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1395/2811] 10.222.0.46 () {58 vars in 1009 bytes} [Fri Jul 1 04:13:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:13:57.352752 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf3bca-6af0-469e-9816-6287accaa13c None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:57.354159 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8ecf3bca-6af0-469e-9816-6287accaa13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:57.423707 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf3bca-6af0-469e-9816-6287accaa13c None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:57.429275 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e32906-992f-4a85-9401-b7d06b2bb305 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83787880173b459c8975b834bd47a51a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:57.429923 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e32906-992f-4a85-9401-b7d06b2bb305 service swift] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:57.430464 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e32906-992f-4a85-9401-b7d06b2bb305 service swift] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:57.430464 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e32906-992f-4a85-9401-b7d06b2bb305 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:57.439538 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e32906-992f-4a85-9401-b7d06b2bb305 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:57.441194 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e32906-992f-4a85-9401-b7d06b2bb305 service swift] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:57.449874 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1417/2812] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Jul 1 04:13:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 04:13:58.315125 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c0121-0a99-4143-833a-fd71c069839f None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:58.315615 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c0121-0a99-4143-833a-fd71c069839f None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:58.315742 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c0121-0a99-4143-833a-fd71c069839f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:58.336172 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-346c0121-0a99-4143-833a-fd71c069839f None None] MFA Rules not processed for user `dd41221abea04808bed5ef4ac4528c62`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:13:58.337211 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-346c0121-0a99-4143-833a-fd71c069839f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:58.344373 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1396/2813] 10.222.0.46 () {58 vars in 967 bytes} [Fri Jul 1 04:13:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:13:58.356851 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e32906-992f-4a85-9401-b7d06b2bb305 service swift] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:58.368213 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e32906-992f-4a85-9401-b7d06b2bb305 service swift] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:58.373155 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9144f82-2cb3-44ce-aa18-719300521308 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83787880173b459c8975b834bd47a51a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:58.373783 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9144f82-2cb3-44ce-aa18-719300521308 service swift] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:58.374063 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9144f82-2cb3-44ce-aa18-719300521308 service swift] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:58.374363 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9144f82-2cb3-44ce-aa18-719300521308 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:58.383003 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9144f82-2cb3-44ce-aa18-719300521308 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:58.384612 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9144f82-2cb3-44ce-aa18-719300521308 service swift] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:58.392708 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1418/2814] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Jul 1 04:13:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 04:13:58.947026 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8405ec-bfe7-4b23-bf2e-c00ca1f2e6b3 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:58.947318 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8405ec-bfe7-4b23-bf2e-c00ca1f2e6b3 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:58.947642 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8405ec-bfe7-4b23-bf2e-c00ca1f2e6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:58.965118 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-7f8405ec-bfe7-4b23-bf2e-c00ca1f2e6b3 None None] MFA Rules not processed for user `dd41221abea04808bed5ef4ac4528c62`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:13:58.966312 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-7f8405ec-bfe7-4b23-bf2e-c00ca1f2e6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:58.973976 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1397/2815] 10.222.0.46 () {58 vars in 1009 bytes} [Fri Jul 1 04:13:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:13:58.985648 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9144f82-2cb3-44ce-aa18-719300521308 service swift] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:58.996768 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9144f82-2cb3-44ce-aa18-719300521308 service swift] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:59.001797 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff633614-7b6e-488d-a0a0-2ca1b61c552e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83787880173b459c8975b834bd47a51a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:59.002372 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff633614-7b6e-488d-a0a0-2ca1b61c552e service swift] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:59.002653 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff633614-7b6e-488d-a0a0-2ca1b61c552e service swift] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:59.002957 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff633614-7b6e-488d-a0a0-2ca1b61c552e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:59.011101 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff633614-7b6e-488d-a0a0-2ca1b61c552e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:59.012718 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff633614-7b6e-488d-a0a0-2ca1b61c552e service swift] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:59.020763 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1419/2816] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Jul 1 04:13:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 04:13:59.544721 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522aadfc-d44c-49a6-bef1-92873e15dbe2 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:59.545275 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522aadfc-d44c-49a6-bef1-92873e15dbe2 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:59.545399 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522aadfc-d44c-49a6-bef1-92873e15dbe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:59.563623 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-522aadfc-d44c-49a6-bef1-92873e15dbe2 None None] MFA Rules not processed for user `dd41221abea04808bed5ef4ac4528c62`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:13:59.564739 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-522aadfc-d44c-49a6-bef1-92873e15dbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:13:59.572972 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1398/2817] 10.222.0.46 () {58 vars in 967 bytes} [Fri Jul 1 04:13:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:13:59.585850 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff633614-7b6e-488d-a0a0-2ca1b61c552e service swift] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:13:59.596480 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff633614-7b6e-488d-a0a0-2ca1b61c552e service swift] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:13:59.601695 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01d58f-15a5-4137-95a3-12245f2849b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83787880173b459c8975b834bd47a51a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:13:59.602333 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01d58f-15a5-4137-95a3-12245f2849b2 service swift] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:13:59.602615 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01d58f-15a5-4137-95a3-12245f2849b2 service swift] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:13:59.602894 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01d58f-15a5-4137-95a3-12245f2849b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:13:59.611006 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca01d58f-15a5-4137-95a3-12245f2849b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:13:59.612637 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca01d58f-15a5-4137-95a3-12245f2849b2 service swift] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:13:59.621125 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1420/2818] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Jul 1 04:13:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 04:14:02.207324 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522aadfc-d44c-49a6-bef1-92873e15dbe2 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:02.272800 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522aadfc-d44c-49a6-bef1-92873e15dbe2 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:02.277617 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f9639-d309-446b-bf83-2ce0d3e1033d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:02.278485 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f9639-d309-446b-bf83-2ce0d3e1033d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:02.278769 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f9639-d309-446b-bf83-2ce0d3e1033d admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:02.279047 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f9639-d309-446b-bf83-2ce0d3e1033d admin admin] PATH_INFO: `/v3/users/98e4a6d9ea424f72be44f27dde2d198c` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:02.280270 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f9639-d309-446b-bf83-2ce0d3e1033d admin admin] RBAC: Authorizing `identity:delete_user(user_id=98e4a6d9ea424f72be44f27dde2d198c)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:02.282245 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f9639-d309-446b-bf83-2ce0d3e1033d admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:02.495209 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-da2f9639-d309-446b-bf83-2ce0d3e1033d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98e4a6d9ea424f72be44f27dde2d198c'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:02.495840 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-da2f9639-d309-446b-bf83-2ce0d3e1033d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98e4a6d9ea424f72be44f27dde2d198c'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:02.564884 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-da2f9639-d309-446b-bf83-2ce0d3e1033d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98e4a6d9ea424f72be44f27dde2d198c'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:02.565527 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-da2f9639-d309-446b-bf83-2ce0d3e1033d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98e4a6d9ea424f72be44f27dde2d198c'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:02.574714 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-da2f9639-d309-446b-bf83-2ce0d3e1033d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98e4a6d9ea424f72be44f27dde2d198c'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:02.592704 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1399/2819] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:14:02 2022] DELETE /identity/v3/users/98e4a6d9ea424f72be44f27dde2d198c => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:14:02.597291 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d4e6c-cf15-4f6f-ba92-eabdf0d547c4 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:02.597807 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d4e6c-cf15-4f6f-ba92-eabdf0d547c4 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:02.597924 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d4e6c-cf15-4f6f-ba92-eabdf0d547c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:02.615186 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-cc6d4e6c-cf15-4f6f-ba92-eabdf0d547c4 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:14:02.616425 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-cc6d4e6c-cf15-4f6f-ba92-eabdf0d547c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:14:02.677293 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1421/2820] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:14:02.687786 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f9639-d309-446b-bf83-2ce0d3e1033d admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:02.689245 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-da2f9639-d309-446b-bf83-2ce0d3e1033d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:14:02.696522 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:14:02.749864 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f9639-d309-446b-bf83-2ce0d3e1033d admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:02.753895 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d81766-12f4-4351-9596-6aa2956fa6f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:02.754554 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d81766-12f4-4351-9596-6aa2956fa6f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:02.756116 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d81766-12f4-4351-9596-6aa2956fa6f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:02.756116 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d81766-12f4-4351-9596-6aa2956fa6f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:02.765642 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d81766-12f4-4351-9596-6aa2956fa6f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:02.767091 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d81766-12f4-4351-9596-6aa2956fa6f4 service neutron] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:02.778132 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1400/2821] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:14:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:14:03.029985 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d4e6c-cf15-4f6f-ba92-eabdf0d547c4 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:03.031634 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-cc6d4e6c-cf15-4f6f-ba92-eabdf0d547c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:14:03.046676 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d4e6c-cf15-4f6f-ba92-eabdf0d547c4 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:03.052505 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5dbb37-3642-4b46-b933-67a61fbb09e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:03.053384 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5dbb37-3642-4b46-b933-67a61fbb09e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:03.054306 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5dbb37-3642-4b46-b933-67a61fbb09e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:03.054545 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5dbb37-3642-4b46-b933-67a61fbb09e0 admin admin] PATH_INFO: `/v3/projects/50c91aedf9744849b62fecd0af97428b` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:03.055770 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5dbb37-3642-4b46-b933-67a61fbb09e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50c91aedf9744849b62fecd0af97428b)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:03.058064 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5dbb37-3642-4b46-b933-67a61fbb09e0 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:03.187617 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:14:03.190504 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2a5dbb37-3642-4b46-b933-67a61fbb09e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50c91aedf9744849b62fecd0af97428b', 'request_id': 'req-2a5dbb37-3642-4b46-b933-67a61fbb09e0'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:03.291313 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2a5dbb37-3642-4b46-b933-67a61fbb09e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50c91aedf9744849b62fecd0af97428b', 'request_id': 'req-2a5dbb37-3642-4b46-b933-67a61fbb09e0'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:03.297483 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2a5dbb37-3642-4b46-b933-67a61fbb09e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50c91aedf9744849b62fecd0af97428b', 'request_id': 'req-2a5dbb37-3642-4b46-b933-67a61fbb09e0'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:03.311509 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2a5dbb37-3642-4b46-b933-67a61fbb09e0 admin admin] The token cache is being invalidate because project 50c91aedf9744849b62fecd0af97428b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:14:03.311804 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2a5dbb37-3642-4b46-b933-67a61fbb09e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:03.312476 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2a5dbb37-3642-4b46-b933-67a61fbb09e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:03.314038 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1422/2822] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:14:03 2022] DELETE /identity/v3/projects/50c91aedf9744849b62fecd0af97428b => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:14:12.873709 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=24 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:14:13.308315 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:14:32.627890 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a610be-b227-49ec-ba66-6b116b0050fc None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:32.645965 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a610be-b227-49ec-ba66-6b116b0050fc None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:32.645965 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a610be-b227-49ec-ba66-6b116b0050fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:32.645965 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-35a610be-b227-49ec-ba66-6b116b0050fc None None] MFA Rules not processed for user `dd41221abea04808bed5ef4ac4528c62`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:14:32.647154 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-35a610be-b227-49ec-ba66-6b116b0050fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:14:32.707064 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1401/2823] 10.222.0.46 () {58 vars in 967 bytes} [Fri Jul 1 04:14:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:14:32.719574 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5dbb37-3642-4b46-b933-67a61fbb09e0 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:32.721368 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2a5dbb37-3642-4b46-b933-67a61fbb09e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:14:32.793226 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5dbb37-3642-4b46-b933-67a61fbb09e0 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:32.798933 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea27d2-78a1-4d3a-838f-d67551b67842 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83787880173b459c8975b834bd47a51a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:32.799326 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea27d2-78a1-4d3a-838f-d67551b67842 service swift] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:32.799648 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea27d2-78a1-4d3a-838f-d67551b67842 service swift] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:32.799929 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea27d2-78a1-4d3a-838f-d67551b67842 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:32.809152 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea27d2-78a1-4d3a-838f-d67551b67842 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:32.810781 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea27d2-78a1-4d3a-838f-d67551b67842 service swift] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:32.819051 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1423/2824] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Jul 1 04:14:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 04:14:37.463015 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a610be-b227-49ec-ba66-6b116b0050fc None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:37.464549 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-35a610be-b227-49ec-ba66-6b116b0050fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:14:37.564622 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a610be-b227-49ec-ba66-6b116b0050fc None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:37.569897 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b285ddf-16d5-4b85-961c-dca9cf05da49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:37.570819 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b285ddf-16d5-4b85-961c-dca9cf05da49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:37.573679 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b285ddf-16d5-4b85-961c-dca9cf05da49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:37.573679 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b285ddf-16d5-4b85-961c-dca9cf05da49 admin admin] PATH_INFO: `/v3/users/474e8177791448b89962ade62816cb5c` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:37.573679 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b285ddf-16d5-4b85-961c-dca9cf05da49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=474e8177791448b89962ade62816cb5c)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:37.574800 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b285ddf-16d5-4b85-961c-dca9cf05da49 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:37.784450 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-7b285ddf-16d5-4b85-961c-dca9cf05da49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '474e8177791448b89962ade62816cb5c'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:37.785576 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-7b285ddf-16d5-4b85-961c-dca9cf05da49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '474e8177791448b89962ade62816cb5c'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:37.850634 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-7b285ddf-16d5-4b85-961c-dca9cf05da49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '474e8177791448b89962ade62816cb5c'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:37.851387 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-7b285ddf-16d5-4b85-961c-dca9cf05da49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '474e8177791448b89962ade62816cb5c'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:37.860883 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-7b285ddf-16d5-4b85-961c-dca9cf05da49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '474e8177791448b89962ade62816cb5c'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:37.881996 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1402/2825] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:14:37 2022] DELETE /identity/v3/users/474e8177791448b89962ade62816cb5c => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:14:38.183388 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea27d2-78a1-4d3a-838f-d67551b67842 service swift] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:38.196120 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea27d2-78a1-4d3a-838f-d67551b67842 service swift] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:38.259621 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45292c4f-2c6b-4521-a9e8-1b3c8f7c9975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:38.261292 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45292c4f-2c6b-4521-a9e8-1b3c8f7c9975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:38.261583 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45292c4f-2c6b-4521-a9e8-1b3c8f7c9975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:38.261863 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45292c4f-2c6b-4521-a9e8-1b3c8f7c9975 admin admin] PATH_INFO: `/v3/projects/b055ff77f93c4facbc0ef5d35a6aeb76` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:38.263106 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45292c4f-2c6b-4521-a9e8-1b3c8f7c9975 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b055ff77f93c4facbc0ef5d35a6aeb76)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:38.265205 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45292c4f-2c6b-4521-a9e8-1b3c8f7c9975 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:38.411504 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-45292c4f-2c6b-4521-a9e8-1b3c8f7c9975 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b055ff77f93c4facbc0ef5d35a6aeb76', 'request_id': 'req-45292c4f-2c6b-4521-a9e8-1b3c8f7c9975'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:38.484471 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-45292c4f-2c6b-4521-a9e8-1b3c8f7c9975 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b055ff77f93c4facbc0ef5d35a6aeb76', 'request_id': 'req-45292c4f-2c6b-4521-a9e8-1b3c8f7c9975'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:38.492432 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-45292c4f-2c6b-4521-a9e8-1b3c8f7c9975 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b055ff77f93c4facbc0ef5d35a6aeb76', 'request_id': 'req-45292c4f-2c6b-4521-a9e8-1b3c8f7c9975'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:38.505027 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-45292c4f-2c6b-4521-a9e8-1b3c8f7c9975 admin admin] The token cache is being invalidate because project b055ff77f93c4facbc0ef5d35a6aeb76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:14:38.505497 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-45292c4f-2c6b-4521-a9e8-1b3c8f7c9975 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:38.506583 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-45292c4f-2c6b-4521-a9e8-1b3c8f7c9975 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:38.508656 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1424/2826] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:14:38 2022] DELETE /identity/v3/projects/b055ff77f93c4facbc0ef5d35a6aeb76 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:14:38.515060 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979abbc4-89c7-4cec-b9e0-696bd0c6a840 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:38.516519 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979abbc4-89c7-4cec-b9e0-696bd0c6a840 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:38.517082 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979abbc4-89c7-4cec-b9e0-696bd0c6a840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:38.537693 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-979abbc4-89c7-4cec-b9e0-696bd0c6a840 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:14:38.538903 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-979abbc4-89c7-4cec-b9e0-696bd0c6a840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:14:38.560498 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:14:38.602594 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1403/2827] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:14:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:14:38.610624 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31efd43-c2c1-414a-bde7-8c8798f3b96c None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:38.610912 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31efd43-c2c1-414a-bde7-8c8798f3b96c None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:38.611194 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31efd43-c2c1-414a-bde7-8c8798f3b96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:38.630005 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-d31efd43-c2c1-414a-bde7-8c8798f3b96c None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:14:38.631318 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d31efd43-c2c1-414a-bde7-8c8798f3b96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:14:38.639360 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1425/2828] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:14:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:14:38.643700 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979abbc4-89c7-4cec-b9e0-696bd0c6a840 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:38.653577 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979abbc4-89c7-4cec-b9e0-696bd0c6a840 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:38.658226 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23169ea6-1721-4b2d-927f-4767130a12fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:38.659316 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23169ea6-1721-4b2d-927f-4767130a12fd admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:38.659316 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23169ea6-1721-4b2d-927f-4767130a12fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:38.659596 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23169ea6-1721-4b2d-927f-4767130a12fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:38.660238 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23169ea6-1721-4b2d-927f-4767130a12fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80376) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:14:38.660540 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23169ea6-1721-4b2d-927f-4767130a12fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:38.662140 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23169ea6-1721-4b2d-927f-4767130a12fd admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:38.675862 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1404/2829] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:14:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:14:38.683202 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31efd43-c2c1-414a-bde7-8c8798f3b96c None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:38.692933 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31efd43-c2c1-414a-bde7-8c8798f3b96c None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:38.708998 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ae178-3e4b-4d88-801a-1e6f1691bfd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:38.709694 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ae178-3e4b-4d88-801a-1e6f1691bfd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:38.709981 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ae178-3e4b-4d88-801a-1e6f1691bfd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:38.710257 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ae178-3e4b-4d88-801a-1e6f1691bfd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:38.710950 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238ae178-3e4b-4d88-801a-1e6f1691bfd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:38.712919 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238ae178-3e4b-4d88-801a-1e6f1691bfd9 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:38.724582 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:14:38.821413 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1426/2830] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:14:38 2022] POST /identity/v3/projects => generated 403 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:14:38.822630 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23169ea6-1721-4b2d-927f-4767130a12fd admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:38.832798 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23169ea6-1721-4b2d-927f-4767130a12fd admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:38.895842 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232db415-b3ce-4def-897a-741bfadf8c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:38.896524 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232db415-b3ce-4def-897a-741bfadf8c4d admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:38.896805 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232db415-b3ce-4def-897a-741bfadf8c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:38.897081 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232db415-b3ce-4def-897a-741bfadf8c4d admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:38.897817 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232db415-b3ce-4def-897a-741bfadf8c4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:38.899866 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232db415-b3ce-4def-897a-741bfadf8c4d admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:38.974409 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1405/2831] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:14:38 2022] POST /identity/v3/users => generated 302 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:14:38.976059 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ae178-3e4b-4d88-801a-1e6f1691bfd9 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:38.988355 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ae178-3e4b-4d88-801a-1e6f1691bfd9 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:38.993645 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6726228-7d0d-4009-af73-f2e2fa0a0aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:38.995016 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6726228-7d0d-4009-af73-f2e2fa0a0aff admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:38.995302 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6726228-7d0d-4009-af73-f2e2fa0a0aff admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:38.995611 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6726228-7d0d-4009-af73-f2e2fa0a0aff admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:38.996350 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6726228-7d0d-4009-af73-f2e2fa0a0aff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:38.997980 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6726228-7d0d-4009-af73-f2e2fa0a0aff admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:39.014911 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1427/2832] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:14:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:14:39.016185 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232db415-b3ce-4def-897a-741bfadf8c4d admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:39.026972 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232db415-b3ce-4def-897a-741bfadf8c4d admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:39.036334 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a05103-f1fc-4b80-aea5-499f3241c5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:39.041462 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a05103-f1fc-4b80-aea5-499f3241c5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:39.041462 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a05103-f1fc-4b80-aea5-499f3241c5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:39.041462 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a05103-f1fc-4b80-aea5-499f3241c5e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:39.041462 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a05103-f1fc-4b80-aea5-499f3241c5e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:39.041462 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a05103-f1fc-4b80-aea5-499f3241c5e8 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:39.053291 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1406/2833] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:14:39.057474 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6726228-7d0d-4009-af73-f2e2fa0a0aff admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:39.069650 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6726228-7d0d-4009-af73-f2e2fa0a0aff admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:39.077052 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222f9e7-9729-46cb-b086-164b7bf712e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:39.077052 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222f9e7-9729-46cb-b086-164b7bf712e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:39.077052 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222f9e7-9729-46cb-b086-164b7bf712e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:39.077052 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222f9e7-9729-46cb-b086-164b7bf712e0 admin admin] PATH_INFO: `/v3/projects/75eacef5aa7b4d2583c61a45b5f3d764/users/0c0d3c5b9e6a4867a468cf1784b178c6/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:39.093040 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d222f9e7-9729-46cb-b086-164b7bf712e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75eacef5aa7b4d2583c61a45b5f3d764, user_id=0c0d3c5b9e6a4867a468cf1784b178c6, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:39.095910 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d222f9e7-9729-46cb-b086-164b7bf712e0 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:39.202450 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1428/2834] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:14:39 2022] PUT /identity/v3/projects/75eacef5aa7b4d2583c61a45b5f3d764/users/0c0d3c5b9e6a4867a468cf1784b178c6/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:14:39.207206 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd558c4-fa1e-46ec-a237-99e6e5de2cbe None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:39.207598 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd558c4-fa1e-46ec-a237-99e6e5de2cbe None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:39.207888 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd558c4-fa1e-46ec-a237-99e6e5de2cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:39.242517 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-4bd558c4-fa1e-46ec-a237-99e6e5de2cbe None None] MFA Rules not processed for user `0c0d3c5b9e6a4867a468cf1784b178c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:14:39.243940 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-4bd558c4-fa1e-46ec-a237-99e6e5de2cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:14:39.335617 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1407/2835] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:14:39 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:14:39.344701 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222f9e7-9729-46cb-b086-164b7bf712e0 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:39.422528 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222f9e7-9729-46cb-b086-164b7bf712e0 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:39.427316 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddfc14c-7e78-46ac-ba77-59ab0a2911e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:39.428017 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddfc14c-7e78-46ac-ba77-59ab0a2911e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:39.428304 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddfc14c-7e78-46ac-ba77-59ab0a2911e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:39.428583 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddfc14c-7e78-46ac-ba77-59ab0a2911e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:39.429283 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddfc14c-7e78-46ac-ba77-59ab0a2911e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:39.431229 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddfc14c-7e78-46ac-ba77-59ab0a2911e2 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:39.516722 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1429/2836] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:14:39 2022] POST /identity/v3/projects => generated 403 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:14:39.520725 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd558c4-fa1e-46ec-a237-99e6e5de2cbe None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:39.531762 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd558c4-fa1e-46ec-a237-99e6e5de2cbe None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:39.549622 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:14:39.591207 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe595d-8c0d-438c-beb6-1878154887b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:39.591911 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe595d-8c0d-438c-beb6-1878154887b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:39.592221 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe595d-8c0d-438c-beb6-1878154887b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:39.592495 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe595d-8c0d-438c-beb6-1878154887b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:39.593219 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fe595d-8c0d-438c-beb6-1878154887b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:39.595120 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fe595d-8c0d-438c-beb6-1878154887b5 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:39.690327 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1408/2837] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:14:39 2022] POST /identity/v3/users => generated 308 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:14:39.692218 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddfc14c-7e78-46ac-ba77-59ab0a2911e2 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:39.704126 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddfc14c-7e78-46ac-ba77-59ab0a2911e2 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:39.710454 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bef4a3-a876-4a9d-981f-16f276fc44ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:39.711197 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bef4a3-a876-4a9d-981f-16f276fc44ee admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:39.711619 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bef4a3-a876-4a9d-981f-16f276fc44ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:39.711999 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bef4a3-a876-4a9d-981f-16f276fc44ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:39.713595 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bef4a3-a876-4a9d-981f-16f276fc44ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:39.714584 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bef4a3-a876-4a9d-981f-16f276fc44ee admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:39.728672 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1430/2838] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:14:39.732922 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe595d-8c0d-438c-beb6-1878154887b5 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:39.743887 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe595d-8c0d-438c-beb6-1878154887b5 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:39.753165 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868f318-0741-4b52-8ace-53d9174d5098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:39.754228 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868f318-0741-4b52-8ace-53d9174d5098 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:39.754611 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868f318-0741-4b52-8ace-53d9174d5098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:39.754984 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868f318-0741-4b52-8ace-53d9174d5098 admin admin] PATH_INFO: `/v3/projects/016db6c876e0427c8e67425acc160ece/users/f1471709179c4f51b3015e863b90354b/roles/681755518698445fabd9a8accec13c0f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:39.774232 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868f318-0741-4b52-8ace-53d9174d5098 admin admin] RBAC: Authorizing `identity:create_grant(project_id=016db6c876e0427c8e67425acc160ece, user_id=f1471709179c4f51b3015e863b90354b, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:39.777010 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868f318-0741-4b52-8ace-53d9174d5098 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:39.853081 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1409/2839] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:14:39 2022] PUT /identity/v3/projects/016db6c876e0427c8e67425acc160ece/users/f1471709179c4f51b3015e863b90354b/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:14:39.857605 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bef4a3-a876-4a9d-981f-16f276fc44ee admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:39.868535 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bef4a3-a876-4a9d-981f-16f276fc44ee admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:39.935654 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d87a3-09fe-48a7-a4f6-f95efbc8ab4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:39.936342 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d87a3-09fe-48a7-a4f6-f95efbc8ab4c admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:39.936620 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d87a3-09fe-48a7-a4f6-f95efbc8ab4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:39.936897 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d87a3-09fe-48a7-a4f6-f95efbc8ab4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:39.938206 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d87a3-09fe-48a7-a4f6-f95efbc8ab4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:39.939272 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d87a3-09fe-48a7-a4f6-f95efbc8ab4c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:39.954885 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1431/2840] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:14:39.956516 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868f318-0741-4b52-8ace-53d9174d5098 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:39.969439 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868f318-0741-4b52-8ace-53d9174d5098 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:39.974688 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408af40-e7ed-409d-9283-b72010fc3a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:39.975711 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408af40-e7ed-409d-9283-b72010fc3a6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:39.975995 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408af40-e7ed-409d-9283-b72010fc3a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:39.976272 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408af40-e7ed-409d-9283-b72010fc3a6d admin admin] PATH_INFO: `/v3/projects/016db6c876e0427c8e67425acc160ece/users/f1471709179c4f51b3015e863b90354b/roles/681755518698445fabd9a8accec13c0f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:39.978296 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408af40-e7ed-409d-9283-b72010fc3a6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=016db6c876e0427c8e67425acc160ece, user_id=f1471709179c4f51b3015e863b90354b, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:39.981790 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408af40-e7ed-409d-9283-b72010fc3a6d admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:39.993532 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1410/2841] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:14:39 2022] PUT /identity/v3/projects/016db6c876e0427c8e67425acc160ece/users/f1471709179c4f51b3015e863b90354b/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:14:40.004180 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba1e12-9de9-4dc1-872b-82816e8b8bbf None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:40.004551 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba1e12-9de9-4dc1-872b-82816e8b8bbf None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:40.004736 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba1e12-9de9-4dc1-872b-82816e8b8bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:40.034650 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-0bba1e12-9de9-4dc1-872b-82816e8b8bbf None None] MFA Rules not processed for user `f1471709179c4f51b3015e863b90354b`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:14:40.035818 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0bba1e12-9de9-4dc1-872b-82816e8b8bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:14:40.051603 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:14:40.117096 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1432/2842] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:14:40 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:14:40.125155 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408af40-e7ed-409d-9283-b72010fc3a6d admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:40.127081 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-1408af40-e7ed-409d-9283-b72010fc3a6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:14:40.193584 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408af40-e7ed-409d-9283-b72010fc3a6d admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:40.197288 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f83df-ad32-4112-ad6f-7f6f32bee2f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:40.198477 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f83df-ad32-4112-ad6f-7f6f32bee2f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:40.198757 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f83df-ad32-4112-ad6f-7f6f32bee2f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:40.199032 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f83df-ad32-4112-ad6f-7f6f32bee2f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:40.208830 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465f83df-ad32-4112-ad6f-7f6f32bee2f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:40.210628 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465f83df-ad32-4112-ad6f-7f6f32bee2f5 service cinder] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:40.220620 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1411/2843] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:14:40 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:14:40.370340 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba1e12-9de9-4dc1-872b-82816e8b8bbf None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:40.452233 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba1e12-9de9-4dc1-872b-82816e8b8bbf None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:40.456943 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a3b42-3fcc-4d2a-acc8-2f8c470fd375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:40.457823 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a3b42-3fcc-4d2a-acc8-2f8c470fd375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:40.458104 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a3b42-3fcc-4d2a-acc8-2f8c470fd375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:40.458381 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a3b42-3fcc-4d2a-acc8-2f8c470fd375 admin admin] PATH_INFO: `/v3/users/0c0d3c5b9e6a4867a468cf1784b178c6` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:40.459608 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a3b42-3fcc-4d2a-acc8-2f8c470fd375 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c0d3c5b9e6a4867a468cf1784b178c6)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:40.461607 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a3b42-3fcc-4d2a-acc8-2f8c470fd375 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:40.749991 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-010a3b42-3fcc-4d2a-acc8-2f8c470fd375 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c0d3c5b9e6a4867a468cf1784b178c6'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:40.751034 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-010a3b42-3fcc-4d2a-acc8-2f8c470fd375 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c0d3c5b9e6a4867a468cf1784b178c6'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:40.775346 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-010a3b42-3fcc-4d2a-acc8-2f8c470fd375 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c0d3c5b9e6a4867a468cf1784b178c6'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:40.795719 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-010a3b42-3fcc-4d2a-acc8-2f8c470fd375 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c0d3c5b9e6a4867a468cf1784b178c6'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:40.796596 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-010a3b42-3fcc-4d2a-acc8-2f8c470fd375 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c0d3c5b9e6a4867a468cf1784b178c6'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:40.901929 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1433/2844] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:14:40 2022] DELETE /identity/v3/users/0c0d3c5b9e6a4867a468cf1784b178c6 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:14:40.906460 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57fbe4-d6c4-4535-9312-1859d450c20e None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:40.906994 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57fbe4-d6c4-4535-9312-1859d450c20e None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:40.906994 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57fbe4-d6c4-4535-9312-1859d450c20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:40.926194 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-2c57fbe4-d6c4-4535-9312-1859d450c20e None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:14:40.927389 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-2c57fbe4-d6c4-4535-9312-1859d450c20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:14:41.006352 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1412/2845] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:14:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:14:41.017560 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a3b42-3fcc-4d2a-acc8-2f8c470fd375 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:41.019112 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-010a3b42-3fcc-4d2a-acc8-2f8c470fd375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:14:41.069175 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:14:41.108646 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a3b42-3fcc-4d2a-acc8-2f8c470fd375 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:41.113493 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d74e9-be42-46f4-bb40-435fd6466534 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:41.114805 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d74e9-be42-46f4-bb40-435fd6466534 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:41.115078 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d74e9-be42-46f4-bb40-435fd6466534 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:41.115357 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d74e9-be42-46f4-bb40-435fd6466534 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:41.126502 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8d74e9-be42-46f4-bb40-435fd6466534 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:41.128625 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8d74e9-be42-46f4-bb40-435fd6466534 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:41.139636 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1434/2846] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:14:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:14:41.714601 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57fbe4-d6c4-4535-9312-1859d450c20e None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:41.716138 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-2c57fbe4-d6c4-4535-9312-1859d450c20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:14:41.729849 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57fbe4-d6c4-4535-9312-1859d450c20e None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:41.734505 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7396065-b5a0-4c71-9fa8-c086dafca1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:41.735378 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7396065-b5a0-4c71-9fa8-c086dafca1c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:41.735702 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7396065-b5a0-4c71-9fa8-c086dafca1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:41.736012 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7396065-b5a0-4c71-9fa8-c086dafca1c5 admin admin] PATH_INFO: `/v3/projects/75eacef5aa7b4d2583c61a45b5f3d764` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:41.737314 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7396065-b5a0-4c71-9fa8-c086dafca1c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75eacef5aa7b4d2583c61a45b5f3d764)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:41.739274 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7396065-b5a0-4c71-9fa8-c086dafca1c5 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:41.761698 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:14:41.917062 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-d7396065-b5a0-4c71-9fa8-c086dafca1c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75eacef5aa7b4d2583c61a45b5f3d764', 'request_id': 'req-d7396065-b5a0-4c71-9fa8-c086dafca1c5'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:41.924119 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-d7396065-b5a0-4c71-9fa8-c086dafca1c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75eacef5aa7b4d2583c61a45b5f3d764', 'request_id': 'req-d7396065-b5a0-4c71-9fa8-c086dafca1c5'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:41.933428 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-d7396065-b5a0-4c71-9fa8-c086dafca1c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75eacef5aa7b4d2583c61a45b5f3d764', 'request_id': 'req-d7396065-b5a0-4c71-9fa8-c086dafca1c5'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:42.021014 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-d7396065-b5a0-4c71-9fa8-c086dafca1c5 admin admin] The token cache is being invalidate because project 75eacef5aa7b4d2583c61a45b5f3d764 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:14:42.021315 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-d7396065-b5a0-4c71-9fa8-c086dafca1c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:42.021979 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-d7396065-b5a0-4c71-9fa8-c086dafca1c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:42.023588 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1413/2847] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:14:41 2022] DELETE /identity/v3/projects/75eacef5aa7b4d2583c61a45b5f3d764 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:14:42.028391 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d74e9-be42-46f4-bb40-435fd6466534 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:42.038151 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d74e9-be42-46f4-bb40-435fd6466534 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:42.117645 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f769aa-8744-4c88-8b48-b50d8860e93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:42.117645 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f769aa-8744-4c88-8b48-b50d8860e93d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:42.117645 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f769aa-8744-4c88-8b48-b50d8860e93d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:42.117645 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f769aa-8744-4c88-8b48-b50d8860e93d admin admin] PATH_INFO: `/v3/users/f1471709179c4f51b3015e863b90354b` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:42.118030 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f769aa-8744-4c88-8b48-b50d8860e93d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1471709179c4f51b3015e863b90354b)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:42.119968 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f769aa-8744-4c88-8b48-b50d8860e93d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:42.332781 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7396065-b5a0-4c71-9fa8-c086dafca1c5 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:42.334271 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-d7396065-b5a0-4c71-9fa8-c086dafca1c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:14:42.353574 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7396065-b5a0-4c71-9fa8-c086dafca1c5 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:42.358407 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac047c8-c98d-414d-8a71-41c20697eb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:42.359270 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac047c8-c98d-414d-8a71-41c20697eb1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:42.359609 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac047c8-c98d-414d-8a71-41c20697eb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:42.359887 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac047c8-c98d-414d-8a71-41c20697eb1c admin admin] PATH_INFO: `/v3/users/cc6337d8ba584d9c87f6d0a1404d60cd` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:42.361204 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac047c8-c98d-414d-8a71-41c20697eb1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc6337d8ba584d9c87f6d0a1404d60cd)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:42.375308 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac047c8-c98d-414d-8a71-41c20697eb1c admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:42.424155 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b7f769aa-8744-4c88-8b48-b50d8860e93d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1471709179c4f51b3015e863b90354b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:42.424815 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b7f769aa-8744-4c88-8b48-b50d8860e93d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1471709179c4f51b3015e863b90354b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:42.437160 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b7f769aa-8744-4c88-8b48-b50d8860e93d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1471709179c4f51b3015e863b90354b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:42.443885 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b7f769aa-8744-4c88-8b48-b50d8860e93d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1471709179c4f51b3015e863b90354b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:42.444548 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b7f769aa-8744-4c88-8b48-b50d8860e93d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1471709179c4f51b3015e863b90354b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:42.542095 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1435/2848] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:14:42 2022] DELETE /identity/v3/users/f1471709179c4f51b3015e863b90354b => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:14:42.618446 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-9ac047c8-c98d-414d-8a71-41c20697eb1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc6337d8ba584d9c87f6d0a1404d60cd'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:42.619096 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-9ac047c8-c98d-414d-8a71-41c20697eb1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc6337d8ba584d9c87f6d0a1404d60cd'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:42.701149 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-9ac047c8-c98d-414d-8a71-41c20697eb1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc6337d8ba584d9c87f6d0a1404d60cd'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:42.701800 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-9ac047c8-c98d-414d-8a71-41c20697eb1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc6337d8ba584d9c87f6d0a1404d60cd'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:42.709579 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-9ac047c8-c98d-414d-8a71-41c20697eb1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc6337d8ba584d9c87f6d0a1404d60cd'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:42.726821 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1414/2849] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:14:42 2022] DELETE /identity/v3/users/cc6337d8ba584d9c87f6d0a1404d60cd => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:14:43.018200 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f769aa-8744-4c88-8b48-b50d8860e93d admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:43.019869 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b7f769aa-8744-4c88-8b48-b50d8860e93d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:14:43.068648 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac047c8-c98d-414d-8a71-41c20697eb1c admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:43.070128 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-9ac047c8-c98d-414d-8a71-41c20697eb1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:14:43.093232 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:14:43.107155 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f769aa-8744-4c88-8b48-b50d8860e93d admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:43.143783 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac047c8-c98d-414d-8a71-41c20697eb1c admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:43.149297 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224f6e7-1dab-4fa1-8b6f-e300b8027a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:43.150170 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224f6e7-1dab-4fa1-8b6f-e300b8027a46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:43.150456 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224f6e7-1dab-4fa1-8b6f-e300b8027a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:43.150722 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224f6e7-1dab-4fa1-8b6f-e300b8027a46 admin admin] PATH_INFO: `/v3/projects/9f270eb2838e4968838fde17de4adf01` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:43.152574 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b224f6e7-1dab-4fa1-8b6f-e300b8027a46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f270eb2838e4968838fde17de4adf01)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:43.154486 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b224f6e7-1dab-4fa1-8b6f-e300b8027a46 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:43.165954 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adfb522-245b-4b41-8542-ef497d0152b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:43.166876 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfb522-245b-4b41-8542-ef497d0152b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:43.167153 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfb522-245b-4b41-8542-ef497d0152b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:43.167947 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:14:43.168111 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfb522-245b-4b41-8542-ef497d0152b0 admin admin] PATH_INFO: `/v3/projects/016db6c876e0427c8e67425acc160ece` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:43.169317 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adfb522-245b-4b41-8542-ef497d0152b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=016db6c876e0427c8e67425acc160ece)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:43.171298 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adfb522-245b-4b41-8542-ef497d0152b0 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:43.290691 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-b224f6e7-1dab-4fa1-8b6f-e300b8027a46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f270eb2838e4968838fde17de4adf01', 'request_id': 'req-b224f6e7-1dab-4fa1-8b6f-e300b8027a46'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:43.297343 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-b224f6e7-1dab-4fa1-8b6f-e300b8027a46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f270eb2838e4968838fde17de4adf01', 'request_id': 'req-b224f6e7-1dab-4fa1-8b6f-e300b8027a46'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:43.303712 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-b224f6e7-1dab-4fa1-8b6f-e300b8027a46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f270eb2838e4968838fde17de4adf01', 'request_id': 'req-b224f6e7-1dab-4fa1-8b6f-e300b8027a46'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:43.317977 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0adfb522-245b-4b41-8542-ef497d0152b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '016db6c876e0427c8e67425acc160ece', 'request_id': 'req-0adfb522-245b-4b41-8542-ef497d0152b0'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:43.437934 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-b224f6e7-1dab-4fa1-8b6f-e300b8027a46 admin admin] The token cache is being invalidate because project 9f270eb2838e4968838fde17de4adf01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:14:43.438188 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-b224f6e7-1dab-4fa1-8b6f-e300b8027a46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:43.438810 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-b224f6e7-1dab-4fa1-8b6f-e300b8027a46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:43.440578 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1415/2850] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:14:43 2022] DELETE /identity/v3/projects/9f270eb2838e4968838fde17de4adf01 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:14:43.444434 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224f6e7-1dab-4fa1-8b6f-e300b8027a46 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:43.445828 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-b224f6e7-1dab-4fa1-8b6f-e300b8027a46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:14:43.467064 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0adfb522-245b-4b41-8542-ef497d0152b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '016db6c876e0427c8e67425acc160ece', 'request_id': 'req-0adfb522-245b-4b41-8542-ef497d0152b0'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:43.474502 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0adfb522-245b-4b41-8542-ef497d0152b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '016db6c876e0427c8e67425acc160ece', 'request_id': 'req-0adfb522-245b-4b41-8542-ef497d0152b0'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:43.486548 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0adfb522-245b-4b41-8542-ef497d0152b0 admin admin] The token cache is being invalidate because project 016db6c876e0427c8e67425acc160ece was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:14:43.486836 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0adfb522-245b-4b41-8542-ef497d0152b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:43.487652 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0adfb522-245b-4b41-8542-ef497d0152b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:43.489215 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1436/2851] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:14:43 2022] DELETE /identity/v3/projects/016db6c876e0427c8e67425acc160ece => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:14:43.494927 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac11649-50ff-4014-81ff-0fd490a71516 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:43.497907 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac11649-50ff-4014-81ff-0fd490a71516 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:43.497907 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac11649-50ff-4014-81ff-0fd490a71516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:43.513904 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-7ac11649-50ff-4014-81ff-0fd490a71516 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:14:43.515117 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-7ac11649-50ff-4014-81ff-0fd490a71516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:14:43.521581 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224f6e7-1dab-4fa1-8b6f-e300b8027a46 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:43.574531 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1437/2852] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 04:14:43.578353 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b9917-d78a-44b7-b1cc-eb8b97790e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:43.579250 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b9917-d78a-44b7-b1cc-eb8b97790e14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:43.579559 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b9917-d78a-44b7-b1cc-eb8b97790e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:43.583742 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b9917-d78a-44b7-b1cc-eb8b97790e14 admin admin] PATH_INFO: `/v3/users/af31dff14a754317b7185e63b06c88ac` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:43.583742 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b9917-d78a-44b7-b1cc-eb8b97790e14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af31dff14a754317b7185e63b06c88ac)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:43.583957 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0eef4-106c-476f-82d7-adc601135dac None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:43.583957 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0eef4-106c-476f-82d7-adc601135dac None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:43.583957 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0eef4-106c-476f-82d7-adc601135dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:43.584210 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b9917-d78a-44b7-b1cc-eb8b97790e14 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:43.602260 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-e0a0eef4-106c-476f-82d7-adc601135dac None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:14:43.603560 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e0a0eef4-106c-476f-82d7-adc601135dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:14:43.611687 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1438/2853] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 04:14:43.615960 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a0eef4-106c-476f-82d7-adc601135dac None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:43.624878 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a0eef4-106c-476f-82d7-adc601135dac None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:43.629508 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fc1fa-ab6e-4eb1-a1b2-9286f2b4ab59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:43.630179 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fc1fa-ab6e-4eb1-a1b2-9286f2b4ab59 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:43.630463 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fc1fa-ab6e-4eb1-a1b2-9286f2b4ab59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:43.630737 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fc1fa-ab6e-4eb1-a1b2-9286f2b4ab59 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:43.631497 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1fc1fa-ab6e-4eb1-a1b2-9286f2b4ab59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:14:43.631812 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1fc1fa-ab6e-4eb1-a1b2-9286f2b4ab59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:43.633413 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1fc1fa-ab6e-4eb1-a1b2-9286f2b4ab59 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:43.645265 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1439/2854] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:14:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 04:14:43.649404 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fc1fa-ab6e-4eb1-a1b2-9286f2b4ab59 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:43.659315 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fc1fa-ab6e-4eb1-a1b2-9286f2b4ab59 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:43.663966 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3d319-822b-4391-b40d-9e07a80e7fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:43.664861 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3d319-822b-4391-b40d-9e07a80e7fca admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:43.665145 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3d319-822b-4391-b40d-9e07a80e7fca admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:43.665419 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3d319-822b-4391-b40d-9e07a80e7fca admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:43.666094 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf3d319-822b-4391-b40d-9e07a80e7fca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:43.668093 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf3d319-822b-4391-b40d-9e07a80e7fca admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:43.766033 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1440/2855] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:14:43 2022] POST /identity/v3/projects => generated 379 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 04:14:43.770316 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3d319-822b-4391-b40d-9e07a80e7fca admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:43.785616 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-4d4b9917-d78a-44b7-b1cc-eb8b97790e14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af31dff14a754317b7185e63b06c88ac'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:43.786428 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-4d4b9917-d78a-44b7-b1cc-eb8b97790e14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af31dff14a754317b7185e63b06c88ac'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:43.832753 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3d319-822b-4391-b40d-9e07a80e7fca admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:43.837405 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f542c0a4-2e56-48d8-990d-1ec7bc7119a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:43.838071 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542c0a4-2e56-48d8-990d-1ec7bc7119a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:43.838355 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542c0a4-2e56-48d8-990d-1ec7bc7119a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:43.838633 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542c0a4-2e56-48d8-990d-1ec7bc7119a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:43.839986 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f542c0a4-2e56-48d8-990d-1ec7bc7119a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:43.841909 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f542c0a4-2e56-48d8-990d-1ec7bc7119a4 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:43.845978 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:14:43.872766 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-4d4b9917-d78a-44b7-b1cc-eb8b97790e14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af31dff14a754317b7185e63b06c88ac'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:43.873401 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-4d4b9917-d78a-44b7-b1cc-eb8b97790e14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af31dff14a754317b7185e63b06c88ac'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:43.881074 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-4d4b9917-d78a-44b7-b1cc-eb8b97790e14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af31dff14a754317b7185e63b06c88ac'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:43.884887 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:14:43.901212 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1416/2856] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:14:43 2022] DELETE /identity/v3/users/af31dff14a754317b7185e63b06c88ac => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:14:43.914517 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1441/2857] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:14:43 2022] POST /identity/v3/users => generated 290 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 04:14:43.921063 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b9917-d78a-44b7-b1cc-eb8b97790e14 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:43.922546 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-4d4b9917-d78a-44b7-b1cc-eb8b97790e14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:14:43.991811 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b9917-d78a-44b7-b1cc-eb8b97790e14 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:43.997719 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa01d2-f8d8-4137-aa32-ee0fac93516d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:43.998412 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa01d2-f8d8-4137-aa32-ee0fac93516d admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:43.998696 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa01d2-f8d8-4137-aa32-ee0fac93516d admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:43.998976 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa01d2-f8d8-4137-aa32-ee0fac93516d admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:43.999743 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aa01d2-f8d8-4137-aa32-ee0fac93516d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:44.001419 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aa01d2-f8d8-4137-aa32-ee0fac93516d admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:44.012492 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1417/2858] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:14:44.016857 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f542c0a4-2e56-48d8-990d-1ec7bc7119a4 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:44.027228 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f542c0a4-2e56-48d8-990d-1ec7bc7119a4 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:44.032376 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e6127-1eda-45ad-a9b0-e63a83b5925a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:44.032996 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e6127-1eda-45ad-a9b0-e63a83b5925a admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:44.035397 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e6127-1eda-45ad-a9b0-e63a83b5925a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:44.035397 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e6127-1eda-45ad-a9b0-e63a83b5925a admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:44.035397 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e6127-1eda-45ad-a9b0-e63a83b5925a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:44.035925 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e6127-1eda-45ad-a9b0-e63a83b5925a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:44.046997 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1442/2859] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:14:44.055415 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa01d2-f8d8-4137-aa32-ee0fac93516d admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:44.067627 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa01d2-f8d8-4137-aa32-ee0fac93516d admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:44.075759 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a202384-959e-4805-86c5-7e594a1051d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:44.075759 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a202384-959e-4805-86c5-7e594a1051d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:44.075759 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a202384-959e-4805-86c5-7e594a1051d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:44.075759 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a202384-959e-4805-86c5-7e594a1051d2 admin admin] PATH_INFO: `/v3/projects/65f8ae7a29124d5c80e0125f079b37f7/users/ddca8838296940b082b0415b67554827/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:44.091157 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a202384-959e-4805-86c5-7e594a1051d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65f8ae7a29124d5c80e0125f079b37f7, user_id=ddca8838296940b082b0415b67554827, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:44.093899 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a202384-959e-4805-86c5-7e594a1051d2 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:44.153045 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e6127-1eda-45ad-a9b0-e63a83b5925a admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:44.154163 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1418/2860] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:14:44 2022] PUT /identity/v3/projects/65f8ae7a29124d5c80e0125f079b37f7/users/ddca8838296940b082b0415b67554827/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:14:44.155437 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-015e6127-1eda-45ad-a9b0-e63a83b5925a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:14:44.173626 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35f540-38f2-4a46-a5cb-f91df0be89d7 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:44.174018 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35f540-38f2-4a46-a5cb-f91df0be89d7 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:44.174332 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35f540-38f2-4a46-a5cb-f91df0be89d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:44.176588 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e6127-1eda-45ad-a9b0-e63a83b5925a admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:44.207938 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-cf35f540-38f2-4a46-a5cb-f91df0be89d7 None None] MFA Rules not processed for user `ddca8838296940b082b0415b67554827`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:14:44.209196 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-cf35f540-38f2-4a46-a5cb-f91df0be89d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:14:44.253239 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d2936-c752-4993-9ed5-7669b3799bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:44.254133 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d2936-c752-4993-9ed5-7669b3799bf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:44.254417 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d2936-c752-4993-9ed5-7669b3799bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:44.254693 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d2936-c752-4993-9ed5-7669b3799bf8 admin admin] PATH_INFO: `/v3/projects/29e12899446546c7ac5b54302d6ab012` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:44.255929 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d2936-c752-4993-9ed5-7669b3799bf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29e12899446546c7ac5b54302d6ab012)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:44.257980 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d2936-c752-4993-9ed5-7669b3799bf8 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:44.280232 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1419/2861] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:14:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 01 04:14:44.284824 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35f540-38f2-4a46-a5cb-f91df0be89d7 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:44.296627 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35f540-38f2-4a46-a5cb-f91df0be89d7 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:44.301825 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da1b0a-a4c4-451e-9ba9-cf27eb4261c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:44.302485 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da1b0a-a4c4-451e-9ba9-cf27eb4261c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:44.302768 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da1b0a-a4c4-451e-9ba9-cf27eb4261c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:44.303043 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da1b0a-a4c4-451e-9ba9-cf27eb4261c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:44.303895 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da1b0a-a4c4-451e-9ba9-cf27eb4261c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:44.305856 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da1b0a-a4c4-451e-9ba9-cf27eb4261c5 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:44.353307 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-740d2936-c752-4993-9ed5-7669b3799bf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29e12899446546c7ac5b54302d6ab012', 'request_id': 'req-740d2936-c752-4993-9ed5-7669b3799bf8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:44.372608 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1420/2862] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:14:44 2022] POST /identity/v3/projects => generated 379 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 04:14:44.375903 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da1b0a-a4c4-451e-9ba9-cf27eb4261c5 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:44.384679 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:14:44.416158 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-740d2936-c752-4993-9ed5-7669b3799bf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29e12899446546c7ac5b54302d6ab012', 'request_id': 'req-740d2936-c752-4993-9ed5-7669b3799bf8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:44.424541 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-740d2936-c752-4993-9ed5-7669b3799bf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29e12899446546c7ac5b54302d6ab012', 'request_id': 'req-740d2936-c752-4993-9ed5-7669b3799bf8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:44.432388 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:14:44.437755 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-740d2936-c752-4993-9ed5-7669b3799bf8 admin admin] The token cache is being invalidate because project 29e12899446546c7ac5b54302d6ab012 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:14:44.438048 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-740d2936-c752-4993-9ed5-7669b3799bf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:44.438721 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-740d2936-c752-4993-9ed5-7669b3799bf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:44.440343 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1443/2863] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:14:44 2022] DELETE /identity/v3/projects/29e12899446546c7ac5b54302d6ab012 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:14:44.451728 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da1b0a-a4c4-451e-9ba9-cf27eb4261c5 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:44.458812 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f90aa-44f7-4ddd-a2e5-7674184203de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:44.459869 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f90aa-44f7-4ddd-a2e5-7674184203de admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:44.460292 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f90aa-44f7-4ddd-a2e5-7674184203de admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:44.460702 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f90aa-44f7-4ddd-a2e5-7674184203de admin admin] PATH_INFO: `/v3/users` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:44.461785 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f90aa-44f7-4ddd-a2e5-7674184203de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:44.465005 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f90aa-44f7-4ddd-a2e5-7674184203de admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:44.565887 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1421/2864] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:14:44 2022] POST /identity/v3/users => generated 296 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 04:14:44.570216 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d2936-c752-4993-9ed5-7669b3799bf8 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:44.571866 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-740d2936-c752-4993-9ed5-7669b3799bf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:14:44.647519 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d2936-c752-4993-9ed5-7669b3799bf8 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:44.653638 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a950665-923d-4052-b67a-e1f9c9cab1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:44.654509 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a950665-923d-4052-b67a-e1f9c9cab1ce admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:44.654972 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a950665-923d-4052-b67a-e1f9c9cab1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:44.655092 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a950665-923d-4052-b67a-e1f9c9cab1ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:44.655855 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a950665-923d-4052-b67a-e1f9c9cab1ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:44.657593 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a950665-923d-4052-b67a-e1f9c9cab1ce admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:44.672914 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1444/2865] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:14:44.678151 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f90aa-44f7-4ddd-a2e5-7674184203de admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:44.690316 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f90aa-44f7-4ddd-a2e5-7674184203de admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:44.695242 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a62d75-7739-4611-b47f-868598f0768a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:44.696334 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a62d75-7739-4611-b47f-868598f0768a admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:44.696625 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a62d75-7739-4611-b47f-868598f0768a admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:44.696900 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a62d75-7739-4611-b47f-868598f0768a admin admin] PATH_INFO: `/v3/projects/f5f6448febd045efb058a54df09ff807/users/9c445edc6033414181bad1320c6d4ea6/roles/681755518698445fabd9a8accec13c0f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:44.715550 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a62d75-7739-4611-b47f-868598f0768a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5f6448febd045efb058a54df09ff807, user_id=9c445edc6033414181bad1320c6d4ea6, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:44.718457 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a62d75-7739-4611-b47f-868598f0768a admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:44.804400 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1422/2866] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:14:44 2022] PUT /identity/v3/projects/f5f6448febd045efb058a54df09ff807/users/9c445edc6033414181bad1320c6d4ea6/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:14:44.808995 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a950665-923d-4052-b67a-e1f9c9cab1ce admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:44.819162 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a950665-923d-4052-b67a-e1f9c9cab1ce admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:44.873987 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d28bc3-29bc-422b-a425-506a1c753211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:44.874657 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d28bc3-29bc-422b-a425-506a1c753211 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:44.874940 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d28bc3-29bc-422b-a425-506a1c753211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:44.875218 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d28bc3-29bc-422b-a425-506a1c753211 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:44.875966 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d28bc3-29bc-422b-a425-506a1c753211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:44.877577 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d28bc3-29bc-422b-a425-506a1c753211 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:44.887882 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1445/2867] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:14:44.892058 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a62d75-7739-4611-b47f-868598f0768a admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:44.902320 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a62d75-7739-4611-b47f-868598f0768a admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:44.906986 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b17807-9631-457d-85aa-e6272db1540c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:44.907907 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b17807-9631-457d-85aa-e6272db1540c admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:44.908190 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b17807-9631-457d-85aa-e6272db1540c admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:44.908464 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b17807-9631-457d-85aa-e6272db1540c admin admin] PATH_INFO: `/v3/projects/f5f6448febd045efb058a54df09ff807/users/9c445edc6033414181bad1320c6d4ea6/roles/681755518698445fabd9a8accec13c0f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:44.910422 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b17807-9631-457d-85aa-e6272db1540c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5f6448febd045efb058a54df09ff807, user_id=9c445edc6033414181bad1320c6d4ea6, role_id=681755518698445fabd9a8accec13c0f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:44.913103 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b17807-9631-457d-85aa-e6272db1540c admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:44.923328 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1423/2868] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:14:44 2022] PUT /identity/v3/projects/f5f6448febd045efb058a54df09ff807/users/9c445edc6033414181bad1320c6d4ea6/roles/681755518698445fabd9a8accec13c0f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:14:44.933621 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae9733-e1c8-405f-b628-1862a4552898 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:44.933942 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae9733-e1c8-405f-b628-1862a4552898 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:44.934224 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae9733-e1c8-405f-b628-1862a4552898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:44.961699 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-b8ae9733-e1c8-405f-b628-1862a4552898 None None] MFA Rules not processed for user `9c445edc6033414181bad1320c6d4ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:14:44.962905 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b8ae9733-e1c8-405f-b628-1862a4552898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:14:45.033828 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1446/2869] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:14:44 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:14:45.051596 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b17807-9631-457d-85aa-e6272db1540c admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:45.053312 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-e8b17807-9631-457d-85aa-e6272db1540c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:14:45.110652 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b17807-9631-457d-85aa-e6272db1540c admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:45.114309 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fea575-8dd6-4264-a10b-94992e951877 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:45.114950 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fea575-8dd6-4264-a10b-94992e951877 service cinder] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:45.115237 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fea575-8dd6-4264-a10b-94992e951877 service cinder] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:45.115545 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fea575-8dd6-4264-a10b-94992e951877 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:45.125197 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fea575-8dd6-4264-a10b-94992e951877 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:45.126630 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fea575-8dd6-4264-a10b-94992e951877 service cinder] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:45.136027 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1424/2870] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:14:45 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:14:45.927093 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae9733-e1c8-405f-b628-1862a4552898 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:45.936342 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae9733-e1c8-405f-b628-1862a4552898 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:45.940986 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e713084-28c6-4edf-b495-f4a4e113e72d tempest-VolumeQuotaClassesTest-269206163 tempest-VolumeQuotaClassesTest-269206163-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c445edc6033414181bad1320c6d4ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f6448febd045efb058a54df09ff807', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:45.941629 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e713084-28c6-4edf-b495-f4a4e113e72d tempest-VolumeQuotaClassesTest-269206163 tempest-VolumeQuotaClassesTest-269206163-project-admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:45.941917 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e713084-28c6-4edf-b495-f4a4e113e72d tempest-VolumeQuotaClassesTest-269206163 tempest-VolumeQuotaClassesTest-269206163-project-admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:45.942196 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e713084-28c6-4edf-b495-f4a4e113e72d tempest-VolumeQuotaClassesTest-269206163 tempest-VolumeQuotaClassesTest-269206163-project-admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:45.942922 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e713084-28c6-4edf-b495-f4a4e113e72d tempest-VolumeQuotaClassesTest-269206163 tempest-VolumeQuotaClassesTest-269206163-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:14:45.943235 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e713084-28c6-4edf-b495-f4a4e113e72d tempest-VolumeQuotaClassesTest-269206163 tempest-VolumeQuotaClassesTest-269206163-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:45.944885 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e713084-28c6-4edf-b495-f4a4e113e72d tempest-VolumeQuotaClassesTest-269206163 tempest-VolumeQuotaClassesTest-269206163-project-admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:45.957282 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1447/2871] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:14:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:14:45.961248 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fea575-8dd6-4264-a10b-94992e951877 service cinder] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:45.970909 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fea575-8dd6-4264-a10b-94992e951877 service cinder] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:45.975616 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd9d01-947e-4cbe-9f8e-384e552c5dab tempest-VolumeQuotaClassesTest-269206163 tempest-VolumeQuotaClassesTest-269206163-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c445edc6033414181bad1320c6d4ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f6448febd045efb058a54df09ff807', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:45.976260 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd9d01-947e-4cbe-9f8e-384e552c5dab tempest-VolumeQuotaClassesTest-269206163 tempest-VolumeQuotaClassesTest-269206163-project-admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:45.976545 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd9d01-947e-4cbe-9f8e-384e552c5dab tempest-VolumeQuotaClassesTest-269206163 tempest-VolumeQuotaClassesTest-269206163-project-admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:45.976832 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd9d01-947e-4cbe-9f8e-384e552c5dab tempest-VolumeQuotaClassesTest-269206163 tempest-VolumeQuotaClassesTest-269206163-project-admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:45.977522 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abd9d01-947e-4cbe-9f8e-384e552c5dab tempest-VolumeQuotaClassesTest-269206163 tempest-VolumeQuotaClassesTest-269206163-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:45.979490 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abd9d01-947e-4cbe-9f8e-384e552c5dab tempest-VolumeQuotaClassesTest-269206163 tempest-VolumeQuotaClassesTest-269206163-project-admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:46.097964 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1425/2872] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:14:45 2022] POST /identity/v3/projects => generated 354 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:14:46.102139 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e713084-28c6-4edf-b495-f4a4e113e72d tempest-VolumeQuotaClassesTest-269206163 tempest-VolumeQuotaClassesTest-269206163-project-admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:46.107403 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:14:46.113033 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e713084-28c6-4edf-b495-f4a4e113e72d tempest-VolumeQuotaClassesTest-269206163 tempest-VolumeQuotaClassesTest-269206163-project-admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:46.170040 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83669e52-5d29-403c-b3af-1c5ae054ffc8 tempest-VolumeQuotaClassesTest-269206163 tempest-VolumeQuotaClassesTest-269206163-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c445edc6033414181bad1320c6d4ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f6448febd045efb058a54df09ff807', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:46.170706 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83669e52-5d29-403c-b3af-1c5ae054ffc8 tempest-VolumeQuotaClassesTest-269206163 tempest-VolumeQuotaClassesTest-269206163-project-admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:46.170997 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83669e52-5d29-403c-b3af-1c5ae054ffc8 tempest-VolumeQuotaClassesTest-269206163 tempest-VolumeQuotaClassesTest-269206163-project-admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:46.171277 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83669e52-5d29-403c-b3af-1c5ae054ffc8 tempest-VolumeQuotaClassesTest-269206163 tempest-VolumeQuotaClassesTest-269206163-project-admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:46.172039 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83669e52-5d29-403c-b3af-1c5ae054ffc8 tempest-VolumeQuotaClassesTest-269206163 tempest-VolumeQuotaClassesTest-269206163-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:14:46.172346 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83669e52-5d29-403c-b3af-1c5ae054ffc8 tempest-VolumeQuotaClassesTest-269206163 tempest-VolumeQuotaClassesTest-269206163-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:46.174013 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83669e52-5d29-403c-b3af-1c5ae054ffc8 tempest-VolumeQuotaClassesTest-269206163 tempest-VolumeQuotaClassesTest-269206163-project-admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:46.186921 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1448/2873] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:14:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:14:46.223020 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd9d01-947e-4cbe-9f8e-384e552c5dab tempest-VolumeQuotaClassesTest-269206163 tempest-VolumeQuotaClassesTest-269206163-project-admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:46.233953 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd9d01-947e-4cbe-9f8e-384e552c5dab tempest-VolumeQuotaClassesTest-269206163 tempest-VolumeQuotaClassesTest-269206163-project-admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:46.239188 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630c1a9-3820-44a9-87f4-0b1472e34aa2 tempest-VolumeQuotaClassesTest-269206163 tempest-VolumeQuotaClassesTest-269206163-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c445edc6033414181bad1320c6d4ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5f6448febd045efb058a54df09ff807', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:46.240079 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630c1a9-3820-44a9-87f4-0b1472e34aa2 tempest-VolumeQuotaClassesTest-269206163 tempest-VolumeQuotaClassesTest-269206163-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:46.240370 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630c1a9-3820-44a9-87f4-0b1472e34aa2 tempest-VolumeQuotaClassesTest-269206163 tempest-VolumeQuotaClassesTest-269206163-project-admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:46.242566 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630c1a9-3820-44a9-87f4-0b1472e34aa2 tempest-VolumeQuotaClassesTest-269206163 tempest-VolumeQuotaClassesTest-269206163-project-admin] PATH_INFO: `/v3/projects/faf2d05649ff49a5adb19428b3395808` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:46.242566 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5630c1a9-3820-44a9-87f4-0b1472e34aa2 tempest-VolumeQuotaClassesTest-269206163 tempest-VolumeQuotaClassesTest-269206163-project-admin] RBAC: Authorizing `identity:delete_project(project_id=faf2d05649ff49a5adb19428b3395808)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:46.243755 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5630c1a9-3820-44a9-87f4-0b1472e34aa2 tempest-VolumeQuotaClassesTest-269206163 tempest-VolumeQuotaClassesTest-269206163-project-admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:46.355008 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:DELETE=2 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:14:46.364268 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-5630c1a9-3820-44a9-87f4-0b1472e34aa2 tempest-VolumeQuotaClassesTest-269206163 tempest-VolumeQuotaClassesTest-269206163-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faf2d05649ff49a5adb19428b3395808', 'request_id': 'req-5630c1a9-3820-44a9-87f4-0b1472e34aa2'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:46.370501 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-5630c1a9-3820-44a9-87f4-0b1472e34aa2 tempest-VolumeQuotaClassesTest-269206163 tempest-VolumeQuotaClassesTest-269206163-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faf2d05649ff49a5adb19428b3395808', 'request_id': 'req-5630c1a9-3820-44a9-87f4-0b1472e34aa2'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:46.376380 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-5630c1a9-3820-44a9-87f4-0b1472e34aa2 tempest-VolumeQuotaClassesTest-269206163 tempest-VolumeQuotaClassesTest-269206163-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faf2d05649ff49a5adb19428b3395808', 'request_id': 'req-5630c1a9-3820-44a9-87f4-0b1472e34aa2'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:46.420664 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-5630c1a9-3820-44a9-87f4-0b1472e34aa2 tempest-VolumeQuotaClassesTest-269206163 tempest-VolumeQuotaClassesTest-269206163-project-admin] The token cache is being invalidate because project faf2d05649ff49a5adb19428b3395808 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:14:46.420879 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-5630c1a9-3820-44a9-87f4-0b1472e34aa2 tempest-VolumeQuotaClassesTest-269206163 tempest-VolumeQuotaClassesTest-269206163-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:46.421510 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-5630c1a9-3820-44a9-87f4-0b1472e34aa2 tempest-VolumeQuotaClassesTest-269206163 tempest-VolumeQuotaClassesTest-269206163-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:46.423084 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1426/2874] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:14:46 2022] DELETE /identity/v3/projects/faf2d05649ff49a5adb19428b3395808 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:14:47.077540 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83669e52-5d29-403c-b3af-1c5ae054ffc8 tempest-VolumeQuotaClassesTest-269206163 tempest-VolumeQuotaClassesTest-269206163-project-admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:47.079417 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-83669e52-5d29-403c-b3af-1c5ae054ffc8 tempest-VolumeQuotaClassesTest-269206163 tempest-VolumeQuotaClassesTest-269206163-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:14:47.148067 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83669e52-5d29-403c-b3af-1c5ae054ffc8 tempest-VolumeQuotaClassesTest-269206163 tempest-VolumeQuotaClassesTest-269206163-project-admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:47.203208 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda4ef71-8576-4688-8929-4f604a7946a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:47.204119 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4ef71-8576-4688-8929-4f604a7946a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:47.204400 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4ef71-8576-4688-8929-4f604a7946a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:47.204675 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4ef71-8576-4688-8929-4f604a7946a9 admin admin] PATH_INFO: `/v3/users/ddca8838296940b082b0415b67554827` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:47.205855 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda4ef71-8576-4688-8929-4f604a7946a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddca8838296940b082b0415b67554827)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:47.207837 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda4ef71-8576-4688-8929-4f604a7946a9 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:47.365186 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:14:47.366689 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-dda4ef71-8576-4688-8929-4f604a7946a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddca8838296940b082b0415b67554827'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:47.367341 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-dda4ef71-8576-4688-8929-4f604a7946a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddca8838296940b082b0415b67554827'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:47.379848 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-dda4ef71-8576-4688-8929-4f604a7946a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddca8838296940b082b0415b67554827'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:47.386748 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-dda4ef71-8576-4688-8929-4f604a7946a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddca8838296940b082b0415b67554827'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:47.387422 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-dda4ef71-8576-4688-8929-4f604a7946a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddca8838296940b082b0415b67554827'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:47.547531 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1449/2875] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:14:47 2022] DELETE /identity/v3/users/ddca8838296940b082b0415b67554827 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:14:47.552183 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886fb74-853a-4468-908e-df5d3bcca22b None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:47.552667 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886fb74-853a-4468-908e-df5d3bcca22b None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:47.552788 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886fb74-853a-4468-908e-df5d3bcca22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:47.571493 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-d886fb74-853a-4468-908e-df5d3bcca22b None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:14:47.572824 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-d886fb74-853a-4468-908e-df5d3bcca22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:14:47.631894 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1427/2876] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:14:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:14:47.641633 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda4ef71-8576-4688-8929-4f604a7946a9 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:47.643026 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-dda4ef71-8576-4688-8929-4f604a7946a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:14:47.706668 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda4ef71-8576-4688-8929-4f604a7946a9 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:47.710310 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce8ff1-02bd-4e5b-99ed-54afbeebbbc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:47.710954 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce8ff1-02bd-4e5b-99ed-54afbeebbbc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:47.711236 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce8ff1-02bd-4e5b-99ed-54afbeebbbc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:47.711532 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce8ff1-02bd-4e5b-99ed-54afbeebbbc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:47.722142 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce8ff1-02bd-4e5b-99ed-54afbeebbbc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:47.723701 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce8ff1-02bd-4e5b-99ed-54afbeebbbc0 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:47.734125 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1450/2877] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:14:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:14:48.126640 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886fb74-853a-4468-908e-df5d3bcca22b None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:48.128249 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-d886fb74-853a-4468-908e-df5d3bcca22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:14:48.146870 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886fb74-853a-4468-908e-df5d3bcca22b None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:48.153751 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2491c2f-08eb-41c1-a85f-5f2fdb30f2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:48.153751 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2491c2f-08eb-41c1-a85f-5f2fdb30f2e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:48.153751 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2491c2f-08eb-41c1-a85f-5f2fdb30f2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:48.153751 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2491c2f-08eb-41c1-a85f-5f2fdb30f2e2 admin admin] PATH_INFO: `/v3/projects/65f8ae7a29124d5c80e0125f079b37f7` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:48.154992 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2491c2f-08eb-41c1-a85f-5f2fdb30f2e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65f8ae7a29124d5c80e0125f079b37f7)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:48.157086 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2491c2f-08eb-41c1-a85f-5f2fdb30f2e2 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:48.313532 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-f2491c2f-08eb-41c1-a85f-5f2fdb30f2e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65f8ae7a29124d5c80e0125f079b37f7', 'request_id': 'req-f2491c2f-08eb-41c1-a85f-5f2fdb30f2e2'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:48.320056 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-f2491c2f-08eb-41c1-a85f-5f2fdb30f2e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65f8ae7a29124d5c80e0125f079b37f7', 'request_id': 'req-f2491c2f-08eb-41c1-a85f-5f2fdb30f2e2'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:48.325732 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-f2491c2f-08eb-41c1-a85f-5f2fdb30f2e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65f8ae7a29124d5c80e0125f079b37f7', 'request_id': 'req-f2491c2f-08eb-41c1-a85f-5f2fdb30f2e2'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:48.409364 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-f2491c2f-08eb-41c1-a85f-5f2fdb30f2e2 admin admin] The token cache is being invalidate because project 65f8ae7a29124d5c80e0125f079b37f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:14:48.409591 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-f2491c2f-08eb-41c1-a85f-5f2fdb30f2e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:48.410194 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-f2491c2f-08eb-41c1-a85f-5f2fdb30f2e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:48.411814 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1428/2878] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:14:48 2022] DELETE /identity/v3/projects/65f8ae7a29124d5c80e0125f079b37f7 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:14:48.422376 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce8ff1-02bd-4e5b-99ed-54afbeebbbc0 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:48.432551 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce8ff1-02bd-4e5b-99ed-54afbeebbbc0 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:48.490005 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c396d47-a049-49d5-a5ba-5a860f2aef65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:48.490901 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c396d47-a049-49d5-a5ba-5a860f2aef65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:48.491582 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c396d47-a049-49d5-a5ba-5a860f2aef65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:48.491582 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c396d47-a049-49d5-a5ba-5a860f2aef65 admin admin] PATH_INFO: `/v3/users/9c445edc6033414181bad1320c6d4ea6` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:48.492691 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c396d47-a049-49d5-a5ba-5a860f2aef65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c445edc6033414181bad1320c6d4ea6)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:48.494631 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c396d47-a049-49d5-a5ba-5a860f2aef65 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:48.657691 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-3c396d47-a049-49d5-a5ba-5a860f2aef65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c445edc6033414181bad1320c6d4ea6'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:48.658385 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-3c396d47-a049-49d5-a5ba-5a860f2aef65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c445edc6033414181bad1320c6d4ea6'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:48.671586 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-3c396d47-a049-49d5-a5ba-5a860f2aef65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c445edc6033414181bad1320c6d4ea6'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:48.673471 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:14:48.679154 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-3c396d47-a049-49d5-a5ba-5a860f2aef65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c445edc6033414181bad1320c6d4ea6'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:48.681065 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-3c396d47-a049-49d5-a5ba-5a860f2aef65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c445edc6033414181bad1320c6d4ea6'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:48.751765 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1451/2879] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:14:48 2022] DELETE /identity/v3/users/9c445edc6033414181bad1320c6d4ea6 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:14:49.159343 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2491c2f-08eb-41c1-a85f-5f2fdb30f2e2 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:49.160842 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-f2491c2f-08eb-41c1-a85f-5f2fdb30f2e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:14:49.174950 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2491c2f-08eb-41c1-a85f-5f2fdb30f2e2 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:49.227143 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:14:49.240036 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8d199-2845-4a63-805b-933182ba099b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:49.240899 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8d199-2845-4a63-805b-933182ba099b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:49.241182 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8d199-2845-4a63-805b-933182ba099b admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:49.241459 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8d199-2845-4a63-805b-933182ba099b admin admin] PATH_INFO: `/v3/projects/f5f6448febd045efb058a54df09ff807` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:49.242721 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef8d199-2845-4a63-805b-933182ba099b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5f6448febd045efb058a54df09ff807)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:49.244667 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef8d199-2845-4a63-805b-933182ba099b admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:49.360158 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-aef8d199-2845-4a63-805b-933182ba099b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5f6448febd045efb058a54df09ff807', 'request_id': 'req-aef8d199-2845-4a63-805b-933182ba099b'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:49.366348 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-aef8d199-2845-4a63-805b-933182ba099b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5f6448febd045efb058a54df09ff807', 'request_id': 'req-aef8d199-2845-4a63-805b-933182ba099b'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:49.372571 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-aef8d199-2845-4a63-805b-933182ba099b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5f6448febd045efb058a54df09ff807', 'request_id': 'req-aef8d199-2845-4a63-805b-933182ba099b'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:49.421203 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-aef8d199-2845-4a63-805b-933182ba099b admin admin] The token cache is being invalidate because project f5f6448febd045efb058a54df09ff807 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:14:49.421428 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-aef8d199-2845-4a63-805b-933182ba099b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:49.422054 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-aef8d199-2845-4a63-805b-933182ba099b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:49.423628 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1429/2880] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:14:49 2022] DELETE /identity/v3/projects/f5f6448febd045efb058a54df09ff807 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:14:49.429736 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b6258-f806-465b-8dfa-8117634691f2 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:49.430204 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b6258-f806-465b-8dfa-8117634691f2 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:49.430362 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b6258-f806-465b-8dfa-8117634691f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:49.448635 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-816b6258-f806-465b-8dfa-8117634691f2 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:14:49.450391 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-816b6258-f806-465b-8dfa-8117634691f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:14:49.511560 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1452/2881] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:14:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:14:49.520744 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b64619-38a6-48a3-bf65-040f8a5a699e None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:49.521032 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b64619-38a6-48a3-bf65-040f8a5a699e None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:49.521312 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b64619-38a6-48a3-bf65-040f8a5a699e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:49.540735 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-96b64619-38a6-48a3-bf65-040f8a5a699e None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:14:49.542088 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-96b64619-38a6-48a3-bf65-040f8a5a699e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:14:49.552221 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1430/2882] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:14:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:14:49.556754 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b6258-f806-465b-8dfa-8117634691f2 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:49.569156 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b6258-f806-465b-8dfa-8117634691f2 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:49.575888 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1f613-b2ff-4396-afbd-768f07939e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:49.576865 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1f613-b2ff-4396-afbd-768f07939e7a admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:49.577408 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1f613-b2ff-4396-afbd-768f07939e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:49.577770 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1f613-b2ff-4396-afbd-768f07939e7a admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:49.578573 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d1f613-b2ff-4396-afbd-768f07939e7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:14:49.579055 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d1f613-b2ff-4396-afbd-768f07939e7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:49.581804 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d1f613-b2ff-4396-afbd-768f07939e7a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:49.596995 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1453/2883] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:14:49.602117 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b64619-38a6-48a3-bf65-040f8a5a699e None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:49.615108 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b64619-38a6-48a3-bf65-040f8a5a699e None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:49.622024 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455de7b-9722-45e3-a2c1-2c83e7210554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:49.622828 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455de7b-9722-45e3-a2c1-2c83e7210554 admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:49.623190 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455de7b-9722-45e3-a2c1-2c83e7210554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:49.623556 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455de7b-9722-45e3-a2c1-2c83e7210554 admin admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:49.624534 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455de7b-9722-45e3-a2c1-2c83e7210554 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:49.626917 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455de7b-9722-45e3-a2c1-2c83e7210554 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:49.777323 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1431/2884] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:14:49 2022] POST /identity/v3/projects => generated 373 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:14:49.782108 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1f613-b2ff-4396-afbd-768f07939e7a admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:49.792608 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1f613-b2ff-4396-afbd-768f07939e7a admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:49.848510 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d41c8b-aa3b-40bb-82f2-4f85e43998c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:49.849179 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d41c8b-aa3b-40bb-82f2-4f85e43998c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:49.849459 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d41c8b-aa3b-40bb-82f2-4f85e43998c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:49.849731 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d41c8b-aa3b-40bb-82f2-4f85e43998c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:49.850406 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d41c8b-aa3b-40bb-82f2-4f85e43998c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:49.852359 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d41c8b-aa3b-40bb-82f2-4f85e43998c3 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:49.950113 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1454/2885] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:14:49 2022] POST /identity/v3/users => generated 287 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:14:49.951954 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455de7b-9722-45e3-a2c1-2c83e7210554 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:49.962318 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455de7b-9722-45e3-a2c1-2c83e7210554 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:49.967010 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc8724-fdf1-486c-8dbd-b9078e4726cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:49.967704 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc8724-fdf1-486c-8dbd-b9078e4726cf admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:49.967989 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc8724-fdf1-486c-8dbd-b9078e4726cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:49.968263 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc8724-fdf1-486c-8dbd-b9078e4726cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:49.969011 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc8724-fdf1-486c-8dbd-b9078e4726cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:49.970609 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc8724-fdf1-486c-8dbd-b9078e4726cf admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:49.981243 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1432/2886] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:14:49.986243 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d41c8b-aa3b-40bb-82f2-4f85e43998c3 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:49.997425 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d41c8b-aa3b-40bb-82f2-4f85e43998c3 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:50.002180 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24159b97-992b-4103-97a4-239ac1337b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:50.002935 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24159b97-992b-4103-97a4-239ac1337b97 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:50.003225 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24159b97-992b-4103-97a4-239ac1337b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:50.003551 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24159b97-992b-4103-97a4-239ac1337b97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:50.004259 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24159b97-992b-4103-97a4-239ac1337b97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:50.005871 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24159b97-992b-4103-97a4-239ac1337b97 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:50.016833 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1455/2887] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:14:50.020965 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc8724-fdf1-486c-8dbd-b9078e4726cf admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:50.030978 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc8724-fdf1-486c-8dbd-b9078e4726cf admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:50.035678 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e8166-8d0f-423f-935c-6bd912fc14c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:50.041078 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e8166-8d0f-423f-935c-6bd912fc14c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:50.041078 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e8166-8d0f-423f-935c-6bd912fc14c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:50.041078 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e8166-8d0f-423f-935c-6bd912fc14c6 admin admin] PATH_INFO: `/v3/projects/ffafe7de39324954b31cdddc18fa7723/users/fb753d43d94f42f386f92b6a228910a0/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:50.051879 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620e8166-8d0f-423f-935c-6bd912fc14c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffafe7de39324954b31cdddc18fa7723, user_id=fb753d43d94f42f386f92b6a228910a0, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:50.054560 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620e8166-8d0f-423f-935c-6bd912fc14c6 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:50.125097 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1433/2888] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:14:50 2022] PUT /identity/v3/projects/ffafe7de39324954b31cdddc18fa7723/users/fb753d43d94f42f386f92b6a228910a0/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:14:50.135325 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f266c-4144-434d-a507-f300a9f96bc5 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:50.135656 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f266c-4144-434d-a507-f300a9f96bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:50.135938 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f266c-4144-434d-a507-f300a9f96bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:50.163181 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-540f266c-4144-434d-a507-f300a9f96bc5 None None] MFA Rules not processed for user `fb753d43d94f42f386f92b6a228910a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:14:50.164698 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-540f266c-4144-434d-a507-f300a9f96bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:14:50.206287 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:14:50.230029 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1456/2889] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:14:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:14:50.241175 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e8166-8d0f-423f-935c-6bd912fc14c6 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:50.242930 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-620e8166-8d0f-423f-935c-6bd912fc14c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:14:50.299492 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e8166-8d0f-423f-935c-6bd912fc14c6 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:50.303057 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384058b0-da7e-4e0f-8b98-2a92f87e2a5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:50.303755 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384058b0-da7e-4e0f-8b98-2a92f87e2a5c service cinder] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:50.304038 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384058b0-da7e-4e0f-8b98-2a92f87e2a5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:50.304316 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384058b0-da7e-4e0f-8b98-2a92f87e2a5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:50.313309 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384058b0-da7e-4e0f-8b98-2a92f87e2a5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:50.314741 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384058b0-da7e-4e0f-8b98-2a92f87e2a5c service cinder] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:50.323469 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1434/2890] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:14:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:14:54.403479 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f266c-4144-434d-a507-f300a9f96bc5 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:54.464912 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f266c-4144-434d-a507-f300a9f96bc5 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:54.469868 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e3304-b5a5-476f-99a1-86b6e0831d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:54.470745 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e3304-b5a5-476f-99a1-86b6e0831d8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:54.471025 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e3304-b5a5-476f-99a1-86b6e0831d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:54.471297 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e3304-b5a5-476f-99a1-86b6e0831d8a admin admin] PATH_INFO: `/v3/users/fb753d43d94f42f386f92b6a228910a0` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:54.472503 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84e3304-b5a5-476f-99a1-86b6e0831d8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb753d43d94f42f386f92b6a228910a0)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:54.474423 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84e3304-b5a5-476f-99a1-86b6e0831d8a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:54.664825 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c84e3304-b5a5-476f-99a1-86b6e0831d8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb753d43d94f42f386f92b6a228910a0'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:54.665405 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c84e3304-b5a5-476f-99a1-86b6e0831d8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb753d43d94f42f386f92b6a228910a0'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:54.679032 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c84e3304-b5a5-476f-99a1-86b6e0831d8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb753d43d94f42f386f92b6a228910a0'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:54.687582 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c84e3304-b5a5-476f-99a1-86b6e0831d8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb753d43d94f42f386f92b6a228910a0'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:54.688302 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c84e3304-b5a5-476f-99a1-86b6e0831d8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb753d43d94f42f386f92b6a228910a0'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:54.803895 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1457/2891] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:14:54 2022] DELETE /identity/v3/users/fb753d43d94f42f386f92b6a228910a0 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:14:54.808471 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af60a73-c578-4bda-ad74-e6fa4ed5f4b8 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:54.811581 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af60a73-c578-4bda-ad74-e6fa4ed5f4b8 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:54.811581 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af60a73-c578-4bda-ad74-e6fa4ed5f4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:54.826087 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-2af60a73-c578-4bda-ad74-e6fa4ed5f4b8 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:14:54.827833 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-2af60a73-c578-4bda-ad74-e6fa4ed5f4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:14:54.837130 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:14:54.886122 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1435/2892] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:14:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:14:54.902588 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e3304-b5a5-476f-99a1-86b6e0831d8a admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:54.904051 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c84e3304-b5a5-476f-99a1-86b6e0831d8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:14:54.961261 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e3304-b5a5-476f-99a1-86b6e0831d8a admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:54.964942 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6659d-f498-4c41-bc13-6d3948a65602 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:54.965591 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6659d-f498-4c41-bc13-6d3948a65602 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:54.965875 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6659d-f498-4c41-bc13-6d3948a65602 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:54.966151 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6659d-f498-4c41-bc13-6d3948a65602 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:54.976049 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6659d-f498-4c41-bc13-6d3948a65602 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:54.977545 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6659d-f498-4c41-bc13-6d3948a65602 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:54.987504 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1458/2893] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:14:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:14:55.359644 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af60a73-c578-4bda-ad74-e6fa4ed5f4b8 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:55.363025 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-2af60a73-c578-4bda-ad74-e6fa4ed5f4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:14:55.375218 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af60a73-c578-4bda-ad74-e6fa4ed5f4b8 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:55.380264 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7572291-326d-40e1-9ff6-c62f857b2cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:55.381143 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7572291-326d-40e1-9ff6-c62f857b2cdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:55.382380 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7572291-326d-40e1-9ff6-c62f857b2cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:55.382380 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7572291-326d-40e1-9ff6-c62f857b2cdd admin admin] PATH_INFO: `/v3/projects/ffafe7de39324954b31cdddc18fa7723` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:55.382901 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7572291-326d-40e1-9ff6-c62f857b2cdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffafe7de39324954b31cdddc18fa7723)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:55.384942 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7572291-326d-40e1-9ff6-c62f857b2cdd admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:55.479118 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-d7572291-326d-40e1-9ff6-c62f857b2cdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffafe7de39324954b31cdddc18fa7723', 'request_id': 'req-d7572291-326d-40e1-9ff6-c62f857b2cdd'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:55.486342 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-d7572291-326d-40e1-9ff6-c62f857b2cdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffafe7de39324954b31cdddc18fa7723', 'request_id': 'req-d7572291-326d-40e1-9ff6-c62f857b2cdd'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:55.492171 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-d7572291-326d-40e1-9ff6-c62f857b2cdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffafe7de39324954b31cdddc18fa7723', 'request_id': 'req-d7572291-326d-40e1-9ff6-c62f857b2cdd'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:55.569134 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-d7572291-326d-40e1-9ff6-c62f857b2cdd admin admin] The token cache is being invalidate because project ffafe7de39324954b31cdddc18fa7723 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:14:55.569420 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-d7572291-326d-40e1-9ff6-c62f857b2cdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:55.570040 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-d7572291-326d-40e1-9ff6-c62f857b2cdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:14:55.571631 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1436/2894] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:14:55 2022] DELETE /identity/v3/projects/ffafe7de39324954b31cdddc18fa7723 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:14:55.576512 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335c247-4650-414d-88da-cc493b20cf58 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:55.580940 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335c247-4650-414d-88da-cc493b20cf58 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:55.580940 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335c247-4650-414d-88da-cc493b20cf58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:55.583833 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:14:55.596928 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-0335c247-4650-414d-88da-cc493b20cf58 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:14:55.598143 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0335c247-4650-414d-88da-cc493b20cf58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:14:55.656950 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1459/2895] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:14:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:14:55.665009 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab8357-5c25-4684-a0bf-1df01cef0211 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:55.667550 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab8357-5c25-4684-a0bf-1df01cef0211 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:55.667550 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab8357-5c25-4684-a0bf-1df01cef0211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:55.684387 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-2dab8357-5c25-4684-a0bf-1df01cef0211 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:14:55.685605 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-2dab8357-5c25-4684-a0bf-1df01cef0211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:14:55.693482 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1437/2896] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:14:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:14:55.697697 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0335c247-4650-414d-88da-cc493b20cf58 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:55.708243 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0335c247-4650-414d-88da-cc493b20cf58 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:55.712777 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31f6a1-20be-473a-8674-5526bcffcbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:55.713428 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31f6a1-20be-473a-8674-5526bcffcbf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:55.713716 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31f6a1-20be-473a-8674-5526bcffcbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:55.713992 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31f6a1-20be-473a-8674-5526bcffcbf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:55.714708 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31f6a1-20be-473a-8674-5526bcffcbf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 04:14:55.715016 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31f6a1-20be-473a-8674-5526bcffcbf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:55.716658 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31f6a1-20be-473a-8674-5526bcffcbf4 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:55.728581 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1460/2897] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Jul 1 04:14:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 04:14:55.733059 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab8357-5c25-4684-a0bf-1df01cef0211 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:55.742243 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab8357-5c25-4684-a0bf-1df01cef0211 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:55.746911 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d58da3-39ac-4803-81a1-97480ce6075e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:55.747573 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d58da3-39ac-4803-81a1-97480ce6075e admin admin] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:55.747862 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d58da3-39ac-4803-81a1-97480ce6075e admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:55.748141 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d58da3-39ac-4803-81a1-97480ce6075e admin admin] PATH_INFO: `/v3/projects` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:55.748832 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d58da3-39ac-4803-81a1-97480ce6075e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:55.750728 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d58da3-39ac-4803-81a1-97480ce6075e admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:55.845311 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1438/2898] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Jul 1 04:14:55 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:14:55.849538 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31f6a1-20be-473a-8674-5526bcffcbf4 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:55.859644 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31f6a1-20be-473a-8674-5526bcffcbf4 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:55.916540 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f86a8e8-29bd-4c65-b8b7-9bd9fbcf62ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:55.917216 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86a8e8-29bd-4c65-b8b7-9bd9fbcf62ae admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:55.917497 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86a8e8-29bd-4c65-b8b7-9bd9fbcf62ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:55.917774 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86a8e8-29bd-4c65-b8b7-9bd9fbcf62ae admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:55.918469 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f86a8e8-29bd-4c65-b8b7-9bd9fbcf62ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:55.920426 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f86a8e8-29bd-4c65-b8b7-9bd9fbcf62ae admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:56.005106 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1461/2899] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Jul 1 04:14:55 2022] POST /identity/v3/users => generated 288 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 04:14:56.009081 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d58da3-39ac-4803-81a1-97480ce6075e admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:56.020259 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d58da3-39ac-4803-81a1-97480ce6075e admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:56.025255 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa05e38-0124-42f1-a3cc-7d7d53e8a0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:56.028348 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa05e38-0124-42f1-a3cc-7d7d53e8a0cf admin admin] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:56.028348 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa05e38-0124-42f1-a3cc-7d7d53e8a0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:56.028348 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa05e38-0124-42f1-a3cc-7d7d53e8a0cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:56.028348 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa05e38-0124-42f1-a3cc-7d7d53e8a0cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:56.028784 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa05e38-0124-42f1-a3cc-7d7d53e8a0cf admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:56.039851 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1439/2900] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:14:56.044021 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f86a8e8-29bd-4c65-b8b7-9bd9fbcf62ae admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:56.054318 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f86a8e8-29bd-4c65-b8b7-9bd9fbcf62ae admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:56.059057 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f6776-e1d5-4d58-9f55-9e345b25e89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:56.059784 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f6776-e1d5-4d58-9f55-9e345b25e89a admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:56.060066 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f6776-e1d5-4d58-9f55-9e345b25e89a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:56.060346 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f6776-e1d5-4d58-9f55-9e345b25e89a admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:56.061196 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f6776-e1d5-4d58-9f55-9e345b25e89a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:56.063313 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f6776-e1d5-4d58-9f55-9e345b25e89a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:56.073346 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1462/2901] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Jul 1 04:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 04:14:56.078238 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa05e38-0124-42f1-a3cc-7d7d53e8a0cf admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:56.088290 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa05e38-0124-42f1-a3cc-7d7d53e8a0cf admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:56.092885 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322999cf-922a-48f0-ba91-be7b09370352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:56.093804 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322999cf-922a-48f0-ba91-be7b09370352 admin admin] REQUEST_METHOD: `PUT` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:56.094087 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322999cf-922a-48f0-ba91-be7b09370352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:56.094361 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322999cf-922a-48f0-ba91-be7b09370352 admin admin] PATH_INFO: `/v3/projects/cfad9452aaca4bb0822d575734415e2f/users/16310b3d4f9848bdb33048bf0d8457fa/roles/c0b595782ebc410db693ef7fa70522a3` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:56.108956 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322999cf-922a-48f0-ba91-be7b09370352 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfad9452aaca4bb0822d575734415e2f, user_id=16310b3d4f9848bdb33048bf0d8457fa, role_id=c0b595782ebc410db693ef7fa70522a3)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:56.111705 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322999cf-922a-48f0-ba91-be7b09370352 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:56.187503 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1440/2902] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Jul 1 04:14:56 2022] PUT /identity/v3/projects/cfad9452aaca4bb0822d575734415e2f/users/16310b3d4f9848bdb33048bf0d8457fa/roles/c0b595782ebc410db693ef7fa70522a3 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:14:56.250970 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf9513-a3c8-4acf-af8d-9edc73f82515 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:56.251276 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf9513-a3c8-4acf-af8d-9edc73f82515 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:56.251612 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf9513-a3c8-4acf-af8d-9edc73f82515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:56.277998 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-febf9513-a3c8-4acf-af8d-9edc73f82515 None None] MFA Rules not processed for user `16310b3d4f9848bdb33048bf0d8457fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:14:56.279213 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-febf9513-a3c8-4acf-af8d-9edc73f82515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:14:56.339260 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:14:56.344500 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1463/2903] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:14:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:14:56.360681 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322999cf-922a-48f0-ba91-be7b09370352 admin admin] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:14:56.362578 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-322999cf-922a-48f0-ba91-be7b09370352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:14:56.404169 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:14:56.422013 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322999cf-922a-48f0-ba91-be7b09370352 admin admin] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:14:56.425834 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b5dc1d-7a36-485b-9e5a-b060fc1407aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '418106a8c3104dcfa40fcc6c68356294', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:14:56.426437 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5dc1d-7a36-485b-9e5a-b060fc1407aa service cinder] REQUEST_METHOD: `GET` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:14:56.426720 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5dc1d-7a36-485b-9e5a-b060fc1407aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:14:56.427527 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5dc1d-7a36-485b-9e5a-b060fc1407aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:14:56.436469 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b5dc1d-7a36-485b-9e5a-b060fc1407aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:14:56.438638 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b5dc1d-7a36-485b-9e5a-b060fc1407aa service cinder] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:14:56.448085 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1441/2904] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:14:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:15:06.403349 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:15:06.489522 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=10 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:15:07.863525 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf9513-a3c8-4acf-af8d-9edc73f82515 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:15:07.925994 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf9513-a3c8-4acf-af8d-9edc73f82515 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:15:07.930506 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30029094-4a4f-4d4f-93d0-3764144c5feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:15:07.931375 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30029094-4a4f-4d4f-93d0-3764144c5feb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:15:07.931683 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30029094-4a4f-4d4f-93d0-3764144c5feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:15:07.931978 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30029094-4a4f-4d4f-93d0-3764144c5feb admin admin] PATH_INFO: `/v3/users/16310b3d4f9848bdb33048bf0d8457fa` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:15:07.933113 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30029094-4a4f-4d4f-93d0-3764144c5feb admin admin] RBAC: Authorizing `identity:delete_user(user_id=16310b3d4f9848bdb33048bf0d8457fa)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:15:07.935074 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30029094-4a4f-4d4f-93d0-3764144c5feb admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:15:08.108517 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-30029094-4a4f-4d4f-93d0-3764144c5feb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16310b3d4f9848bdb33048bf0d8457fa'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:15:08.109083 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-30029094-4a4f-4d4f-93d0-3764144c5feb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16310b3d4f9848bdb33048bf0d8457fa'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:15:08.121488 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-30029094-4a4f-4d4f-93d0-3764144c5feb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16310b3d4f9848bdb33048bf0d8457fa'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:15:08.128981 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-30029094-4a4f-4d4f-93d0-3764144c5feb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16310b3d4f9848bdb33048bf0d8457fa'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:15:08.129628 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-30029094-4a4f-4d4f-93d0-3764144c5feb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16310b3d4f9848bdb33048bf0d8457fa'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:15:08.214668 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1464/2905] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Jul 1 04:15:07 2022] DELETE /identity/v3/users/16310b3d4f9848bdb33048bf0d8457fa => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 04:15:08.219151 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1029966-6c59-4f05-9945-e524943a96e3 None None] REQUEST_METHOD: `POST` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:15:08.219660 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1029966-6c59-4f05-9945-e524943a96e3 None None] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:15:08.219791 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1029966-6c59-4f05-9945-e524943a96e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:15:08.237346 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.auth.core [None req-a1029966-6c59-4f05-9945-e524943a96e3 None None] MFA Rules not processed for user `25426a981a294fbbafc4d23f43e2ba63`. Rule list: `[]` (Enabled: `True`). {{(pid=80376) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 04:15:08.238547 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-a1029966-6c59-4f05-9945-e524943a96e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:15:08.299880 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1442/2906] 10.222.0.46 () {58 vars in 957 bytes} [Fri Jul 1 04:15:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 04:15:08.309460 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30029094-4a4f-4d4f-93d0-3764144c5feb admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:15:08.310887 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-30029094-4a4f-4d4f-93d0-3764144c5feb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:15:08.368941 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30029094-4a4f-4d4f-93d0-3764144c5feb admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:15:08.372475 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3dfed7-bac7-4f89-8746-50b9284b931b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93929b81a23c482ca7ce47e7a94682e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:15:08.373184 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3dfed7-bac7-4f89-8746-50b9284b931b service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:15:08.373423 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3dfed7-bac7-4f89-8746-50b9284b931b service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:15:08.373674 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3dfed7-bac7-4f89-8746-50b9284b931b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:15:08.383716 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3dfed7-bac7-4f89-8746-50b9284b931b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:15:08.385165 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3dfed7-bac7-4f89-8746-50b9284b931b service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:15:08.394870 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1465/2907] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:15:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:15:08.873187 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1029966-6c59-4f05-9945-e524943a96e3 None None] Authenticating user token {{(pid=80376) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:15:08.874756 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.fernet_utils [None req-a1029966-6c59-4f05-9945-e524943a96e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80376) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:15:08.886747 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1029966-6c59-4f05-9945-e524943a96e3 None None] Validating token access rules against request {{(pid=80376) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:15:08.891350 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a931e-d152-4875-92b5-823c7ae545b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25426a981a294fbbafc4d23f43e2ba63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e246a3f333f94971a10397b9c77aad47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80376) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:15:08.892760 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a931e-d152-4875-92b5-823c7ae545b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:15:08.893043 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a931e-d152-4875-92b5-823c7ae545b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:15:08.893321 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a931e-d152-4875-92b5-823c7ae545b0 admin admin] PATH_INFO: `/v3/projects/cfad9452aaca4bb0822d575734415e2f` {{(pid=80376) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:15:08.894513 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a931e-d152-4875-92b5-823c7ae545b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfad9452aaca4bb0822d575734415e2f)` {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:15:08.899185 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a931e-d152-4875-92b5-823c7ae545b0 admin admin] RBAC: Authorization granted {{(pid=80376) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:15:09.067898 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-e09a931e-d152-4875-92b5-823c7ae545b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfad9452aaca4bb0822d575734415e2f', 'request_id': 'req-e09a931e-d152-4875-92b5-823c7ae545b0'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:15:09.074411 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-e09a931e-d152-4875-92b5-823c7ae545b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfad9452aaca4bb0822d575734415e2f', 'request_id': 'req-e09a931e-d152-4875-92b5-823c7ae545b0'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:15:09.080745 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-e09a931e-d152-4875-92b5-823c7ae545b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfad9452aaca4bb0822d575734415e2f', 'request_id': 'req-e09a931e-d152-4875-92b5-823c7ae545b0'} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:15:09.175992 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-e09a931e-d152-4875-92b5-823c7ae545b0 admin admin] The token cache is being invalidate because project cfad9452aaca4bb0822d575734415e2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80376) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 04:15:09.176201 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-e09a931e-d152-4875-92b5-823c7ae545b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:15:09.176808 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG keystone.notifications [None req-e09a931e-d152-4875-92b5-823c7ae545b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80376) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 04:15:09.178331 dv-cinder-846842-8-smb devstack@keystone.service[80376]: [pid: 80376|app: 0|req: 1443/2908] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Jul 1 04:15:08 2022] DELETE /identity/v3/projects/cfad9452aaca4bb0822d575734415e2f => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 04:15:18.390637 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:15:19.171252 dv-cinder-846842-8-smb devstack@keystone.service[80376]: DEBUG dbcounter [-] [80376] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80376) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 04:18:53.132382 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3dfed7-bac7-4f89-8746-50b9284b931b service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 04:18:53.133834 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-7f3dfed7-bac7-4f89-8746-50b9284b931b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:18:53.277213 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3dfed7-bac7-4f89-8746-50b9284b931b service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 04:18:53.335758 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66e87b-4539-4fff-8ea5-bfd0750162d1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4efe4a6dd11047688892641a936e2914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da83db15a312499fb627691ae442f233', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 04:18:53.336325 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66e87b-4539-4fff-8ea5-bfd0750162d1 service placement] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 04:18:53.336605 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66e87b-4539-4fff-8ea5-bfd0750162d1 service placement] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 04:18:53.336879 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66e87b-4539-4fff-8ea5-bfd0750162d1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 04:18:53.338656 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-da66e87b-4539-4fff-8ea5-bfd0750162d1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 04:18:53.349884 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da66e87b-4539-4fff-8ea5-bfd0750162d1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 04:18:53.351554 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da66e87b-4539-4fff-8ea5-bfd0750162d1 service placement] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 04:18:53.362382 dv-cinder-846842-8-smb devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1466/2909] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Jul 1 04:18:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 04:19:03.357895 dv-cinder-846842-8-smb devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}